Sep 14 10:25:02.337992 ip-10-0-135-139 systemd[1]: Starting Kubernetes Kubelet...
Sep 14 10:25:02.730937 ip-10-0-135-139 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 10:25:02.730937 ip-10-0-135-139 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 14 10:25:02.730937 ip-10-0-135-139 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 10:25:02.730937 ip-10-0-135-139 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 14 10:25:02.730937 ip-10-0-135-139 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 10:25:02.732008 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.731926    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 14 10:25:02.736257 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736242    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:25:02.736257 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736256    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736261    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736264    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736267    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736270    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736272    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736275    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736278    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736280    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736282    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736286    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736288    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736291    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736294    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736296    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736298    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736301    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736303    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736305    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736313    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:25:02.736333 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736316    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736319    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736322    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736325    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736328    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736330    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736334    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736338    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736342    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736346    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736349    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736351    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736354    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736357    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736360    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736363    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736366    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736368    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736370    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:25:02.736850 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736373    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736375    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736377    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736380    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736382    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736385    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736387    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736389    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736392    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736394    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736396    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736399    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736401    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736403    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736406    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736409    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736412    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736414    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736417    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736419    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:25:02.737295 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736422    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736424    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736426    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736429    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736431    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736434    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736436    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736438    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736441    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736443    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736448    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736451    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736455    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736459    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736462    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736464    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736467    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736469    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736472    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:25:02.737763 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736474    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736476    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736479    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736481    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736484    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736486    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736488    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736491    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736494    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736497    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736499    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736502    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736504    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736507    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736509    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736512    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736514    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736517    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736520    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.736522    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:25:02.738229 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737183    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737189    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737191    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737194    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737197    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737200    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737202    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737205    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737208    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737210    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737213    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737215    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737218    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737220    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737223    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737226    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737229    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737231    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737234    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737236    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:25:02.738721 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737239    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737242    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737244    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737246    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737249    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737251    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737254    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737256    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737259    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737263    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737266    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737269    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737271    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737274    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737277    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737279    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737281    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737284    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737287    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:25:02.739202 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737289    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737293    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737295    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737298    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737300    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737303    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737305    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737308    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737310    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737314    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737316    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737318    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737321    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737324    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737326    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737329    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737332    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737335    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737337    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:25:02.739643 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737340    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737342    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737345    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737347    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737349    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737352    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737354    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737356    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737359    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737361    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737363    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737366    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737368    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737371    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737373    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737376    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737378    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737382    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737384    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737387    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:25:02.740117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737390    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737392    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737395    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737398    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737400    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737403    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737407    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737410    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737412    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737415    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737417    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737420    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737422    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737425    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737427    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737429    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737432    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737434    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737436    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737439    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:25:02.740603 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737441    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737793    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737798    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737800    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737803    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737811    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737814    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737816    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737819    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737824    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737827    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737830    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737832    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737835    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737838    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737840    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737842    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737845    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737847    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:25:02.741083 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737850    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737853    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737857    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737859    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737862    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737865    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737867    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737869    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737872    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737875    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737877    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737879    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737882    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737884    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737886    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737889    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737891    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737893    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737896    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:25:02.741529 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737899    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737901    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737904    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737907    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737910    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737913    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737915    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737918    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737920    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737923    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737925    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737927    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737930    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737933    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737935    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737938    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737940    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737942    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737944    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737947    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:25:02.742017 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737950    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737952    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737954    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737958    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737961    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737964    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737967    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737970    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737972    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737975    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737977    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737980    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737982    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737986    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737988    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737993    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737996    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.737998    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738001    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:25:02.742480 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738003    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738006    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738009    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738011    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738013    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738016    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738019    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738021    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738024    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738026    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738028    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738031    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738034    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738036    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738038    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738041    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738043    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738046    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738048    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738050    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:25:02.742980 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738054    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738057    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738060    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738133    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738167    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738173    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738177    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738181    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738187    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738191    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738195    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738198    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738201    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738204    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738207    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738210    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738213    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738216    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738219    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738221    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738224    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738228    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738231    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738234    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 14 10:25:02.743441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738237    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738241    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738245    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738247    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738250    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738253    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738257    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738259    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738262    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738265    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738268    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738272    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738275    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738277    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738280    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738283    2578 flags.go:64] FLAG: --enable-server="true"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738288    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738292    2578 flags.go:64] FLAG: --event-burst="100"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738295    2578 flags.go:64] FLAG: --event-qps="50"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738297    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738300    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738303    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738306    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738309    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738312    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 14 10:25:02.744029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738314    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738317    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738320    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738323    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738325    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738328    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738331    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738333    2578 flags.go:64] FLAG: --feature-gates=""
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738337    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738340    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738343    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738345    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738348    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738351    2578 flags.go:64] FLAG: --help="false"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738354    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-139.ec2.internal"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738356    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738359    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738362    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738366    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738369    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738371    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738374    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738377    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 14 10:25:02.744621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738381    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738384    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738387    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738390    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738392    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738395    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738398    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738401    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738403    2578 flags.go:64] FLAG: --lock-file=""
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738406    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738408    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738411    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738417    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738419    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738422    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738424    2578 flags.go:64] FLAG: --logging-format="text"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738427    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738430    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738433    2578 flags.go:64] FLAG: --manifest-url=""
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738435    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738439    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738442    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738445    2578 flags.go:64] FLAG: --max-pods="110"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738448    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738451    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 14 10:25:02.745194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738454    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738456    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738459    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738462    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738465    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738471    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738473    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738478    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738481    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738484    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738490    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738492    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738495    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738498    2578 flags.go:64] FLAG: --port="10250"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738501    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738504    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09f75d10b8a36b203"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738507    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738509    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738512    2578 flags.go:64] FLAG: --register-node="true"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738515    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738518    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738521    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738523    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738526    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738529    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 14 10:25:02.745796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738532    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738535    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738537    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738540    2578 flags.go:64] FLAG: --runonce="false"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738543    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738545    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738548    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738551    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738553    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738556    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738559    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738562    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738564    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738567    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738570    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738573    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738576    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738580    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738583    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738588    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738591    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738594    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738598    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738600    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738603    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 14 10:25:02.746460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738605    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738608    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738611    2578 flags.go:64] FLAG: --v="2"
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738614    2578 flags.go:64] FLAG: --version="false"
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738618    2578 flags.go:64] FLAG: --vmodule=""
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738621    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.738624    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738740    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738744    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738747    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738750    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738753    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738755    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738758    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738761    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738764    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738767    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738770    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738773    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738775    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738778    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738782    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:25:02.747059 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738786    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738789    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738791    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738794    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738796    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738799    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738801    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738805    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738809    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738812    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738814    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738817    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738819    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738821    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738824    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738826    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738829    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738831    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738834    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:25:02.747580 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738836    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738839    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738841    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738843    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738846    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738848    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738851    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738853    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738856    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738858    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738860    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738863    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738868    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738873    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738876    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738879    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738882    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738885    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738887    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:25:02.748054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738890    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738892    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738895    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738897    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738900    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738902    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738904    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738907    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738909    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738911    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738914    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738916    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738918    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738921    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738923    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738925    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738928    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738930    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738933    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738935    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:25:02.748508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738938    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738940    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738942    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738945    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738947    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738951    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738955    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738957    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738961    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738964    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738967    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738970    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738973    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738975    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738978    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738981    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738984    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738986    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738989    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:25:02.749101 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738991    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738993    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738996    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.738998    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.739001    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.739003    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.739005    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.739655    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.747546    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.747559    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.748401    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.748408    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748462    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748467    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748470    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:25:02.749556 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748474    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748477    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748479    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748482    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748485    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748487    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748490    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748492    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748495    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748498    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748500    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748503    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748505    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748508    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748511    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748513    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748516    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748518    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748521    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748524    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:25:02.749996 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748526    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748528    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748531    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748534    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748536    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748541    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748544    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748547    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748550    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748553    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748557    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748559    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748562    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748565    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748568    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748571    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748573    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748576    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748579    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:25:02.750450 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748581    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748584    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748586    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748589    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748592    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748594    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748596    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748599    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748601    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748604    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748606    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748609    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748611    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748613    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748616    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748618    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748621    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748623    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748626    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748628    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:25:02.750913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748631    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748633    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748637    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748640    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748643    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748645    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748648    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748650    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748652    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748655    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748657    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748660    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748662    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748664    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748667    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748691    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748698    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748701    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748704    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:25:02.751378 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748707    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748709    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748712    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748714    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748717    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748719    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748721    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748724    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748726    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748728    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748731    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748734    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748736    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748739    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748742    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748744    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748746    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:25:02.751912 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748749    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.748754    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748904    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748909    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748913    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748915    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748918    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748921    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748923    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748926    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748928    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748931    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748933    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748936    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748939    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:25:02.752314 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748941    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748944    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748946    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748949    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748951    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748954    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748956    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748959    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748962    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748964    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748966    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748969    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748971    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748974    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748976    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748978    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748981    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748983    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748986    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:25:02.752704 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748988    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748990    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748992    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748996    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.748999    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749002    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749005    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749007    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749010    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749013    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749015    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749018    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749022    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749024    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749027    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749030    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749032    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749035    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749038    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:25:02.753157 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749041    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749044    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749047    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749050    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749052    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749055    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749058    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749060    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749063    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749065    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749068    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749070    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749073    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749075    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749077    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749080    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749082    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749085    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749087    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749089    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:25:02.753602 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749092    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749094    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749096    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749098    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749101    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749103    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749106    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749110    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749115    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749118    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749121    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749123    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749125    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749128    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749131    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749133    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749136    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749138    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749141    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749143    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:25:02.754072 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749145    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749148    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749150    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749152    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749155    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749157    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749159    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:02.749162    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.749166    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.749257    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.751603    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.752576    2578 server.go:1019] "Starting client certificate rotation"
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.752685    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 10:25:02.754547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.753507    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 10:25:02.755293 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.755280    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 10:25:02.756383 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.756359    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 10:25:02.768743 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.768726    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 14 10:25:02.772230 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.772214    2578 log.go:25] "Validated CRI v1 image API"
Sep 14 10:25:02.776548 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.776532    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 14 10:25:02.779955 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.779934    2578 fs.go:135] Filesystem UUIDs: map[01048427-eece-43d3-a4a5-f269d6b3c467:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 db8c3ff6-1a9b-4ddd-807c-f3ce2859949b:/dev/nvme0n1p4]
Sep 14 10:25:02.780038 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.779955    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 14 10:25:02.785831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.785723    2578 manager.go:216] Machine: {Timestamp:2026-09-14 10:25:02.78445266 +0000 UTC m=+0.325854452 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3217243 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e66a06fa98b2c07c1ab9db87790c SystemUUID:ec25e66a-06fa-98b2-c07c-1ab9db87790c BootID:872b3394-f4ec-427a-8633-97a9ad0b450d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d1:43:66:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d1:43:66:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:4b:72:d3:d0:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 14 10:25:02.785831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.785820    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 14 10:25:02.786014 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.785911    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 14 10:25:02.787034 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.787012    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 14 10:25:02.787186 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.787037    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 14 10:25:02.788633 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.788622    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 14 10:25:02.788666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.788635    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 14 10:25:02.788666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.788643    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 10:25:02.788972 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.788954    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 10:25:02.789462 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.789451    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 10:25:02.790771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.790762    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 14 10:25:02.795265 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.795253    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 10:25:02.795380 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.795371    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 14 10:25:02.795419 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.795401    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 14 10:25:02.795419 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.795417    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 14 10:25:02.795484 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.795432    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 14 10:25:02.795484 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.795441    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 14 10:25:02.795484 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.795449    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 14 10:25:02.795825 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.795813    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 10:25:02.795878 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.795833    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 10:25:02.798266 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.798241    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 14 10:25:02.801218 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.801204    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 14 10:25:02.801263 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.801234    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 14 10:25:02.803451 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803437    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 14 10:25:02.803483 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803469    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 14 10:25:02.803483 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803480    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 14 10:25:02.803538 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803488    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 14 10:25:02.803538 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803500    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 14 10:25:02.803538 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803508    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 14 10:25:02.803538 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803527    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 14 10:25:02.803538 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803535    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 14 10:25:02.803660 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803542    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 14 10:25:02.803660 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803547    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 14 10:25:02.803660 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803556    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 14 10:25:02.803660 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.803568    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 14 10:25:02.805374 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.805361    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 14 10:25:02.805412 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.805376    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 14 10:25:02.808245 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.808217    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 14 10:25:02.808284 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.808247    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 14 10:25:02.808320 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.808275    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 14 10:25:02.809178 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.809166    2578 server.go:1268] "Started kubelet"
Sep 14 10:25:02.809269 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.809239    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 14 10:25:02.809323 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.809294    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 14 10:25:02.809407 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.809314    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 14 10:25:02.810048 ip-10-0-135-139 systemd[1]: Started Kubernetes Kubelet.
Sep 14 10:25:02.813706 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.813662    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 14 10:25:02.815088 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.815064    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 14 10:25:02.817041 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.817028    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 14 10:25:02.822497 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.822476    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 14 10:25:02.823185 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.823168    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 14 10:25:02.823274 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.823256    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:02.823830 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.823797    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 14 10:25:02.823830 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.823814    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 14 10:25:02.823927 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.823841    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 14 10:25:02.823927 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.823913    2578 factory.go:55] Registering systemd factory
Sep 14 10:25:02.823996 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.823928    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 14 10:25:02.823996 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.823914    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 14 10:25:02.823996 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.823975    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 14 10:25:02.824132 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.824115    2578 factory.go:153] Registering CRI-O factory
Sep 14 10:25:02.824132 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.824131    2578 factory.go:223] Registration of the crio container factory successfully
Sep 14 10:25:02.824266 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.824179    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 14 10:25:02.824266 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.824193    2578 factory.go:103] Registering Raw factory
Sep 14 10:25:02.824266 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.824207    2578 manager.go:1196] Started watching for new ooms in manager
Sep 14 10:25:02.824528 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.824519    2578 manager.go:349] Starting recovery of all containers
Sep 14 10:25:02.829017 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.828861    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tpbq"
Sep 14 10:25:02.829380 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.829350    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 14 10:25:02.830909 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.829666    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-139.ec2.internal.18d528ff0a97d85d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-139.ec2.internal,UID:ip-10-0-135-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-139.ec2.internal,},FirstTimestamp:2026-09-14 10:25:02.809135197 +0000 UTC m=+0.350536988,LastTimestamp:2026-09-14 10:25:02.809135197 +0000 UTC m=+0.350536988,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-139.ec2.internal,}"
Sep 14 10:25:02.834733 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.834699    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 14 10:25:02.834947 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.834926    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tpbq"
Sep 14 10:25:02.835180 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.835165    2578 manager.go:354] Recovery completed
Sep 14 10:25:02.839858 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.839845    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:25:02.841768 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.841752    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:25:02.841831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.841792    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:25:02.841831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.841806    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:25:02.842337 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.842324    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 14 10:25:02.842337 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.842337    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 14 10:25:02.842442 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.842343    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:25:02.842442 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.842353    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 10:25:02.843086 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.843073    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:25:02.843136 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.843116    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:25:02.843136 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.843134    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:25:02.843417 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.843407    2578 policy_none.go:49] "None policy: Start"
Sep 14 10:25:02.843449 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.843422    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 14 10:25:02.843449 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.843431    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 14 10:25:02.844289 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.844225    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-139.ec2.internal.18d528ff0c89cf75  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-139.ec2.internal,UID:ip-10-0-135-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-139.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-139.ec2.internal,},FirstTimestamp:2026-09-14 10:25:02.841769845 +0000 UTC m=+0.383171647,LastTimestamp:2026-09-14 10:25:02.841769845 +0000 UTC m=+0.383171647,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-139.ec2.internal,}"
Sep 14 10:25:02.844402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.844381    2578 policy_none.go:47] "Start"
Sep 14 10:25:02.883289 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.883253    2578 manager.go:337] "Starting Device Plugin manager"
Sep 14 10:25:02.883289 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.883300    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 14 10:25:02.887881 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.883313    2578 server.go:87] "Starting device plugin registration server"
Sep 14 10:25:02.887881 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.883659    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 14 10:25:02.887881 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.883687    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 14 10:25:02.887881 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.883795    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 14 10:25:02.887881 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.883877    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 14 10:25:02.887881 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.883888    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 14 10:25:02.887881 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.884499    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 14 10:25:02.887881 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.884549    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:02.969352 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.969314    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 14 10:25:02.970562 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.970545    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 14 10:25:02.970656 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.970596    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 14 10:25:02.970656 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.970621    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 14 10:25:02.970751 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.970662    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 14 10:25:02.972734 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.972713    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:25:02.984599 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.984542    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:25:02.985299 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.985282    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:25:02.985386 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.985312    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:25:02.985386 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.985323    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:25:02.985386 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.985342    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-139.ec2.internal"
Sep 14 10:25:02.992340 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:02.992326    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-139.ec2.internal"
Sep 14 10:25:02.992380 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:02.992347    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-139.ec2.internal\": node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.009156 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.009132    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.070739 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.070710    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal"]
Sep 14 10:25:03.070848 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.070786    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:25:03.072088 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.072073    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:25:03.072172 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.072107    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:25:03.072172 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.072120    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:25:03.073312 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.073298    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:25:03.073427 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.073412    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.073474 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.073443    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:25:03.073975 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.073960    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:25:03.073975 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.073970    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:25:03.074102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.073987    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:25:03.074102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.073992    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:25:03.074102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.074001    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:25:03.074102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.074006    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:25:03.075037 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.075022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.075108 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.075047    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:25:03.075650 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.075636    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:25:03.075733 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.075657    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:25:03.075733 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.075683    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:25:03.098168 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.098142    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-139.ec2.internal\" not found" node="ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.102310 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.102295    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-139.ec2.internal\" not found" node="ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.109242 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.109226    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.132098 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.132069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b3ece645199dcff1203654d50efe554-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal\" (UID: \"0b3ece645199dcff1203654d50efe554\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.132098 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.132102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3ece645199dcff1203654d50efe554-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal\" (UID: \"0b3ece645199dcff1203654d50efe554\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.132183 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.132123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f2534fef1caace65913d4394bf8e9e2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-139.ec2.internal\" (UID: \"6f2534fef1caace65913d4394bf8e9e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.210278 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.210259    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.232658 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.232637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b3ece645199dcff1203654d50efe554-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal\" (UID: \"0b3ece645199dcff1203654d50efe554\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.232719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.232694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3ece645199dcff1203654d50efe554-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal\" (UID: \"0b3ece645199dcff1203654d50efe554\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.232751 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.232730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b3ece645199dcff1203654d50efe554-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal\" (UID: \"0b3ece645199dcff1203654d50efe554\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.232785 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.232749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3ece645199dcff1203654d50efe554-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal\" (UID: \"0b3ece645199dcff1203654d50efe554\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.232829 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.232796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f2534fef1caace65913d4394bf8e9e2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-139.ec2.internal\" (UID: \"6f2534fef1caace65913d4394bf8e9e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.232862 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.232853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f2534fef1caace65913d4394bf8e9e2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-139.ec2.internal\" (UID: \"6f2534fef1caace65913d4394bf8e9e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.310545 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.310499    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.401022 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.400996    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.405759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.405743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:03.411610 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.411591    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.512039 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.512011    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.612517 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.612456    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.713127 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.713091    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.752547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.752527    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 14 10:25:03.752955 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.752687    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 14 10:25:03.813495 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.813475    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:03.838734 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.838708    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-13 10:20:02 +0000 UTC" deadline="2028-03-30 09:28:20.090396216 +0000 UTC"
Sep 14 10:25:03.838734 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.838731    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13511h3m16.251668392s"
Sep 14 10:25:03.875100 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:03.875045    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:25:03.913686 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:03.913652    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:04.014400 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.014380    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:04.019203 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:04.019174    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3ece645199dcff1203654d50efe554.slice/crio-3f76c8071f678f29fcc2a03e199f749d6b6739e6919f76d0351d48721f82d130 WatchSource:0}: Error finding container 3f76c8071f678f29fcc2a03e199f749d6b6739e6919f76d0351d48721f82d130: Status 404 returned error can't find the container with id 3f76c8071f678f29fcc2a03e199f749d6b6739e6919f76d0351d48721f82d130
Sep 14 10:25:04.019366 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:04.019349    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2534fef1caace65913d4394bf8e9e2.slice/crio-b6991740a5256d1b5cbc377b86c49511a393af0c9abc3517945a35a889498c12 WatchSource:0}: Error finding container b6991740a5256d1b5cbc377b86c49511a393af0c9abc3517945a35a889498c12: Status 404 returned error can't find the container with id b6991740a5256d1b5cbc377b86c49511a393af0c9abc3517945a35a889498c12
Sep 14 10:25:04.025035 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.025019    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:25:04.114819 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.114796    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:04.215355 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.215277    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-139.ec2.internal\" not found"
Sep 14 10:25:04.232909 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.232888    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:25:04.323834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.323805    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:04.327371 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.327344    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:25:04.338037 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.338011    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 10:25:04.338988 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.338975    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal"
Sep 14 10:25:04.351273 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.351258    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 10:25:04.796418 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.796385    2578 apiserver.go:52] "Watching apiserver"
Sep 14 10:25:04.805519 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.805488    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 14 10:25:04.807633 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.807604    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal","openshift-multus/network-metrics-daemon-b4s8s","openshift-network-operator/iptables-alerter-pb5n5","openshift-ovn-kubernetes/ovnkube-node-h7zz8","kube-system/global-pull-secret-syncer-qs687","kube-system/konnectivity-agent-xtj7j","kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5","openshift-multus/multus-additional-cni-plugins-hdzl9","openshift-multus/multus-p9xd9","openshift-network-diagnostics/network-check-target-hfzjz","openshift-cluster-node-tuning-operator/tuned-ttrhx","openshift-dns/node-resolver-5kmw4","openshift-image-registry/node-ca-6j4z8"]
Sep 14 10:25:04.808974 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.808952    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.810141 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.810122    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:04.810239 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.810180    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:04.810969 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.810897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.811575 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.811552    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 14 10:25:04.811575 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.811545    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 14 10:25:04.811843 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.811828    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9zl2s\""
Sep 14 10:25:04.811900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.811845    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 14 10:25:04.812048 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.812029    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 14 10:25:04.812852 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.812567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.813761 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.813202    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:25:04.816707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.816223    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 14 10:25:04.816707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.816307    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b7nj6\""
Sep 14 10:25:04.816707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.816398    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 14 10:25:04.816707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.816407    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 14 10:25:04.816707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.816498    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 14 10:25:04.816707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.816592    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r29bk\""
Sep 14 10:25:04.817739 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.817723    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 14 10:25:04.817917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.817902    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 14 10:25:04.818067 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.818053    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 14 10:25:04.818121 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.818094    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 14 10:25:04.818230 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.818217    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.821773 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.821753    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 14 10:25:04.821920 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.821759    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:04.822022 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.821979    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 14 10:25:04.822260 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.822246    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 14 10:25:04.822354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.822248    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:25:04.822417 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.821917    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4nms4\""
Sep 14 10:25:04.823435 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.823421    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 14 10:25:04.824281 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.824265    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.824918 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.824902    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 14 10:25:04.825330 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.825309    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 14 10:25:04.825683 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.825651    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2kppw\""
Sep 14 10:25:04.826722 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.826708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.827283 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.827258    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 14 10:25:04.827497 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.827399    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hrxx4\""
Sep 14 10:25:04.827871 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.827855    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 14 10:25:04.828458 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.828240    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:04.828458 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.828305    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:04.829054 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.829040    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 14 10:25:04.829400 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.829386    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 14 10:25:04.829831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.829814    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v9pk9\""
Sep 14 10:25:04.830760 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.830641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:04.832780 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.832464    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.833166 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.833125    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 14 10:25:04.833166 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.833142    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 14 10:25:04.833794 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.833427    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 14 10:25:04.833794 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.833489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:04.833794 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.833497    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2l6tm\""
Sep 14 10:25:04.833794 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.833536    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:04.837053 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.837033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 14 10:25:04.837279 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.837268    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:25:04.837642 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.837631    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qv9v6\""
Sep 14 10:25:04.839829 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.839789    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 10:25:04.841283 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-node-log\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1c4c374-a18b-441b-b87d-58fcb8a86aa2-konnectivity-ca\") pod \"konnectivity-agent-xtj7j\" (UID: \"d1c4c374-a18b-441b-b87d-58fcb8a86aa2\") " pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:04.841367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-ovn-node-metrics-cert\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7433f80-c853-450f-a099-d82d0f41cb5c-system-cni-dir\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.841367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-env-overrides\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841553 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55-tmp-dir\") pod \"node-resolver-5kmw4\" (UID: \"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55\") " pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.841553 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-hostroot\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.841553 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-systemd-units\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841553 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-etc-openvswitch\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841553 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-cni-netd\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841553 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6f7w\" (UniqueName: \"kubernetes.io/projected/19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55-kube-api-access-k6f7w\") pod \"node-resolver-5kmw4\" (UID: \"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55\") " pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.841553 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-cni-dir\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.841553 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb6kg\" (UniqueName: \"kubernetes.io/projected/9fb96906-7504-42f9-97b1-98b23a0a63d8-kube-api-access-gb6kg\") pod \"node-ca-6j4z8\" (UID: \"9fb96906-7504-42f9-97b1-98b23a0a63d8\") " pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7433f80-c853-450f-a099-d82d0f41cb5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-socket-dir-parent\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvlwf\" (UniqueName: \"kubernetes.io/projected/6ccdc7e1-a9c0-41db-bc27-091299ec4729-kube-api-access-pvlwf\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-run-netns\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-run-systemd\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-run-openvswitch\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-run-ovn-kubernetes\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fb96906-7504-42f9-97b1-98b23a0a63d8-host\") pod \"node-ca-6j4z8\" (UID: \"9fb96906-7504-42f9-97b1-98b23a0a63d8\") " pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-run-k8s-cni-cncf-io\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.841937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-daemon-config\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-slash\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.841997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac-iptables-alerter-script\") pod \"iptables-alerter-pb5n5\" (UID: \"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac\") " pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7433f80-c853-450f-a099-d82d0f41cb5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-var-lib-kubelet\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-conf-dir\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-log-socket\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-etc-kubernetes\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55-hosts-file\") pod \"node-resolver-5kmw4\" (UID: \"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55\") " pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7433f80-c853-450f-a099-d82d0f41cb5c-cnibin\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7433f80-c853-450f-a099-d82d0f41cb5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-run-netns\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-var-lib-cni-bin\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-var-lib-cni-multus\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.842353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-kubelet\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-var-lib-openvswitch\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-run-multus-certs\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9fb96906-7504-42f9-97b1-98b23a0a63d8-serviceca\") pod \"node-ca-6j4z8\" (UID: \"9fb96906-7504-42f9-97b1-98b23a0a63d8\") " pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-system-cni-dir\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ccdc7e1-a9c0-41db-bc27-091299ec4729-cni-binary-copy\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac-host-slash\") pod \"iptables-alerter-pb5n5\" (UID: \"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac\") " pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxgtp\" (UniqueName: \"kubernetes.io/projected/eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac-kube-api-access-vxgtp\") pod \"iptables-alerter-pb5n5\" (UID: \"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac\") " pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1c4c374-a18b-441b-b87d-58fcb8a86aa2-agent-certs\") pod \"konnectivity-agent-xtj7j\" (UID: \"d1c4c374-a18b-441b-b87d-58fcb8a86aa2\") " pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7433f80-c853-450f-a099-d82d0f41cb5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-cnibin\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-ovnkube-script-lib\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s7pk\" (UniqueName: \"kubernetes.io/projected/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-kube-api-access-6s7pk\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-run-ovn\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-cni-bin\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.843049 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-ovnkube-config\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.843626 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.842787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wwbc\" (UniqueName: \"kubernetes.io/projected/d7433f80-c853-450f-a099-d82d0f41cb5c-kube-api-access-6wwbc\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.860481 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.860463    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ml5bz"
Sep 14 10:25:04.868771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.868758    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ml5bz"
Sep 14 10:25:04.925106 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.925081    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 14 10:25:04.942961 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.942933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-ovn-node-metrics-cert\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.942969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7433f80-c853-450f-a099-d82d0f41cb5c-system-cni-dir\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.943107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.942992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-device-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:04.943107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-env-overrides\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55-tmp-dir\") pod \"node-resolver-5kmw4\" (UID: \"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55\") " pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.943107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-hostroot\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.943107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-systemd-units\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-etc-openvswitch\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-cni-netd\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6f7w\" (UniqueName: \"kubernetes.io/projected/19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55-kube-api-access-k6f7w\") pod \"node-resolver-5kmw4\" (UID: \"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55\") " pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-cni-dir\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb6kg\" (UniqueName: \"kubernetes.io/projected/9fb96906-7504-42f9-97b1-98b23a0a63d8-kube-api-access-gb6kg\") pod \"node-ca-6j4z8\" (UID: \"9fb96906-7504-42f9-97b1-98b23a0a63d8\") " pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7433f80-c853-450f-a099-d82d0f41cb5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-socket-dir-parent\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-systemd-units\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-socket-dir-parent\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvlwf\" (UniqueName: \"kubernetes.io/projected/6ccdc7e1-a9c0-41db-bc27-091299ec4729-kube-api-access-pvlwf\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prkkd\" (UniqueName: \"kubernetes.io/projected/80c3e812-6a9f-4945-b043-2cf5ebe13963-kube-api-access-prkkd\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-etc-openvswitch\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-registration-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943392    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-cni-netd\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-run-netns\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-run-systemd\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.943479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-run-openvswitch\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-run-ovn-kubernetes\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq4zc\" (UniqueName: \"kubernetes.io/projected/a7db74e4-0e04-42f9-9988-5bf8c214aa88-kube-api-access-sq4zc\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2a0e91f-654d-4dc1-aeaa-14267a34a523-dbus\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fb96906-7504-42f9-97b1-98b23a0a63d8-host\") pod \"node-ca-6j4z8\" (UID: \"9fb96906-7504-42f9-97b1-98b23a0a63d8\") " pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-run-k8s-cni-cncf-io\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-daemon-config\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg5c2\" (UniqueName: \"kubernetes.io/projected/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-kube-api-access-sg5c2\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-slash\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac-iptables-alerter-script\") pod \"iptables-alerter-pb5n5\" (UID: \"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac\") " pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7433f80-c853-450f-a099-d82d0f41cb5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-var-lib-kubelet\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-conf-dir\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-sys\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-cni-dir\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-log-socket\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.944208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-etc-kubernetes\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-systemd\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-tmp\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55-hosts-file\") pod \"node-resolver-5kmw4\" (UID: \"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55\") " pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7433f80-c853-450f-a099-d82d0f41cb5c-cnibin\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7433f80-c853-450f-a099-d82d0f41cb5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-run-netns\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-var-lib-cni-bin\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-var-lib-cni-multus\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-var-lib-kubelet\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.943975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-kubelet\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-var-lib-openvswitch\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-modprobe-d\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-tuned\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-run-multus-certs\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.944912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9fb96906-7504-42f9-97b1-98b23a0a63d8-serviceca\") pod \"node-ca-6j4z8\" (UID: \"9fb96906-7504-42f9-97b1-98b23a0a63d8\") " pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-system-cni-dir\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ccdc7e1-a9c0-41db-bc27-091299ec4729-cni-binary-copy\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-sys-fs\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-sysconfig\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-sysctl-conf\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-host\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac-host-slash\") pod \"iptables-alerter-pb5n5\" (UID: \"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac\") " pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxgtp\" (UniqueName: \"kubernetes.io/projected/eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac-kube-api-access-vxgtp\") pod \"iptables-alerter-pb5n5\" (UID: \"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac\") " pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1c4c374-a18b-441b-b87d-58fcb8a86aa2-agent-certs\") pod \"konnectivity-agent-xtj7j\" (UID: \"d1c4c374-a18b-441b-b87d-58fcb8a86aa2\") " pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7433f80-c853-450f-a099-d82d0f41cb5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-cnibin\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-sysctl-d\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-ovnkube-script-lib\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s7pk\" (UniqueName: \"kubernetes.io/projected/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-kube-api-access-6s7pk\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:04.945551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-run\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7433f80-c853-450f-a099-d82d0f41cb5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-run-ovn\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-cni-bin\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-ovnkube-config\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wwbc\" (UniqueName: \"kubernetes.io/projected/d7433f80-c853-450f-a099-d82d0f41cb5c-kube-api-access-6wwbc\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-socket-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-kubernetes\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-lib-modules\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-node-log\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1c4c374-a18b-441b-b87d-58fcb8a86aa2-konnectivity-ca\") pod \"konnectivity-agent-xtj7j\" (UID: \"d1c4c374-a18b-441b-b87d-58fcb8a86aa2\") " pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2a0e91f-654d-4dc1-aeaa-14267a34a523-kubelet-config\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944723    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55-hosts-file\") pod \"node-resolver-5kmw4\" (UID: \"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55\") " pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7433f80-c853-450f-a099-d82d0f41cb5c-cnibin\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.944892    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-run-netns\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7433f80-c853-450f-a099-d82d0f41cb5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.946264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-kubelet\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-var-lib-openvswitch\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7433f80-c853-450f-a099-d82d0f41cb5c-system-cni-dir\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945259    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-run-multus-certs\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945127    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-var-lib-cni-bin\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945519    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-var-lib-cni-multus\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945576    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-hostroot\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9fb96906-7504-42f9-97b1-98b23a0a63d8-serviceca\") pod \"node-ca-6j4z8\" (UID: \"9fb96906-7504-42f9-97b1-98b23a0a63d8\") " pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55-tmp-dir\") pod \"node-resolver-5kmw4\" (UID: \"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55\") " pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-run-netns\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-run-systemd\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-run-openvswitch\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-run-ovn-kubernetes\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.945985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-cni-bin\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac-iptables-alerter-script\") pod \"iptables-alerter-pb5n5\" (UID: \"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac\") " pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946094    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7433f80-c853-450f-a099-d82d0f41cb5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946094    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946135    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-cnibin\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.946999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946171    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7433f80-c853-450f-a099-d82d0f41cb5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-etc-kubernetes\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946304    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-system-cni-dir\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-ovnkube-script-lib\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-ovnkube-config\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ccdc7e1-a9c0-41db-bc27-091299ec4729-cni-binary-copy\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-log-socket\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-conf-dir\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-node-log\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-run-ovn\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-var-lib-kubelet\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac-host-slash\") pod \"iptables-alerter-pb5n5\" (UID: \"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac\") " pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.946982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fb96906-7504-42f9-97b1-98b23a0a63d8-host\") pod \"node-ca-6j4z8\" (UID: \"9fb96906-7504-42f9-97b1-98b23a0a63d8\") " pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.947016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-host-slash\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.947070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ccdc7e1-a9c0-41db-bc27-091299ec4729-host-run-k8s-cni-cncf-io\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.947268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1c4c374-a18b-441b-b87d-58fcb8a86aa2-konnectivity-ca\") pod \"konnectivity-agent-xtj7j\" (UID: \"d1c4c374-a18b-441b-b87d-58fcb8a86aa2\") " pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.947363    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ccdc7e1-a9c0-41db-bc27-091299ec4729-multus-daemon-config\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.947899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.947552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-env-overrides\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.948779 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.948760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-ovn-node-metrics-cert\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.950317 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.950298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1c4c374-a18b-441b-b87d-58fcb8a86aa2-agent-certs\") pod \"konnectivity-agent-xtj7j\" (UID: \"d1c4c374-a18b-441b-b87d-58fcb8a86aa2\") " pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:04.954986 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.954965    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:25:04.955082 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.954992    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:25:04.955082 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.955021    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vft5g for pod openshift-network-diagnostics/network-check-target-hfzjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:04.955195 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:04.955095    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g podName:20ac4e2f-ee02-4246-8a3e-dc906ce775d2 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:05.455063007 +0000 UTC m=+2.996464786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vft5g" (UniqueName: "kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g") pod "network-check-target-hfzjz" (UID: "20ac4e2f-ee02-4246-8a3e-dc906ce775d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:04.956532 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.956464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb6kg\" (UniqueName: \"kubernetes.io/projected/9fb96906-7504-42f9-97b1-98b23a0a63d8-kube-api-access-gb6kg\") pod \"node-ca-6j4z8\" (UID: \"9fb96906-7504-42f9-97b1-98b23a0a63d8\") " pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:04.957103 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.956978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6f7w\" (UniqueName: \"kubernetes.io/projected/19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55-kube-api-access-k6f7w\") pod \"node-resolver-5kmw4\" (UID: \"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55\") " pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:04.958198 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.958147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wwbc\" (UniqueName: \"kubernetes.io/projected/d7433f80-c853-450f-a099-d82d0f41cb5c-kube-api-access-6wwbc\") pod \"multus-additional-cni-plugins-hdzl9\" (UID: \"d7433f80-c853-450f-a099-d82d0f41cb5c\") " pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:04.958198 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.958176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxgtp\" (UniqueName: \"kubernetes.io/projected/eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac-kube-api-access-vxgtp\") pod \"iptables-alerter-pb5n5\" (UID: \"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac\") " pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:04.958333 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.958210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s7pk\" (UniqueName: \"kubernetes.io/projected/c0011ab8-b9c0-4d6b-b18a-98e188b0636e-kube-api-access-6s7pk\") pod \"ovnkube-node-h7zz8\" (UID: \"c0011ab8-b9c0-4d6b-b18a-98e188b0636e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:04.958925 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.958908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvlwf\" (UniqueName: \"kubernetes.io/projected/6ccdc7e1-a9c0-41db-bc27-091299ec4729-kube-api-access-pvlwf\") pod \"multus-p9xd9\" (UID: \"6ccdc7e1-a9c0-41db-bc27-091299ec4729\") " pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:04.975436 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.975390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal" event={"ID":"6f2534fef1caace65913d4394bf8e9e2","Type":"ContainerStarted","Data":"b6991740a5256d1b5cbc377b86c49511a393af0c9abc3517945a35a889498c12"}
Sep 14 10:25:04.976494 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:04.976468    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal" event={"ID":"0b3ece645199dcff1203654d50efe554","Type":"ContainerStarted","Data":"3f76c8071f678f29fcc2a03e199f749d6b6739e6919f76d0351d48721f82d130"}
Sep 14 10:25:05.045203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prkkd\" (UniqueName: \"kubernetes.io/projected/80c3e812-6a9f-4945-b043-2cf5ebe13963-kube-api-access-prkkd\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:05.045203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-registration-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq4zc\" (UniqueName: \"kubernetes.io/projected/a7db74e4-0e04-42f9-9988-5bf8c214aa88-kube-api-access-sq4zc\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2a0e91f-654d-4dc1-aeaa-14267a34a523-dbus\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg5c2\" (UniqueName: \"kubernetes.io/projected/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-kube-api-access-sg5c2\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-sys\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-systemd\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-tmp\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-var-lib-kubelet\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-sys\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-modprobe-d\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-registration-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2a0e91f-654d-4dc1-aeaa-14267a34a523-dbus\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-tuned\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.045511    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-systemd\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-sys-fs\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-sysconfig\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.045577    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs podName:80c3e812-6a9f-4945-b043-2cf5ebe13963 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:05.545563118 +0000 UTC m=+3.086964924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs") pod "network-metrics-daemon-b4s8s" (UID: "80c3e812-6a9f-4945-b043-2cf5ebe13963") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-sysctl-conf\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-host\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-modprobe-d\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-sysconfig\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-var-lib-kubelet\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.045511    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:05.045913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-host\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-sys-fs\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.045729    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret podName:b2a0e91f-654d-4dc1-aeaa-14267a34a523 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:05.545713401 +0000 UTC m=+3.087115179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret") pod "global-pull-secret-syncer-qs687" (UID: "b2a0e91f-654d-4dc1-aeaa-14267a34a523") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-sysctl-d\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-run\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-sysctl-conf\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-socket-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-kubernetes\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-run\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-lib-modules\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2a0e91f-654d-4dc1-aeaa-14267a34a523-kubelet-config\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-sysctl-d\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-kubernetes\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-device-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.046517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045955    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-socket-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.047069 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a7db74e4-0e04-42f9-9988-5bf8c214aa88-device-dir\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.047069 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.045972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2a0e91f-654d-4dc1-aeaa-14267a34a523-kubelet-config\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:05.047069 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.046048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-lib-modules\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.047890 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.047871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-tmp\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.047968 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.047948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-etc-tuned\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.054495 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.054472    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq4zc\" (UniqueName: \"kubernetes.io/projected/a7db74e4-0e04-42f9-9988-5bf8c214aa88-kube-api-access-sq4zc\") pod \"aws-ebs-csi-driver-node-r6xd5\" (UID: \"a7db74e4-0e04-42f9-9988-5bf8c214aa88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.054756 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.054740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prkkd\" (UniqueName: \"kubernetes.io/projected/80c3e812-6a9f-4945-b043-2cf5ebe13963-kube-api-access-prkkd\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:05.054816 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.054781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg5c2\" (UniqueName: \"kubernetes.io/projected/858d6378-8a40-4ba8-bdd2-1f7b096d4fb2-kube-api-access-sg5c2\") pod \"tuned-ttrhx\" (UID: \"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.124870 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.124833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9xd9"
Sep 14 10:25:05.137547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.137526    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pb5n5"
Sep 14 10:25:05.146010 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.145989    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5kmw4"
Sep 14 10:25:05.152412 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.152391    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:05.158909 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.158885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6j4z8"
Sep 14 10:25:05.164167 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.164149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:05.171540 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.171519    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hdzl9"
Sep 14 10:25:05.177894 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.177878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5"
Sep 14 10:25:05.182197 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.182178    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ttrhx"
Sep 14 10:25:05.549282 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.549260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:05.549413 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.549290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:05.549413 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.549306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:05.549413 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.549403    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:05.549413 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.549406    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:05.549584 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.549427    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:25:05.549584 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.549441    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:25:05.549584 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.549451    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vft5g for pod openshift-network-diagnostics/network-check-target-hfzjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:05.549584 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.549459    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret podName:b2a0e91f-654d-4dc1-aeaa-14267a34a523 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:06.549440472 +0000 UTC m=+4.090842252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret") pod "global-pull-secret-syncer-qs687" (UID: "b2a0e91f-654d-4dc1-aeaa-14267a34a523") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:05.549584 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.549475    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs podName:80c3e812-6a9f-4945-b043-2cf5ebe13963 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:06.549466758 +0000 UTC m=+4.090868540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs") pod "network-metrics-daemon-b4s8s" (UID: "80c3e812-6a9f-4945-b043-2cf5ebe13963") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:05.549584 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.549494    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g podName:20ac4e2f-ee02-4246-8a3e-dc906ce775d2 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:06.549480099 +0000 UTC m=+4.090881894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vft5g" (UniqueName: "kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g") pod "network-check-target-hfzjz" (UID: "20ac4e2f-ee02-4246-8a3e-dc906ce775d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:05.776508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:05.776484    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19dc5f96_e3fe_4bcf_9e50_cda9d99a2d55.slice/crio-255222eac3ed0d69d2e92facae9a2480173c910c4e2ae0ed08e2053e047331e1 WatchSource:0}: Error finding container 255222eac3ed0d69d2e92facae9a2480173c910c4e2ae0ed08e2053e047331e1: Status 404 returned error can't find the container with id 255222eac3ed0d69d2e92facae9a2480173c910c4e2ae0ed08e2053e047331e1
Sep 14 10:25:05.790296 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:05.790169    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeff7e68_79a9_4ec6_9fc1_ab5a2c3ed5ac.slice/crio-735effc28f03a4ba4aecd46137129080f2cb89c7f7d289ffa88843aa23792c17 WatchSource:0}: Error finding container 735effc28f03a4ba4aecd46137129080f2cb89c7f7d289ffa88843aa23792c17: Status 404 returned error can't find the container with id 735effc28f03a4ba4aecd46137129080f2cb89c7f7d289ffa88843aa23792c17
Sep 14 10:25:05.791759 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:05.791694    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0011ab8_b9c0_4d6b_b18a_98e188b0636e.slice/crio-58dca623efa50d7d1ccaa2cb804dee5748750ba35db43f23efbfdccba088f369 WatchSource:0}: Error finding container 58dca623efa50d7d1ccaa2cb804dee5748750ba35db43f23efbfdccba088f369: Status 404 returned error can't find the container with id 58dca623efa50d7d1ccaa2cb804dee5748750ba35db43f23efbfdccba088f369
Sep 14 10:25:05.792392 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:05.792318    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858d6378_8a40_4ba8_bdd2_1f7b096d4fb2.slice/crio-f4da2446291556b4fa1dfbcc2b73b95799a8467531d5f6790d70eecc1222ee63 WatchSource:0}: Error finding container f4da2446291556b4fa1dfbcc2b73b95799a8467531d5f6790d70eecc1222ee63: Status 404 returned error can't find the container with id f4da2446291556b4fa1dfbcc2b73b95799a8467531d5f6790d70eecc1222ee63
Sep 14 10:25:05.793286 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:05.793254    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ccdc7e1_a9c0_41db_bc27_091299ec4729.slice/crio-1d64d91019141f797447e5ac26597d90e91f5573dadeea152bcc64820be7bbf1 WatchSource:0}: Error finding container 1d64d91019141f797447e5ac26597d90e91f5573dadeea152bcc64820be7bbf1: Status 404 returned error can't find the container with id 1d64d91019141f797447e5ac26597d90e91f5573dadeea152bcc64820be7bbf1
Sep 14 10:25:05.794984 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:05.794963    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c4c374_a18b_441b_b87d_58fcb8a86aa2.slice/crio-dd499e651022bbf743b7cc6053b5e13c914b0a01b190360ba3a5641611b40ba7 WatchSource:0}: Error finding container dd499e651022bbf743b7cc6053b5e13c914b0a01b190360ba3a5641611b40ba7: Status 404 returned error can't find the container with id dd499e651022bbf743b7cc6053b5e13c914b0a01b190360ba3a5641611b40ba7
Sep 14 10:25:05.795371 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:05.795337    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb96906_7504_42f9_97b1_98b23a0a63d8.slice/crio-c8a68a1a680a2e736aa66953bc3fc4737f71da0c745d1edc2e3b246640ad14b4 WatchSource:0}: Error finding container c8a68a1a680a2e736aa66953bc3fc4737f71da0c745d1edc2e3b246640ad14b4: Status 404 returned error can't find the container with id c8a68a1a680a2e736aa66953bc3fc4737f71da0c745d1edc2e3b246640ad14b4
Sep 14 10:25:05.798989 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:05.796836    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7433f80_c853_450f_a099_d82d0f41cb5c.slice/crio-88cd56391643abb738ad126c89b8fac0a2eac4402986c2d75c75d3c6d51fe0f1 WatchSource:0}: Error finding container 88cd56391643abb738ad126c89b8fac0a2eac4402986c2d75c75d3c6d51fe0f1: Status 404 returned error can't find the container with id 88cd56391643abb738ad126c89b8fac0a2eac4402986c2d75c75d3c6d51fe0f1
Sep 14 10:25:05.798989 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:05.797789    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7db74e4_0e04_42f9_9988_5bf8c214aa88.slice/crio-3d5177a375c1f38a8a14024468a927258203dddc84c3db5bd57fa473e2f49c44 WatchSource:0}: Error finding container 3d5177a375c1f38a8a14024468a927258203dddc84c3db5bd57fa473e2f49c44: Status 404 returned error can't find the container with id 3d5177a375c1f38a8a14024468a927258203dddc84c3db5bd57fa473e2f49c44
Sep 14 10:25:05.870884 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.870851    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 10:20:04 +0000 UTC" deadline="2028-06-24 01:38:22.003192152 +0000 UTC"
Sep 14 10:25:05.870884 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.870881    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15567h13m16.132314721s"
Sep 14 10:25:05.971289 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.971266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:05.971411 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.971267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:05.971411 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.971353    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:05.971498 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:05.971426    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:05.979706 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.979683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9xd9" event={"ID":"6ccdc7e1-a9c0-41db-bc27-091299ec4729","Type":"ContainerStarted","Data":"1d64d91019141f797447e5ac26597d90e91f5573dadeea152bcc64820be7bbf1"}
Sep 14 10:25:05.980570 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.980549    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pb5n5" event={"ID":"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac","Type":"ContainerStarted","Data":"735effc28f03a4ba4aecd46137129080f2cb89c7f7d289ffa88843aa23792c17"}
Sep 14 10:25:05.982065 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.981998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5" event={"ID":"a7db74e4-0e04-42f9-9988-5bf8c214aa88","Type":"ContainerStarted","Data":"3d5177a375c1f38a8a14024468a927258203dddc84c3db5bd57fa473e2f49c44"}
Sep 14 10:25:05.985177 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.985147    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdzl9" event={"ID":"d7433f80-c853-450f-a099-d82d0f41cb5c","Type":"ContainerStarted","Data":"88cd56391643abb738ad126c89b8fac0a2eac4402986c2d75c75d3c6d51fe0f1"}
Sep 14 10:25:05.988399 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.988379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6j4z8" event={"ID":"9fb96906-7504-42f9-97b1-98b23a0a63d8","Type":"ContainerStarted","Data":"c8a68a1a680a2e736aa66953bc3fc4737f71da0c745d1edc2e3b246640ad14b4"}
Sep 14 10:25:05.989337 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.989317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xtj7j" event={"ID":"d1c4c374-a18b-441b-b87d-58fcb8a86aa2","Type":"ContainerStarted","Data":"dd499e651022bbf743b7cc6053b5e13c914b0a01b190360ba3a5641611b40ba7"}
Sep 14 10:25:05.990408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.990389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ttrhx" event={"ID":"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2","Type":"ContainerStarted","Data":"f4da2446291556b4fa1dfbcc2b73b95799a8467531d5f6790d70eecc1222ee63"}
Sep 14 10:25:05.991713 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.991694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5kmw4" event={"ID":"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55","Type":"ContainerStarted","Data":"255222eac3ed0d69d2e92facae9a2480173c910c4e2ae0ed08e2053e047331e1"}
Sep 14 10:25:05.993744 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.993724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal" event={"ID":"6f2534fef1caace65913d4394bf8e9e2","Type":"ContainerStarted","Data":"31ca7f5f9612ce73d054850bd3543d31df3b9a3815d40cd02b822d54d2e85973"}
Sep 14 10:25:05.994750 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:05.994734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" event={"ID":"c0011ab8-b9c0-4d6b-b18a-98e188b0636e","Type":"ContainerStarted","Data":"58dca623efa50d7d1ccaa2cb804dee5748750ba35db43f23efbfdccba088f369"}
Sep 14 10:25:06.009546 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:06.009494    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-139.ec2.internal" podStartSLOduration=2.009483554 podStartE2EDuration="2.009483554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:06.009098153 +0000 UTC m=+3.550499943" watchObservedRunningTime="2026-09-14 10:25:06.009483554 +0000 UTC m=+3.550885354"
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:06.557354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:06.557403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:06.557429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:06.557564    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:06.557621    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret podName:b2a0e91f-654d-4dc1-aeaa-14267a34a523 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:08.557604327 +0000 UTC m=+6.099006125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret") pod "global-pull-secret-syncer-qs687" (UID: "b2a0e91f-654d-4dc1-aeaa-14267a34a523") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:06.558051    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:06.558073    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:06.558086    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vft5g for pod openshift-network-diagnostics/network-check-target-hfzjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:06.558129    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g podName:20ac4e2f-ee02-4246-8a3e-dc906ce775d2 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:08.558115849 +0000 UTC m=+6.099517643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vft5g" (UniqueName: "kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g") pod "network-check-target-hfzjz" (UID: "20ac4e2f-ee02-4246-8a3e-dc906ce775d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:06.558194    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:06.558261 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:06.558227    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs podName:80c3e812-6a9f-4945-b043-2cf5ebe13963 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:08.558216168 +0000 UTC m=+6.099617953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs") pod "network-metrics-daemon-b4s8s" (UID: "80c3e812-6a9f-4945-b043-2cf5ebe13963") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:06.871802 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:06.871699    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 10:20:04 +0000 UTC" deadline="2028-03-11 05:12:32.553826431 +0000 UTC"
Sep 14 10:25:06.871802 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:06.871757    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13050h47m25.682073918s"
Sep 14 10:25:06.974775 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:06.973998    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:06.974775 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:06.974121    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:07.025071 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:07.025033    2578 generic.go:356] "Generic (PLEG): container finished" podID="0b3ece645199dcff1203654d50efe554" containerID="d81afd13a61c4f339a17d2eb97b0d59c7a049fb572aaab800f0ec3879cbd837f" exitCode=0
Sep 14 10:25:07.026060 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:07.026031    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal" event={"ID":"0b3ece645199dcff1203654d50efe554","Type":"ContainerDied","Data":"d81afd13a61c4f339a17d2eb97b0d59c7a049fb572aaab800f0ec3879cbd837f"}
Sep 14 10:25:07.972294 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:07.971571    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:07.972294 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:07.971722    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:07.972294 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:07.972159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:07.972294 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:07.972257    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:08.041700 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:08.041630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal" event={"ID":"0b3ece645199dcff1203654d50efe554","Type":"ContainerStarted","Data":"f5a984f5128861bba8c56531f5666a5f0ccc57569769d688f3dc32f65ba86e32"}
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:08.576532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:08.576583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:08.576615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:08.576775    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:08.576839    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret podName:b2a0e91f-654d-4dc1-aeaa-14267a34a523 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:12.576819787 +0000 UTC m=+10.118221583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret") pod "global-pull-secret-syncer-qs687" (UID: "b2a0e91f-654d-4dc1-aeaa-14267a34a523") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:08.577252    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:08.577274    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:08.577286    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vft5g for pod openshift-network-diagnostics/network-check-target-hfzjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:08.577342    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g podName:20ac4e2f-ee02-4246-8a3e-dc906ce775d2 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:12.577325663 +0000 UTC m=+10.118727458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vft5g" (UniqueName: "kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g") pod "network-check-target-hfzjz" (UID: "20ac4e2f-ee02-4246-8a3e-dc906ce775d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:08.577412    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:08.577479 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:08.577445    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs podName:80c3e812-6a9f-4945-b043-2cf5ebe13963 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:12.577433256 +0000 UTC m=+10.118835035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs") pod "network-metrics-daemon-b4s8s" (UID: "80c3e812-6a9f-4945-b043-2cf5ebe13963") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:08.973874 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:08.973795    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:08.974306 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:08.973913    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:09.971900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:09.971813    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:09.971900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:09.971849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:09.972115 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:09.971989    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:09.972115 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:09.972075    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:10.971845 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:10.971813    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:10.972291 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:10.971937    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:11.971781 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:11.971741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:11.971943 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:11.971874    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:11.972292 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:11.971950    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:11.972292 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:11.972015    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:12.612619 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:12.612581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:12.612808 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:12.612624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:12.612808 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:12.612650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:12.612808 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:12.612783    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:12.612963 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:12.612840    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret podName:b2a0e91f-654d-4dc1-aeaa-14267a34a523 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:20.612823921 +0000 UTC m=+18.154225717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret") pod "global-pull-secret-syncer-qs687" (UID: "b2a0e91f-654d-4dc1-aeaa-14267a34a523") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:12.613249 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:12.613230    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:25:12.613249 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:12.613251    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:25:12.613399 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:12.613263    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vft5g for pod openshift-network-diagnostics/network-check-target-hfzjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:12.613399 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:12.613306    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g podName:20ac4e2f-ee02-4246-8a3e-dc906ce775d2 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:20.613292289 +0000 UTC m=+18.154694072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vft5g" (UniqueName: "kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g") pod "network-check-target-hfzjz" (UID: "20ac4e2f-ee02-4246-8a3e-dc906ce775d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:12.613399 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:12.613375    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:12.613553 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:12.613411    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs podName:80c3e812-6a9f-4945-b043-2cf5ebe13963 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:20.61339946 +0000 UTC m=+18.154801253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs") pod "network-metrics-daemon-b4s8s" (UID: "80c3e812-6a9f-4945-b043-2cf5ebe13963") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:12.972370 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:12.972288    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:12.972809 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:12.972374    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:13.971906 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:13.971392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:13.971906 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:13.971428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:13.971906 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:13.971565    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:13.971906 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:13.971725    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:14.971371 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:14.971338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:14.971772 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:14.971492    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:15.971227 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:15.971191    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:15.971227 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:15.971225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:15.971418 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:15.971308    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:15.971654 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:15.971424    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:16.971830 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:16.971799    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:16.972270 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:16.971930    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:17.971847 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:17.971618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:17.972248 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:17.971696    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:17.972248 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:17.971948    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:17.972248 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:17.972025    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:18.971606 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:18.971567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:18.971804 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:18.971709    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:19.971122 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:19.971084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:19.971595 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:19.971105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:19.971595 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:19.971193    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:19.971595 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:19.971309    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:20.673805 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:20.673771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:20.673805 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:20.673819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:20.674035 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:20.673846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:20.674035 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:20.673948    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:20.674035 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:20.673948    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:20.674035 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:20.673976    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:25:20.674035 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:20.674003    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:25:20.674035 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:20.674014    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs podName:80c3e812-6a9f-4945-b043-2cf5ebe13963 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:36.673995655 +0000 UTC m=+34.215397447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs") pod "network-metrics-daemon-b4s8s" (UID: "80c3e812-6a9f-4945-b043-2cf5ebe13963") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:20.674035 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:20.674016    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vft5g for pod openshift-network-diagnostics/network-check-target-hfzjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:20.674035 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:20.674039    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret podName:b2a0e91f-654d-4dc1-aeaa-14267a34a523 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:36.674029888 +0000 UTC m=+34.215431667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret") pod "global-pull-secret-syncer-qs687" (UID: "b2a0e91f-654d-4dc1-aeaa-14267a34a523") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:20.674336 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:20.674078    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g podName:20ac4e2f-ee02-4246-8a3e-dc906ce775d2 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:36.674061482 +0000 UTC m=+34.215463278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vft5g" (UniqueName: "kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g") pod "network-check-target-hfzjz" (UID: "20ac4e2f-ee02-4246-8a3e-dc906ce775d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:20.971314 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:20.971204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:20.971768 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:20.971328    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:21.971637 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:21.971600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:21.971637 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:21.971638    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:21.972203 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:21.971741    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:21.972203 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:21.971851    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:22.972142 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:22.972110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:22.972616 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:22.972189    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:23.971313 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:23.971268    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:23.971514 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:23.971377    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:23.971514 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:23.971427    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:23.971606 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:23.971512    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:24.074208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.074023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" event={"ID":"c0011ab8-b9c0-4d6b-b18a-98e188b0636e","Type":"ContainerStarted","Data":"72cdd415062cfaa10d43b35b50ad2e953086150d16f49a5ca42f536d1e788cfc"}
Sep 14 10:25:24.074644 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.074275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" event={"ID":"c0011ab8-b9c0-4d6b-b18a-98e188b0636e","Type":"ContainerStarted","Data":"2dc4a199fdc49846fa7af34d5888b2b056690f20459b674818d0dc0d4b568a45"}
Sep 14 10:25:24.074644 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.074324    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" event={"ID":"c0011ab8-b9c0-4d6b-b18a-98e188b0636e","Type":"ContainerStarted","Data":"211bb4d1826ea3272e775eb01858b640e92546e935ee6baeb3471a18efd82b63"}
Sep 14 10:25:24.075567 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.075543    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9xd9" event={"ID":"6ccdc7e1-a9c0-41db-bc27-091299ec4729","Type":"ContainerStarted","Data":"9b007400ab059fe2af2e956154f34d99cb0c4053df0b72b19d54f28c444c422c"}
Sep 14 10:25:24.077167 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.077146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5" event={"ID":"a7db74e4-0e04-42f9-9988-5bf8c214aa88","Type":"ContainerStarted","Data":"a8e571a4e85e4e57a59e966a81f816c97dd3d1d84628a757973f2ee8be983e6d"}
Sep 14 10:25:24.078584 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.078564    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7433f80-c853-450f-a099-d82d0f41cb5c" containerID="b1f532f9fa7da1dee651279dce4a5db7f90e97e83f83dec52324a298215acb1f" exitCode=0
Sep 14 10:25:24.078654 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.078625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdzl9" event={"ID":"d7433f80-c853-450f-a099-d82d0f41cb5c","Type":"ContainerDied","Data":"b1f532f9fa7da1dee651279dce4a5db7f90e97e83f83dec52324a298215acb1f"}
Sep 14 10:25:24.080787 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.080760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6j4z8" event={"ID":"9fb96906-7504-42f9-97b1-98b23a0a63d8","Type":"ContainerStarted","Data":"66f281fc2d249231b73484536ff9d945b96036166a65ff92eab52f62c093ca08"}
Sep 14 10:25:24.083468 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.083332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xtj7j" event={"ID":"d1c4c374-a18b-441b-b87d-58fcb8a86aa2","Type":"ContainerStarted","Data":"7d0c1a85963bc4b8da722f2cfd98760a6c97f04e67e9e3c6661d9a013da24463"}
Sep 14 10:25:24.087591 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.087558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ttrhx" event={"ID":"858d6378-8a40-4ba8-bdd2-1f7b096d4fb2","Type":"ContainerStarted","Data":"5b9e55273f2ff85ef2ff485a3cc743cfc297dda31b89af469bb0c05295082871"}
Sep 14 10:25:24.089304 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.089281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5kmw4" event={"ID":"19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55","Type":"ContainerStarted","Data":"1520ebf0dda59b49709b688b65af68dcc719b2c6d4eb28630eb2ff2237c30fc5"}
Sep 14 10:25:24.100054 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.100019    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-139.ec2.internal" podStartSLOduration=20.100008523 podStartE2EDuration="20.100008523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:08.05956937 +0000 UTC m=+5.600971172" watchObservedRunningTime="2026-09-14 10:25:24.100008523 +0000 UTC m=+21.641410323"
Sep 14 10:25:24.100480 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.100456    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p9xd9" podStartSLOduration=4.324031899 podStartE2EDuration="22.100448022s" totalImagesPullingTime="17.776416123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:24.099770881 +0000 UTC m=+21.641172681" watchObservedRunningTime="2026-09-14 10:25:24.100448022 +0000 UTC m=+21.641849829"
Sep 14 10:25:24.145216 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.145170    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ttrhx" podStartSLOduration=4.448179954 podStartE2EDuration="22.145154451s" totalImagesPullingTime="17.696974497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:24.124852141 +0000 UTC m=+21.666253953" watchObservedRunningTime="2026-09-14 10:25:24.145154451 +0000 UTC m=+21.686556255"
Sep 14 10:25:24.145879 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.145844    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xtj7j" podStartSLOduration=4.451416673 podStartE2EDuration="22.145830877s" totalImagesPullingTime="17.694414204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:24.145492426 +0000 UTC m=+21.686894225" watchObservedRunningTime="2026-09-14 10:25:24.145830877 +0000 UTC m=+21.687232679"
Sep 14 10:25:24.207913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.207871    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5kmw4" podStartSLOduration=4.502371187 podStartE2EDuration="22.207856856s" totalImagesPullingTime="17.705485669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:24.188513511 +0000 UTC m=+21.729915310" watchObservedRunningTime="2026-09-14 10:25:24.207856856 +0000 UTC m=+21.749258656"
Sep 14 10:25:24.208023 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.207938    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6j4z8" podStartSLOduration=4.453920558 podStartE2EDuration="22.207934633s" totalImagesPullingTime="17.754014075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:24.207541164 +0000 UTC m=+21.748942967" watchObservedRunningTime="2026-09-14 10:25:24.207934633 +0000 UTC m=+21.749336432"
Sep 14 10:25:24.466645 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.466615    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6j4z8_9fb96906-7504-42f9-97b1-98b23a0a63d8/node-ca/0.log"
Sep 14 10:25:24.782898 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.782876    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 14 10:25:24.896031 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.895884    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-14T10:25:24.78289298Z","UUID":"84e25037-5f69-4811-8269-cc8bec158a3e","Handler":null,"Name":"","Endpoint":""}
Sep 14 10:25:24.897641 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.897620    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 14 10:25:24.897840 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.897655    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 14 10:25:24.971373 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:24.971341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:24.971526 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:24.971461    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:25.098400 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.098363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" event={"ID":"c0011ab8-b9c0-4d6b-b18a-98e188b0636e","Type":"ContainerStarted","Data":"ac1f05f62d5f4f06848961791025d37f0256dc827c5fafea9d2ef229f83be13a"}
Sep 14 10:25:25.099039 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.098489    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" event={"ID":"c0011ab8-b9c0-4d6b-b18a-98e188b0636e","Type":"ContainerStarted","Data":"47861de8298883fe824d3e427127936886d65bbd0cc9a199d148b75e47b38b5e"}
Sep 14 10:25:25.099039 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.098539    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" event={"ID":"c0011ab8-b9c0-4d6b-b18a-98e188b0636e","Type":"ContainerStarted","Data":"544222570b616ca6a9e3dd5b507eb00f91193efe199a5c2cbb3aaeac89d00941"}
Sep 14 10:25:25.100100 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.100078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pb5n5" event={"ID":"eeff7e68-79a9-4ec6-9fc1-ab5a2c3ed5ac","Type":"ContainerStarted","Data":"eeea16e2fd94d42372cb03af1807df40e970500efbfe082255643b5609cd4f57"}
Sep 14 10:25:25.102215 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.102189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5" event={"ID":"a7db74e4-0e04-42f9-9988-5bf8c214aa88","Type":"ContainerStarted","Data":"14f18125c3c491e7777062176bf7326bb1a6c089abf9aa95218c489b056c5e51"}
Sep 14 10:25:25.116992 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.116944    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pb5n5" podStartSLOduration=5.353327813 podStartE2EDuration="23.116928714s" totalImagesPullingTime="17.763600901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:25.116333266 +0000 UTC m=+22.657735068" watchObservedRunningTime="2026-09-14 10:25:25.116928714 +0000 UTC m=+22.658330514"
Sep 14 10:25:25.369581 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.369497    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:25.370354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.370158    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:25.971529 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.971496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:25.971708 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:25.971603    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:25.971708 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:25.971662    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:25.971833 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:25.971807    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:26.106891 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:26.106852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5" event={"ID":"a7db74e4-0e04-42f9-9988-5bf8c214aa88","Type":"ContainerStarted","Data":"6ba9f68cbde2a55cf5b5e1598b47124fccfff850be9f499fe70d593f32630a2c"}
Sep 14 10:25:26.107716 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:26.107691    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:26.107844 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:26.107777    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xtj7j"
Sep 14 10:25:26.134104 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:26.134059    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6xd5" podStartSLOduration=4.498402533 podStartE2EDuration="24.134045696s" totalImagesPullingTime="19.635643163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:26.133647422 +0000 UTC m=+23.675049225" watchObservedRunningTime="2026-09-14 10:25:26.134045696 +0000 UTC m=+23.675447496"
Sep 14 10:25:26.971875 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:26.971612    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:26.972040 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:26.971984    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:27.112687 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:27.112639    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" event={"ID":"c0011ab8-b9c0-4d6b-b18a-98e188b0636e","Type":"ContainerStarted","Data":"2eb89a57fd5ee0302f63eef0c95284cea37b2164a79a103597ebbf635c187e34"}
Sep 14 10:25:27.971261 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:27.971226    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:27.971491 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:27.971345    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:27.971491 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:27.971382    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:27.971491 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:27.971479    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:28.971659 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:28.971492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:28.972049 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:28.971754    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:29.118687 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.118644    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7433f80-c853-450f-a099-d82d0f41cb5c" containerID="7bedec153c984100a001dd3ac7e73411c9b29c5b354f87d9207e48ea626dfbb4" exitCode=0
Sep 14 10:25:29.118837 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.118735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdzl9" event={"ID":"d7433f80-c853-450f-a099-d82d0f41cb5c","Type":"ContainerDied","Data":"7bedec153c984100a001dd3ac7e73411c9b29c5b354f87d9207e48ea626dfbb4"}
Sep 14 10:25:29.122744 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.122721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" event={"ID":"c0011ab8-b9c0-4d6b-b18a-98e188b0636e","Type":"ContainerStarted","Data":"c494119754658a7dae844bf22c1abff952f122eed7162990d48620554cd945f2"}
Sep 14 10:25:29.122993 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.122976    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:29.123196 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.123039    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:29.123196 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.123081    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:29.138601 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.138581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:29.138865 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.138851    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:25:29.971866 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.971829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:29.971866 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:29.971864    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:29.972430 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:29.971969    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:29.972430 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:29.972066    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:30.129819 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:30.129786    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7433f80-c853-450f-a099-d82d0f41cb5c" containerID="8cd4fea422f9cad26c04e43d3d2ec65c314451d7e7d029f60401de62510a9efd" exitCode=0
Sep 14 10:25:30.129920 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:30.129829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdzl9" event={"ID":"d7433f80-c853-450f-a099-d82d0f41cb5c","Type":"ContainerDied","Data":"8cd4fea422f9cad26c04e43d3d2ec65c314451d7e7d029f60401de62510a9efd"}
Sep 14 10:25:30.161974 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:30.161932    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8" podStartSLOduration=10.145828472 podStartE2EDuration="28.161919126s" totalImagesPullingTime="18.016090654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:29.186261081 +0000 UTC m=+26.727662881" watchObservedRunningTime="2026-09-14 10:25:30.161919126 +0000 UTC m=+27.703321140"
Sep 14 10:25:30.971236 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:30.971204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:30.971373 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:30.971314    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:31.133860 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:31.133831    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7433f80-c853-450f-a099-d82d0f41cb5c" containerID="99fe02d7863e243fd8af43782bce22d76d56c2c353cd59eb634362a214447ebd" exitCode=0
Sep 14 10:25:31.134348 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:31.133914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdzl9" event={"ID":"d7433f80-c853-450f-a099-d82d0f41cb5c","Type":"ContainerDied","Data":"99fe02d7863e243fd8af43782bce22d76d56c2c353cd59eb634362a214447ebd"}
Sep 14 10:25:31.971291 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:31.971262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:31.971466 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:31.971376    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:31.971466 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:31.971434    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:31.971583 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:31.971561    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:32.972325 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:32.972290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:32.972789 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:32.972410    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:33.971796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:33.971766    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:33.971954 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:33.971803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:33.971954 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:33.971867    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:33.972027 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:33.971991    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:34.971368 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:34.971341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:34.971846 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:34.971466    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:35.971652 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:35.971623    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:35.972071 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:35.971623    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:35.972071 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:35.971744    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:35.972071 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:35.971791    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:36.690908 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:36.690875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:36.690908 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:36.690909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:36.691130 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:36.690928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:36.691130 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:36.691011    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:36.691130 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:36.691012    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:36.691130 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:36.691024    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:25:36.691130 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:36.691044    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:25:36.691130 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:36.691057    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vft5g for pod openshift-network-diagnostics/network-check-target-hfzjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:36.691130 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:36.691065    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs podName:80c3e812-6a9f-4945-b043-2cf5ebe13963 nodeName:}" failed. No retries permitted until 2026-09-14 10:26:08.691051192 +0000 UTC m=+66.232452989 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs") pod "network-metrics-daemon-b4s8s" (UID: "80c3e812-6a9f-4945-b043-2cf5ebe13963") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:36.691130 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:36.691079    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret podName:b2a0e91f-654d-4dc1-aeaa-14267a34a523 nodeName:}" failed. No retries permitted until 2026-09-14 10:26:08.691073285 +0000 UTC m=+66.232475064 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret") pod "global-pull-secret-syncer-qs687" (UID: "b2a0e91f-654d-4dc1-aeaa-14267a34a523") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:36.691130 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:36.691094    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g podName:20ac4e2f-ee02-4246-8a3e-dc906ce775d2 nodeName:}" failed. No retries permitted until 2026-09-14 10:26:08.691083612 +0000 UTC m=+66.232485424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vft5g" (UniqueName: "kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g") pod "network-check-target-hfzjz" (UID: "20ac4e2f-ee02-4246-8a3e-dc906ce775d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:36.971325 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:36.971238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:36.971491 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:36.971338    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:37.149078 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:37.149047    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7433f80-c853-450f-a099-d82d0f41cb5c" containerID="22e0f057d7627b5e6b0e6b52b92cd4a8c2adfa3ef5175625ca5eef943c3f9edb" exitCode=0
Sep 14 10:25:37.149446 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:37.149091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdzl9" event={"ID":"d7433f80-c853-450f-a099-d82d0f41cb5c","Type":"ContainerDied","Data":"22e0f057d7627b5e6b0e6b52b92cd4a8c2adfa3ef5175625ca5eef943c3f9edb"}
Sep 14 10:25:37.971259 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:37.971228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:37.971424 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:37.971227    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:37.971424 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:37.971322    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:37.971499 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:37.971421    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:38.153722 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:38.153666    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7433f80-c853-450f-a099-d82d0f41cb5c" containerID="0cd780be03e034c73019cdeae39e57ab79510de80a79dffb32a06218afe8ea8f" exitCode=0
Sep 14 10:25:38.153722 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:38.153721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdzl9" event={"ID":"d7433f80-c853-450f-a099-d82d0f41cb5c","Type":"ContainerDied","Data":"0cd780be03e034c73019cdeae39e57ab79510de80a79dffb32a06218afe8ea8f"}
Sep 14 10:25:38.971118 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:38.971094    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:38.971282 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:38.971181    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:39.161811 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:39.161781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdzl9" event={"ID":"d7433f80-c853-450f-a099-d82d0f41cb5c","Type":"ContainerStarted","Data":"eec11ab393f44b6525d1804b739fa59c3608b76bf4955797df843232d4bd01f1"}
Sep 14 10:25:39.187349 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:39.187307    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hdzl9" podStartSLOduration=8.449716646 podStartE2EDuration="37.187294602s" totalImagesPullingTime="28.737577956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:39.187277708 +0000 UTC m=+36.728679508" watchObservedRunningTime="2026-09-14 10:25:39.187294602 +0000 UTC m=+36.728696394"
Sep 14 10:25:39.971750 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:39.971718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:39.971926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:39.971718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:39.971926 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:39.971808    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:39.972019 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:39.971913    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:40.971712 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:40.971662    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:40.972057 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:40.971799    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:41.971526 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:41.971493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:41.971526 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:41.971528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:41.971742 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:41.971648    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:41.971972 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:41.971765    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:42.971544 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:42.971515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:42.971711 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:42.971642    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:43.971239 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:43.971200    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:43.971605 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:43.971248    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:43.971605 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:43.971317    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:43.971605 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:43.971419    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:44.971749 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:44.971557    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:44.972111 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:44.971826    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:45.971449 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:45.971414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:45.971616 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:45.971458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:45.971616 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:45.971565    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:45.971732 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:45.971687    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:46.971208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:46.971179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:46.971609 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:46.971282    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:47.971087 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:47.971052    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:47.971229 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:47.971159    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:47.971229 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:47.971211    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:47.971495 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:47.971281    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:48.971510 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:48.971477    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:48.971975 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:48.971601    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:49.540555 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:49.540525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4s8s"]
Sep 14 10:25:49.540733 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:49.540627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:49.540802 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:49.540730    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:49.544602 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:49.544539    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hfzjz"]
Sep 14 10:25:49.544766 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:49.544647    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:49.544842 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:49.544767    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:49.545258 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:49.545237    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qs687"]
Sep 14 10:25:49.545345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:49.545334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:49.545439 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:49.545419    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:50.971687 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:50.971595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:50.972112 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:50.971604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:50.972112 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:50.971708    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:50.972112 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:50.971606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:50.972112 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:50.971782    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:50.972112 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:50.971837    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:52.971915 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:52.971883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:52.972349 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:52.971955    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs687" podUID="b2a0e91f-654d-4dc1-aeaa-14267a34a523"
Sep 14 10:25:52.972349 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:52.972062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:52.972349 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:52.972178    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzjz" podUID="20ac4e2f-ee02-4246-8a3e-dc906ce775d2"
Sep 14 10:25:52.972349 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:52.972216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:52.972349 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:25:52.972285    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4s8s" podUID="80c3e812-6a9f-4945-b043-2cf5ebe13963"
Sep 14 10:25:53.220641 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.220617    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-139.ec2.internal" event="NodeReady"
Sep 14 10:25:53.220799 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.220755    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 14 10:25:53.260556 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.260491    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d789b5c7-cv72n"]
Sep 14 10:25:53.271090 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.271064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.276327 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.276306    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp2lw\""
Sep 14 10:25:53.276435 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.276306    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 14 10:25:53.276435 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.276308    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 14 10:25:53.276533 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.276308    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 14 10:25:53.278757 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.278604    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d789b5c7-cv72n"]
Sep 14 10:25:53.285697 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.283485    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 14 10:25:53.288046 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.288025    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k7t76"]
Sep 14 10:25:53.305231 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.305209    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k7t76"
Sep 14 10:25:53.305467 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.305443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k7t76"]
Sep 14 10:25:53.308903 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.308871    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 14 10:25:53.308986 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.308909    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 14 10:25:53.308986 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.308931    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 14 10:25:53.309098 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.309014    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k6n66\""
Sep 14 10:25:53.312941 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.312921    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hvfbq"]
Sep 14 10:25:53.314407 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-registry-certificates\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.314489 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-image-registry-private-configuration\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.314489 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-registry-tls\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.314566 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314503    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2261f98f-d83a-476d-88d7-e42c037c25b7-cert\") pod \"ingress-canary-k7t76\" (UID: \"2261f98f-d83a-476d-88d7-e42c037c25b7\") " pod="openshift-ingress-canary/ingress-canary-k7t76"
Sep 14 10:25:53.314566 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v72b\" (UniqueName: \"kubernetes.io/projected/2261f98f-d83a-476d-88d7-e42c037c25b7-kube-api-access-6v72b\") pod \"ingress-canary-k7t76\" (UID: \"2261f98f-d83a-476d-88d7-e42c037c25b7\") " pod="openshift-ingress-canary/ingress-canary-k7t76"
Sep 14 10:25:53.314639 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-installation-pull-secrets\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.314639 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w52x\" (UniqueName: \"kubernetes.io/projected/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-kube-api-access-8w52x\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.314743 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-ca-trust-extracted\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.314797 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-trusted-ca\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.314797 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.314778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-bound-sa-token\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.338472 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.338451    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hvfbq"]
Sep 14 10:25:53.338730 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.338711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.344825 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.344809    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-msf85\""
Sep 14 10:25:53.344940 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.344870    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 14 10:25:53.344940 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.344884    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 14 10:25:53.344940 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.344876    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 14 10:25:53.345075 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.345029    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 14 10:25:53.380447 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.380427    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sklt4"]
Sep 14 10:25:53.398470 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.398452    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.401929 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.401906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dh7mm\""
Sep 14 10:25:53.402313 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.402299    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 14 10:25:53.403140 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.403123    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 14 10:25:53.403857 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.403802    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sklt4"]
Sep 14 10:25:53.415574 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00ce615a-bfca-4fb3-8a72-fb4649206267-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.415653 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de7a6090-1c0d-4a70-95f4-3f398a60513b-tmp-dir\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.415653 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-registry-certificates\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.415653 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ce615a-bfca-4fb3-8a72-fb4649206267-data-volume\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.415771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00ce615a-bfca-4fb3-8a72-fb4649206267-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.415771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-image-registry-private-configuration\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.415771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-registry-tls\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.415771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7a6090-1c0d-4a70-95f4-3f398a60513b-metrics-tls\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.415771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2261f98f-d83a-476d-88d7-e42c037c25b7-cert\") pod \"ingress-canary-k7t76\" (UID: \"2261f98f-d83a-476d-88d7-e42c037c25b7\") " pod="openshift-ingress-canary/ingress-canary-k7t76"
Sep 14 10:25:53.415932 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v72b\" (UniqueName: \"kubernetes.io/projected/2261f98f-d83a-476d-88d7-e42c037c25b7-kube-api-access-6v72b\") pod \"ingress-canary-k7t76\" (UID: \"2261f98f-d83a-476d-88d7-e42c037c25b7\") " pod="openshift-ingress-canary/ingress-canary-k7t76"
Sep 14 10:25:53.415932 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-installation-pull-secrets\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.415932 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w52x\" (UniqueName: \"kubernetes.io/projected/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-kube-api-access-8w52x\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.415932 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-ca-trust-extracted\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.416104 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qkvz\" (UniqueName: \"kubernetes.io/projected/de7a6090-1c0d-4a70-95f4-3f398a60513b-kube-api-access-9qkvz\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.416104 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.415988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-trusted-ca\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.416104 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.416022    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjwh\" (UniqueName: \"kubernetes.io/projected/00ce615a-bfca-4fb3-8a72-fb4649206267-kube-api-access-6vjwh\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.416104 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.416045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-bound-sa-token\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.416104 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.416078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de7a6090-1c0d-4a70-95f4-3f398a60513b-config-volume\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.416495 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.416475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-ca-trust-extracted\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.416591 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.416514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00ce615a-bfca-4fb3-8a72-fb4649206267-crio-socket\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.416734 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.416717    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-registry-certificates\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.417016 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.416967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-trusted-ca\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.419890 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.419871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-image-registry-private-configuration\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.419979 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.419891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2261f98f-d83a-476d-88d7-e42c037c25b7-cert\") pod \"ingress-canary-k7t76\" (UID: \"2261f98f-d83a-476d-88d7-e42c037c25b7\") " pod="openshift-ingress-canary/ingress-canary-k7t76"
Sep 14 10:25:53.419979 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.419896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-installation-pull-secrets\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.419979 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.419909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-registry-tls\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.427921 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.427900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w52x\" (UniqueName: \"kubernetes.io/projected/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-kube-api-access-8w52x\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.428085 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.428070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v72b\" (UniqueName: \"kubernetes.io/projected/2261f98f-d83a-476d-88d7-e42c037c25b7-kube-api-access-6v72b\") pod \"ingress-canary-k7t76\" (UID: \"2261f98f-d83a-476d-88d7-e42c037c25b7\") " pod="openshift-ingress-canary/ingress-canary-k7t76"
Sep 14 10:25:53.433819 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.433800    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a-bound-sa-token\") pod \"image-registry-7d789b5c7-cv72n\" (UID: \"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a\") " pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.517510 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ce615a-bfca-4fb3-8a72-fb4649206267-data-volume\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.517510 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00ce615a-bfca-4fb3-8a72-fb4649206267-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.517510 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7a6090-1c0d-4a70-95f4-3f398a60513b-metrics-tls\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.517725 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qkvz\" (UniqueName: \"kubernetes.io/projected/de7a6090-1c0d-4a70-95f4-3f398a60513b-kube-api-access-9qkvz\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.517725 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjwh\" (UniqueName: \"kubernetes.io/projected/00ce615a-bfca-4fb3-8a72-fb4649206267-kube-api-access-6vjwh\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.517725 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de7a6090-1c0d-4a70-95f4-3f398a60513b-config-volume\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.517725 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00ce615a-bfca-4fb3-8a72-fb4649206267-crio-socket\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.517725 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00ce615a-bfca-4fb3-8a72-fb4649206267-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.518027 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de7a6090-1c0d-4a70-95f4-3f398a60513b-tmp-dir\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.518027 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.517822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ce615a-bfca-4fb3-8a72-fb4649206267-data-volume\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.518027 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.518011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00ce615a-bfca-4fb3-8a72-fb4649206267-crio-socket\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.518331 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.518076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de7a6090-1c0d-4a70-95f4-3f398a60513b-tmp-dir\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.518331 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.518134    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00ce615a-bfca-4fb3-8a72-fb4649206267-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.518331 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.518245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de7a6090-1c0d-4a70-95f4-3f398a60513b-config-volume\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.519710 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.519692    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de7a6090-1c0d-4a70-95f4-3f398a60513b-metrics-tls\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.519830 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.519813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00ce615a-bfca-4fb3-8a72-fb4649206267-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.526798 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.526779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjwh\" (UniqueName: \"kubernetes.io/projected/00ce615a-bfca-4fb3-8a72-fb4649206267-kube-api-access-6vjwh\") pod \"insights-runtime-extractor-hvfbq\" (UID: \"00ce615a-bfca-4fb3-8a72-fb4649206267\") " pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.526919 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.526905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qkvz\" (UniqueName: \"kubernetes.io/projected/de7a6090-1c0d-4a70-95f4-3f398a60513b-kube-api-access-9qkvz\") pod \"dns-default-sklt4\" (UID: \"de7a6090-1c0d-4a70-95f4-3f398a60513b\") " pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.581897 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.581879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:53.614492 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.614454    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k7t76"
Sep 14 10:25:53.647011 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.646979    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hvfbq"
Sep 14 10:25:53.707014 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.706992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:53.870772 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.870744    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d789b5c7-cv72n"]
Sep 14 10:25:53.874370 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:53.874346    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48743b5_cc8a_4cbb_9fa1_a87b1fdc3f2a.slice/crio-a035aed5cc5d0975ae5d1bc0bda2f8ebe4c1dc019c1de0e873ee32cbd33f58e2 WatchSource:0}: Error finding container a035aed5cc5d0975ae5d1bc0bda2f8ebe4c1dc019c1de0e873ee32cbd33f58e2: Status 404 returned error can't find the container with id a035aed5cc5d0975ae5d1bc0bda2f8ebe4c1dc019c1de0e873ee32cbd33f58e2
Sep 14 10:25:53.887095 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.887071    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k7t76"]
Sep 14 10:25:53.890538 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:53.890518    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2261f98f_d83a_476d_88d7_e42c037c25b7.slice/crio-65d26316a1f46efee10570850a66bf8df94b4520ea39c6b5a66b793e1b38ea87 WatchSource:0}: Error finding container 65d26316a1f46efee10570850a66bf8df94b4520ea39c6b5a66b793e1b38ea87: Status 404 returned error can't find the container with id 65d26316a1f46efee10570850a66bf8df94b4520ea39c6b5a66b793e1b38ea87
Sep 14 10:25:53.925764 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.925739    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hvfbq"]
Sep 14 10:25:53.930151 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:53.930126    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ce615a_bfca_4fb3_8a72_fb4649206267.slice/crio-4c765c00bce678bbe35b86643af4de4295169f37dc25773529cd2a47088414c5 WatchSource:0}: Error finding container 4c765c00bce678bbe35b86643af4de4295169f37dc25773529cd2a47088414c5: Status 404 returned error can't find the container with id 4c765c00bce678bbe35b86643af4de4295169f37dc25773529cd2a47088414c5
Sep 14 10:25:53.976721 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:53.976510    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sklt4"]
Sep 14 10:25:53.979498 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:53.979475    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7a6090_1c0d_4a70_95f4_3f398a60513b.slice/crio-1a39e0470ee37a1fb7f87b8ac4ca9335ddd9aa5cdd7b9396c1a5c7f75622cf7e WatchSource:0}: Error finding container 1a39e0470ee37a1fb7f87b8ac4ca9335ddd9aa5cdd7b9396c1a5c7f75622cf7e: Status 404 returned error can't find the container with id 1a39e0470ee37a1fb7f87b8ac4ca9335ddd9aa5cdd7b9396c1a5c7f75622cf7e
Sep 14 10:25:54.197034 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.196920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sklt4" event={"ID":"de7a6090-1c0d-4a70-95f4-3f398a60513b","Type":"ContainerStarted","Data":"1a39e0470ee37a1fb7f87b8ac4ca9335ddd9aa5cdd7b9396c1a5c7f75622cf7e"}
Sep 14 10:25:54.198076 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.198026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k7t76" event={"ID":"2261f98f-d83a-476d-88d7-e42c037c25b7","Type":"ContainerStarted","Data":"65d26316a1f46efee10570850a66bf8df94b4520ea39c6b5a66b793e1b38ea87"}
Sep 14 10:25:54.199539 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.199511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hvfbq" event={"ID":"00ce615a-bfca-4fb3-8a72-fb4649206267","Type":"ContainerStarted","Data":"3e8f922eec8d0e14e7420001c87e8c8d0aabc536022e42d7300cc38567efe66e"}
Sep 14 10:25:54.199614 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.199560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hvfbq" event={"ID":"00ce615a-bfca-4fb3-8a72-fb4649206267","Type":"ContainerStarted","Data":"4c765c00bce678bbe35b86643af4de4295169f37dc25773529cd2a47088414c5"}
Sep 14 10:25:54.201002 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.200981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d789b5c7-cv72n" event={"ID":"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a","Type":"ContainerStarted","Data":"885d78bb7f954e42147c15d7ef6869d498f73ad80f403839671e811f4f3eae2b"}
Sep 14 10:25:54.201091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.201020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d789b5c7-cv72n" event={"ID":"e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a","Type":"ContainerStarted","Data":"a035aed5cc5d0975ae5d1bc0bda2f8ebe4c1dc019c1de0e873ee32cbd33f58e2"}
Sep 14 10:25:54.201143 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.201126    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:25:54.228324 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.228284    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d789b5c7-cv72n" podStartSLOduration=6.228270846 podStartE2EDuration="6.228270846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:54.227869003 +0000 UTC m=+51.769270838" watchObservedRunningTime="2026-09-14 10:25:54.228270846 +0000 UTC m=+51.769672659"
Sep 14 10:25:54.971625 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.971590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:25:54.971815 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.971591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:25:54.971815 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.971739    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:25:54.974793 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.974767    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsz5x\""
Sep 14 10:25:54.975760 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.975741    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 14 10:25:54.975856 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.975769    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 14 10:25:54.975856 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.975778    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 10:25:54.976086 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.976070    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rjh76\""
Sep 14 10:25:54.976155 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:54.976141    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 10:25:55.206826 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:55.206743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hvfbq" event={"ID":"00ce615a-bfca-4fb3-8a72-fb4649206267","Type":"ContainerStarted","Data":"873b5a7741eb592464aec212faa4f65da2e817218be115a8b304e2b58f88d09e"}
Sep 14 10:25:56.211362 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:56.211325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sklt4" event={"ID":"de7a6090-1c0d-4a70-95f4-3f398a60513b","Type":"ContainerStarted","Data":"93d4ab2857d5c548ceb3d3d61c1a70b285ae95792e99bee1771a4592f9f7ec1f"}
Sep 14 10:25:57.219381 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:57.219287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hvfbq" event={"ID":"00ce615a-bfca-4fb3-8a72-fb4649206267","Type":"ContainerStarted","Data":"1b00b44593e21d3f526cba020d263eaa99d1699c56655f8003630403df46aff8"}
Sep 14 10:25:57.221000 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:57.220975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sklt4" event={"ID":"de7a6090-1c0d-4a70-95f4-3f398a60513b","Type":"ContainerStarted","Data":"27c912eef005b90eb1173070e53baaec36a46e511f1bf26d0911078708e272a4"}
Sep 14 10:25:57.221114 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:57.221028    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sklt4"
Sep 14 10:25:57.222293 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:57.222275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k7t76" event={"ID":"2261f98f-d83a-476d-88d7-e42c037c25b7","Type":"ContainerStarted","Data":"f00a5a0c8667cc5e4c22b15b52809dab2d62da4ba149d10f7e439f55ea8f59bb"}
Sep 14 10:25:57.238984 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:57.238946    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hvfbq" podStartSLOduration=1.36818764 podStartE2EDuration="4.238936601s" totalImagesPullingTime="2.870748961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:57.23777133 +0000 UTC m=+54.779173132" watchObservedRunningTime="2026-09-14 10:25:57.238936601 +0000 UTC m=+54.780338402"
Sep 14 10:25:57.255248 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:57.255207    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k7t76" podStartSLOduration=1.231243891 podStartE2EDuration="4.255192729s" totalImagesPullingTime="3.023948838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:57.254623891 +0000 UTC m=+54.796025691" watchObservedRunningTime="2026-09-14 10:25:57.255192729 +0000 UTC m=+54.796594522"
Sep 14 10:25:57.272774 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:57.272727    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sklt4" podStartSLOduration=2.547307167 podStartE2EDuration="4.272710987s" totalImagesPullingTime="1.72540382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:57.271906293 +0000 UTC m=+54.813308085" watchObservedRunningTime="2026-09-14 10:25:57.272710987 +0000 UTC m=+54.814112787"
Sep 14 10:25:59.257023 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.256991    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-99td2"]
Sep 14 10:25:59.286917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.286895    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-99td2"]
Sep 14 10:25:59.287040 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.286992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.289795 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.289776    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 14 10:25:59.289905 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.289806    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 14 10:25:59.290839 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.290823    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 14 10:25:59.290949 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.290933    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 14 10:25:59.291028 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.290947    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 14 10:25:59.291153 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.291136    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-q68n9\""
Sep 14 10:25:59.361807 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.361785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.361943 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.361811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8psd\" (UniqueName: \"kubernetes.io/projected/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-kube-api-access-s8psd\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.361943 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.361831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.361943 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.361855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.463143 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.463108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.463143 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.463145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8psd\" (UniqueName: \"kubernetes.io/projected/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-kube-api-access-s8psd\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.463326 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.463167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.463366 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.463347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.463848 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.463828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.466658 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.466636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.466750 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.466696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.472382 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.472362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8psd\" (UniqueName: \"kubernetes.io/projected/3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e-kube-api-access-s8psd\") pod \"prometheus-operator-68bcd7f987-99td2\" (UID: \"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.595897 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.595865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2"
Sep 14 10:25:59.885883 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:25:59.885807    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-99td2"]
Sep 14 10:25:59.888805 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:25:59.888783    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5ef2d9_c27c_4c8a_a0b8_cc3126afd77e.slice/crio-5d9c72524bab269085b781817374197a3e14ecaa9975f1e0d2bc0d04d79b27c3 WatchSource:0}: Error finding container 5d9c72524bab269085b781817374197a3e14ecaa9975f1e0d2bc0d04d79b27c3: Status 404 returned error can't find the container with id 5d9c72524bab269085b781817374197a3e14ecaa9975f1e0d2bc0d04d79b27c3
Sep 14 10:26:00.234814 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:00.234740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2" event={"ID":"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e","Type":"ContainerStarted","Data":"5d9c72524bab269085b781817374197a3e14ecaa9975f1e0d2bc0d04d79b27c3"}
Sep 14 10:26:01.144197 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:01.144172    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7zz8"
Sep 14 10:26:01.241804 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:01.241769    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2" event={"ID":"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e","Type":"ContainerStarted","Data":"3332c48d3d1a3fc26950beb17e397b2c154041debd33ef9a8576c845ad88d508"}
Sep 14 10:26:01.241932 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:01.241870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2" event={"ID":"3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e","Type":"ContainerStarted","Data":"49bb4a0fc14ee577bcfa5a839ccf1d9342294403ff9fc13b25e5b4d7e77158b4"}
Sep 14 10:26:01.261368 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:01.261306    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-99td2" podStartSLOduration=1.018438754 podStartE2EDuration="2.261278753s" totalImagesPullingTime="1.242839999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:01.260252493 +0000 UTC m=+58.801654297" watchObservedRunningTime="2026-09-14 10:26:01.261278753 +0000 UTC m=+58.802680555"
Sep 14 10:26:03.716831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.716797    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bxv27"]
Sep 14 10:26:03.720722 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.720705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.724804 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.724782    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 14 10:26:03.724985 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.724891    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 14 10:26:03.725558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.725538    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c4k9f\""
Sep 14 10:26:03.725558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.725556    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 14 10:26:03.790990 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.790966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kzjh\" (UniqueName: \"kubernetes.io/projected/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-kube-api-access-5kzjh\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.791110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.791003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.791110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.791068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-tls\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.791110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.791102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-textfile\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.791204 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.791123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-root\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.791204 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.791148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-wtmp\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.791204 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.791165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-metrics-client-ca\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.791290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.791248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.791290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.791269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-sys\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.891755 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-wtmp\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.891755 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-metrics-client-ca\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.891904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.891904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-sys\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.891904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kzjh\" (UniqueName: \"kubernetes.io/projected/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-kube-api-access-5kzjh\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.891904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.891904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-wtmp\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.891904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-tls\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.892162 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-sys\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.892162 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-textfile\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.892162 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.891969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-root\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.892162 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:26:03.892001    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 14 10:26:03.892162 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.892024    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-root\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.892162 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:26:03.892053    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-tls podName:33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35 nodeName:}" failed. No retries permitted until 2026-09-14 10:26:04.392036004 +0000 UTC m=+61.933437797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-tls") pod "node-exporter-bxv27" (UID: "33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35") : secret "node-exporter-tls" not found
Sep 14 10:26:03.892394 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.892258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-textfile\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.892394 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.892361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-metrics-client-ca\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.892394 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.892371    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.894164 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.894145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:03.908247 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:03.908228    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kzjh\" (UniqueName: \"kubernetes.io/projected/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-kube-api-access-5kzjh\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:04.396038 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:04.396008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-tls\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:04.398303 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:04.398284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35-node-exporter-tls\") pod \"node-exporter-bxv27\" (UID: \"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35\") " pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:04.629182 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:04.629154    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxv27"
Sep 14 10:26:04.640410 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:26:04.640369    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33fc1af3_b0d2_4b43_83ca_c8b77cfdcb35.slice/crio-ab27bcc891c61921c20431f0e5b5ff3127482700d867455a253af050173063be WatchSource:0}: Error finding container ab27bcc891c61921c20431f0e5b5ff3127482700d867455a253af050173063be: Status 404 returned error can't find the container with id ab27bcc891c61921c20431f0e5b5ff3127482700d867455a253af050173063be
Sep 14 10:26:05.256968 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:05.256929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxv27" event={"ID":"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35","Type":"ContainerStarted","Data":"ab27bcc891c61921c20431f0e5b5ff3127482700d867455a253af050173063be"}
Sep 14 10:26:06.261570 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:06.261535    2578 generic.go:356] "Generic (PLEG): container finished" podID="33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35" containerID="478d5f20c8c287add2fb4ca9cbbe347f9527888b3ab9b7a02b186b3025671ea0" exitCode=0
Sep 14 10:26:06.262055 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:06.261602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxv27" event={"ID":"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35","Type":"ContainerDied","Data":"478d5f20c8c287add2fb4ca9cbbe347f9527888b3ab9b7a02b186b3025671ea0"}
Sep 14 10:26:07.230366 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:07.230338    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sklt4"
Sep 14 10:26:07.267044 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:07.267005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxv27" event={"ID":"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35","Type":"ContainerStarted","Data":"d4fe2de8833a868c9600e892a090118f48463066c05a71b9fdb6fc8aecbfe51e"}
Sep 14 10:26:07.267382 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:07.267064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxv27" event={"ID":"33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35","Type":"ContainerStarted","Data":"87e73e98b88b0ed528e1e765afb12be227da16835a491085a58ebe53f2c1f1da"}
Sep 14 10:26:07.317866 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:07.317817    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bxv27" podStartSLOduration=3.271007243 podStartE2EDuration="4.317800271s" totalImagesPullingTime="979.326187ms" totalInitContainerRuntime="67.466841ms" isStatefulPod=true podCreationTimestamp="2026-09-14 10:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:07.316323907 +0000 UTC m=+64.857725707" watchObservedRunningTime="2026-09-14 10:26:07.317800271 +0000 UTC m=+64.859202071"
Sep 14 10:26:08.097559 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.097510    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f6975b68b-n8vjg"]
Sep 14 10:26:08.099451 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.099421    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.103249 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.103221    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 14 10:26:08.103249 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.103225    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 14 10:26:08.104566 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.104545    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9smwp\""
Sep 14 10:26:08.104658 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.104610    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 14 10:26:08.104778 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.104758    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 14 10:26:08.104923 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.104832    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ebi619rckjfda\""
Sep 14 10:26:08.115073 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.115047    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f6975b68b-n8vjg"]
Sep 14 10:26:08.124363 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.124346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/42267498-b89c-4452-929b-51839c3cc629-secret-metrics-server-tls\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.124452 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.124379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42267498-b89c-4452-929b-51839c3cc629-client-ca-bundle\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.124452 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.124398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/42267498-b89c-4452-929b-51839c3cc629-audit-log\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.124525 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.124475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/42267498-b89c-4452-929b-51839c3cc629-metrics-server-audit-profiles\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.124557 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.124529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/42267498-b89c-4452-929b-51839c3cc629-secret-metrics-server-client-certs\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.124557 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.124547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxr57\" (UniqueName: \"kubernetes.io/projected/42267498-b89c-4452-929b-51839c3cc629-kube-api-access-dxr57\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.124617 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.124579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42267498-b89c-4452-929b-51839c3cc629-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.225524 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.225487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42267498-b89c-4452-929b-51839c3cc629-client-ca-bundle\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.225524 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.225532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/42267498-b89c-4452-929b-51839c3cc629-audit-log\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.225806 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.225590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/42267498-b89c-4452-929b-51839c3cc629-metrics-server-audit-profiles\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.225806 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.225639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/42267498-b89c-4452-929b-51839c3cc629-secret-metrics-server-client-certs\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.225806 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.225662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxr57\" (UniqueName: \"kubernetes.io/projected/42267498-b89c-4452-929b-51839c3cc629-kube-api-access-dxr57\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.225806 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.225717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42267498-b89c-4452-929b-51839c3cc629-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.225806 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.225758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/42267498-b89c-4452-929b-51839c3cc629-secret-metrics-server-tls\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.226109 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.226089    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/42267498-b89c-4452-929b-51839c3cc629-audit-log\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.226631 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.226597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/42267498-b89c-4452-929b-51839c3cc629-metrics-server-audit-profiles\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.226756 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.226631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42267498-b89c-4452-929b-51839c3cc629-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.228097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.228076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42267498-b89c-4452-929b-51839c3cc629-client-ca-bundle\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.228199 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.228124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/42267498-b89c-4452-929b-51839c3cc629-secret-metrics-server-tls\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.228308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.228290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/42267498-b89c-4452-929b-51839c3cc629-secret-metrics-server-client-certs\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.238989 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.238964    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxr57\" (UniqueName: \"kubernetes.io/projected/42267498-b89c-4452-929b-51839c3cc629-kube-api-access-dxr57\") pod \"metrics-server-f6975b68b-n8vjg\" (UID: \"42267498-b89c-4452-929b-51839c3cc629\") " pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.408751 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.408655    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:08.506605 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.506574    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"]
Sep 14 10:26:08.508854 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.508836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:08.511660 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.511638    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-88vs8\""
Sep 14 10:26:08.511800 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.511785    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 14 10:26:08.520933 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.520914    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"]
Sep 14 10:26:08.628279 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.628247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fdc388c-dfe1-4424-880d-f2dbfd27ba7a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-7l88l\" (UID: \"6fdc388c-dfe1-4424-880d-f2dbfd27ba7a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:08.628279 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.628282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqsxw\" (UniqueName: \"kubernetes.io/projected/6fdc388c-dfe1-4424-880d-f2dbfd27ba7a-kube-api-access-lqsxw\") pod \"monitoring-plugin-5d85778b9d-7l88l\" (UID: \"6fdc388c-dfe1-4424-880d-f2dbfd27ba7a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:08.684051 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.684029    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f6975b68b-n8vjg"]
Sep 14 10:26:08.686137 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:26:08.686118    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42267498_b89c_4452_929b_51839c3cc629.slice/crio-fd3f8ac933560aff49b4c2fcc159510a2fbda7bbf42d66a38753d99a24a745d4 WatchSource:0}: Error finding container fd3f8ac933560aff49b4c2fcc159510a2fbda7bbf42d66a38753d99a24a745d4: Status 404 returned error can't find the container with id fd3f8ac933560aff49b4c2fcc159510a2fbda7bbf42d66a38753d99a24a745d4
Sep 14 10:26:08.729259 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.729232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:26:08.729367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.729267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fdc388c-dfe1-4424-880d-f2dbfd27ba7a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-7l88l\" (UID: \"6fdc388c-dfe1-4424-880d-f2dbfd27ba7a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:08.729367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.729298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqsxw\" (UniqueName: \"kubernetes.io/projected/6fdc388c-dfe1-4424-880d-f2dbfd27ba7a-kube-api-access-lqsxw\") pod \"monitoring-plugin-5d85778b9d-7l88l\" (UID: \"6fdc388c-dfe1-4424-880d-f2dbfd27ba7a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:08.729367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.729344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:26:08.729484 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.729391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:26:08.731705 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.731663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fdc388c-dfe1-4424-880d-f2dbfd27ba7a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-7l88l\" (UID: \"6fdc388c-dfe1-4424-880d-f2dbfd27ba7a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:08.732250 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.732233    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 14 10:26:08.732310 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.732232    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 10:26:08.732356 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.732307    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 10:26:08.738437 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.738420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqsxw\" (UniqueName: \"kubernetes.io/projected/6fdc388c-dfe1-4424-880d-f2dbfd27ba7a-kube-api-access-lqsxw\") pod \"monitoring-plugin-5d85778b9d-7l88l\" (UID: \"6fdc388c-dfe1-4424-880d-f2dbfd27ba7a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:08.742020 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.742004    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2a0e91f-654d-4dc1-aeaa-14267a34a523-original-pull-secret\") pod \"global-pull-secret-syncer-qs687\" (UID: \"b2a0e91f-654d-4dc1-aeaa-14267a34a523\") " pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:26:08.742343 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.742327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c3e812-6a9f-4945-b043-2cf5ebe13963-metrics-certs\") pod \"network-metrics-daemon-b4s8s\" (UID: \"80c3e812-6a9f-4945-b043-2cf5ebe13963\") " pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:26:08.742863 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.742848    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 14 10:26:08.752479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.752456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vft5g\" (UniqueName: \"kubernetes.io/projected/20ac4e2f-ee02-4246-8a3e-dc906ce775d2-kube-api-access-vft5g\") pod \"network-check-target-hfzjz\" (UID: \"20ac4e2f-ee02-4246-8a3e-dc906ce775d2\") " pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:26:08.786171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.786152    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsz5x\""
Sep 14 10:26:08.791345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.791334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs687"
Sep 14 10:26:08.794456 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.794440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:26:08.801532 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.801517    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rjh76\""
Sep 14 10:26:08.808793 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.808772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4s8s"
Sep 14 10:26:08.818165 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.818130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:08.875945 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.874926    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f4cd77f9d-mjntz"]
Sep 14 10:26:08.878524 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.877643    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:08.882729 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.881279    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r7wmm\""
Sep 14 10:26:08.882729 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.881624    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 14 10:26:08.882729 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.882528    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 10:26:08.882962 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.882757    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 10:26:08.883311 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.883151    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 10:26:08.884012 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.883826    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 10:26:08.884393 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.884235    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 10:26:08.886167 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.884584    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 14 10:26:08.893967 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.893937    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 10:26:08.899974 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.899884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4cd77f9d-mjntz"]
Sep 14 10:26:08.931308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.931283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-oauth-serving-cert\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:08.931465 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.931324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-serving-cert\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:08.931465 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.931356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-oauth-config\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:08.931465 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.931405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-service-ca\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:08.931465 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.931455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtg8l\" (UniqueName: \"kubernetes.io/projected/efe74112-524a-4b94-a527-4115344300f5-kube-api-access-dtg8l\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:08.931610 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.931478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-trusted-ca-bundle\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:08.931610 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:08.931509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-console-config\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.032607 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.032514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-service-ca\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.032607 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.032553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtg8l\" (UniqueName: \"kubernetes.io/projected/efe74112-524a-4b94-a527-4115344300f5-kube-api-access-dtg8l\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.032607 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.032575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-trusted-ca-bundle\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.032607 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.032598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-console-config\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.032961 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.032625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-oauth-serving-cert\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.032961 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.032651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-serving-cert\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.032961 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.032696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-oauth-config\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.033321 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.033284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-service-ca\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.033488 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.033464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-trusted-ca-bundle\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.033542 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.033464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-oauth-serving-cert\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.033542 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.033475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-console-config\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.035148 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.035124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-serving-cert\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.035148 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.035143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-oauth-config\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.050128 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.050108    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtg8l\" (UniqueName: \"kubernetes.io/projected/efe74112-524a-4b94-a527-4115344300f5-kube-api-access-dtg8l\") pod \"console-7f4cd77f9d-mjntz\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") " pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.080238 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.080077    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hfzjz"]
Sep 14 10:26:09.082091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.082069    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qs687"]
Sep 14 10:26:09.083209 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:26:09.083186    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ac4e2f_ee02_4246_8a3e_dc906ce775d2.slice/crio-b45e1e9ac849512081ace2f167e7fcdfb18af29b1200d0a7553641fbaebe4d63 WatchSource:0}: Error finding container b45e1e9ac849512081ace2f167e7fcdfb18af29b1200d0a7553641fbaebe4d63: Status 404 returned error can't find the container with id b45e1e9ac849512081ace2f167e7fcdfb18af29b1200d0a7553641fbaebe4d63
Sep 14 10:26:09.085014 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:26:09.084897    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a0e91f_654d_4dc1_aeaa_14267a34a523.slice/crio-f08fb2684bee9af470278490011a45083c8ce74f30bd79dc67114d306587a414 WatchSource:0}: Error finding container f08fb2684bee9af470278490011a45083c8ce74f30bd79dc67114d306587a414: Status 404 returned error can't find the container with id f08fb2684bee9af470278490011a45083c8ce74f30bd79dc67114d306587a414
Sep 14 10:26:09.105404 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.105384    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4s8s"]
Sep 14 10:26:09.108107 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:26:09.108084    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c3e812_6a9f_4945_b043_2cf5ebe13963.slice/crio-14955ac9e2a5d9102fb48d5706e7e36557ef8d6b6ef0677a9496bebf1c7fbc7a WatchSource:0}: Error finding container 14955ac9e2a5d9102fb48d5706e7e36557ef8d6b6ef0677a9496bebf1c7fbc7a: Status 404 returned error can't find the container with id 14955ac9e2a5d9102fb48d5706e7e36557ef8d6b6ef0677a9496bebf1c7fbc7a
Sep 14 10:26:09.112005 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.111986    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"]
Sep 14 10:26:09.114554 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:26:09.114532    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdc388c_dfe1_4424_880d_f2dbfd27ba7a.slice/crio-c6d9d3fa33543103fba4b4ba5db0441972cf7921f14e1556400f339119cf3dbf WatchSource:0}: Error finding container c6d9d3fa33543103fba4b4ba5db0441972cf7921f14e1556400f339119cf3dbf: Status 404 returned error can't find the container with id c6d9d3fa33543103fba4b4ba5db0441972cf7921f14e1556400f339119cf3dbf
Sep 14 10:26:09.198340 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.198306    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:09.276367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.276335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hfzjz" event={"ID":"20ac4e2f-ee02-4246-8a3e-dc906ce775d2","Type":"ContainerStarted","Data":"b45e1e9ac849512081ace2f167e7fcdfb18af29b1200d0a7553641fbaebe4d63"}
Sep 14 10:26:09.277863 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.277836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qs687" event={"ID":"b2a0e91f-654d-4dc1-aeaa-14267a34a523","Type":"ContainerStarted","Data":"f08fb2684bee9af470278490011a45083c8ce74f30bd79dc67114d306587a414"}
Sep 14 10:26:09.279134 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.279107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l" event={"ID":"6fdc388c-dfe1-4424-880d-f2dbfd27ba7a","Type":"ContainerStarted","Data":"c6d9d3fa33543103fba4b4ba5db0441972cf7921f14e1556400f339119cf3dbf"}
Sep 14 10:26:09.280415 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.280377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4s8s" event={"ID":"80c3e812-6a9f-4945-b043-2cf5ebe13963","Type":"ContainerStarted","Data":"14955ac9e2a5d9102fb48d5706e7e36557ef8d6b6ef0677a9496bebf1c7fbc7a"}
Sep 14 10:26:09.281392 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.281372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg" event={"ID":"42267498-b89c-4452-929b-51839c3cc629","Type":"ContainerStarted","Data":"fd3f8ac933560aff49b4c2fcc159510a2fbda7bbf42d66a38753d99a24a745d4"}
Sep 14 10:26:09.480867 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:09.480726    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4cd77f9d-mjntz"]
Sep 14 10:26:09.485117 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:26:09.485091    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe74112_524a_4b94_a527_4115344300f5.slice/crio-6da04a3d6e19156df28ee0b8f6d65442d8fe04fadcb30ef3cf6c42e3d1c8929a WatchSource:0}: Error finding container 6da04a3d6e19156df28ee0b8f6d65442d8fe04fadcb30ef3cf6c42e3d1c8929a: Status 404 returned error can't find the container with id 6da04a3d6e19156df28ee0b8f6d65442d8fe04fadcb30ef3cf6c42e3d1c8929a
Sep 14 10:26:10.288270 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:10.288195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4cd77f9d-mjntz" event={"ID":"efe74112-524a-4b94-a527-4115344300f5","Type":"ContainerStarted","Data":"6da04a3d6e19156df28ee0b8f6d65442d8fe04fadcb30ef3cf6c42e3d1c8929a"}
Sep 14 10:26:12.300547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.299580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l" event={"ID":"6fdc388c-dfe1-4424-880d-f2dbfd27ba7a","Type":"ContainerStarted","Data":"c91c38694eba7bec28079abf5ea1f8b14d51bf2f0066434715746b485016ce93"}
Sep 14 10:26:12.300547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.300496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:12.305561 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.303159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4s8s" event={"ID":"80c3e812-6a9f-4945-b043-2cf5ebe13963","Type":"ContainerStarted","Data":"3e7b3e7a3c8dea544cee3dcbe3df16732a8c4569bee1f9a5e02e9e53f84fa66d"}
Sep 14 10:26:12.305561 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.303213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4s8s" event={"ID":"80c3e812-6a9f-4945-b043-2cf5ebe13963","Type":"ContainerStarted","Data":"e1d4708121068d2f3ac6dc1f6aeedfaf9c1042bba1b4598ff7b813c9a84620b0"}
Sep 14 10:26:12.306647 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.306596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg" event={"ID":"42267498-b89c-4452-929b-51839c3cc629","Type":"ContainerStarted","Data":"c8ed3e21e18dfc808ffdfadd172639d9d55b51d38bf7f54bf64dc98cfe2fac50"}
Sep 14 10:26:12.307865 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.307316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l"
Sep 14 10:26:12.325432 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.325384    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7l88l" podStartSLOduration=1.96685368 podStartE2EDuration="4.325364538s" totalImagesPullingTime="2.358510858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:12.324059262 +0000 UTC m=+69.865461063" watchObservedRunningTime="2026-09-14 10:26:12.325364538 +0000 UTC m=+69.866766342"
Sep 14 10:26:12.382295 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.382233    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b4s8s" podStartSLOduration=68.020215109 podStartE2EDuration="1m10.382214014s" totalImagesPullingTime="2.361998905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:12.382179433 +0000 UTC m=+69.923581251" watchObservedRunningTime="2026-09-14 10:26:12.382214014 +0000 UTC m=+69.923615815"
Sep 14 10:26:12.412754 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.412698    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg" podStartSLOduration=1.6324178969999998 podStartE2EDuration="4.412662299s" totalImagesPullingTime="2.780244402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:12.41169053 +0000 UTC m=+69.953092326" watchObservedRunningTime="2026-09-14 10:26:12.412662299 +0000 UTC m=+69.954064099"
Sep 14 10:26:12.432150 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:12.432081    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4cd77f9d-mjntz"]
Sep 14 10:26:15.211553 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:15.211528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d789b5c7-cv72n"
Sep 14 10:26:16.323144 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:16.323099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4cd77f9d-mjntz" event={"ID":"efe74112-524a-4b94-a527-4115344300f5","Type":"ContainerStarted","Data":"93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c"}
Sep 14 10:26:16.324986 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:16.324961    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hfzjz" event={"ID":"20ac4e2f-ee02-4246-8a3e-dc906ce775d2","Type":"ContainerStarted","Data":"ecc5aee8eddce21de368610265978d722ff52765a35a46fa3f032d087da2507c"}
Sep 14 10:26:16.325127 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:16.325063    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:26:16.326596 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:16.326553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qs687" event={"ID":"b2a0e91f-654d-4dc1-aeaa-14267a34a523","Type":"ContainerStarted","Data":"8187e3f655b4881cc5c9a3f6fb42f78f83f665025b30e32adb52fb4803ab4c96"}
Sep 14 10:26:16.345556 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:16.345504    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f4cd77f9d-mjntz" podStartSLOduration=2.226026391 podStartE2EDuration="8.345485458s" totalImagesPullingTime="6.119459067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:16.344291965 +0000 UTC m=+73.885693779" watchObservedRunningTime="2026-09-14 10:26:16.345485458 +0000 UTC m=+73.886887259"
Sep 14 10:26:16.364367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:16.363616    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hfzjz" podStartSLOduration=67.845549489 podStartE2EDuration="1m14.363598094s" totalImagesPullingTime="6.518048605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:16.361489321 +0000 UTC m=+73.902891122" watchObservedRunningTime="2026-09-14 10:26:16.363598094 +0000 UTC m=+73.904999896"
Sep 14 10:26:16.385447 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:16.385403    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qs687" podStartSLOduration=66.854772004 podStartE2EDuration="1m13.385391405s" totalImagesPullingTime="6.530619401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:16.384875742 +0000 UTC m=+73.926277544" watchObservedRunningTime="2026-09-14 10:26:16.385391405 +0000 UTC m=+73.926793243"
Sep 14 10:26:19.198934 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:19.198896    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:28.409097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:28.408988    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:28.409097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:28.409046    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:41.343769 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.343703    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f4cd77f9d-mjntz" podUID="efe74112-524a-4b94-a527-4115344300f5" containerName="console" containerID="cri-o://93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c" gracePeriod=15
Sep 14 10:26:41.576030 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.576003    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:41.685861 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.685794    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-serving-cert\") pod \"efe74112-524a-4b94-a527-4115344300f5\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") "
Sep 14 10:26:41.685861 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.685822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-oauth-config\") pod \"efe74112-524a-4b94-a527-4115344300f5\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") "
Sep 14 10:26:41.685861 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.685852    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtg8l\" (UniqueName: \"kubernetes.io/projected/efe74112-524a-4b94-a527-4115344300f5-kube-api-access-dtg8l\") pod \"efe74112-524a-4b94-a527-4115344300f5\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") "
Sep 14 10:26:41.686102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.685878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-oauth-serving-cert\") pod \"efe74112-524a-4b94-a527-4115344300f5\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") "
Sep 14 10:26:41.686102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.686038    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-console-config\") pod \"efe74112-524a-4b94-a527-4115344300f5\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") "
Sep 14 10:26:41.686102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.686082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-trusted-ca-bundle\") pod \"efe74112-524a-4b94-a527-4115344300f5\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") "
Sep 14 10:26:41.686246 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.686145    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-service-ca\") pod \"efe74112-524a-4b94-a527-4115344300f5\" (UID: \"efe74112-524a-4b94-a527-4115344300f5\") "
Sep 14 10:26:41.686576 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.686516    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "efe74112-524a-4b94-a527-4115344300f5" (UID: "efe74112-524a-4b94-a527-4115344300f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:26:41.686875 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.686558    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "efe74112-524a-4b94-a527-4115344300f5" (UID: "efe74112-524a-4b94-a527-4115344300f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:26:41.686875 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.686536    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-console-config" (OuterVolumeSpecName: "console-config") pod "efe74112-524a-4b94-a527-4115344300f5" (UID: "efe74112-524a-4b94-a527-4115344300f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:26:41.686875 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.686641    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "efe74112-524a-4b94-a527-4115344300f5" (UID: "efe74112-524a-4b94-a527-4115344300f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:26:41.688228 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.688191    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "efe74112-524a-4b94-a527-4115344300f5" (UID: "efe74112-524a-4b94-a527-4115344300f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:26:41.688305 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.688273    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe74112-524a-4b94-a527-4115344300f5-kube-api-access-dtg8l" (OuterVolumeSpecName: "kube-api-access-dtg8l") pod "efe74112-524a-4b94-a527-4115344300f5" (UID: "efe74112-524a-4b94-a527-4115344300f5"). InnerVolumeSpecName "kube-api-access-dtg8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:26:41.688305 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.688280    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "efe74112-524a-4b94-a527-4115344300f5" (UID: "efe74112-524a-4b94-a527-4115344300f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:26:41.786787 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.786764    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:26:41.786787 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.786784    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-serving-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:26:41.786895 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.786793    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efe74112-524a-4b94-a527-4115344300f5-console-oauth-config\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:26:41.786895 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.786801    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtg8l\" (UniqueName: \"kubernetes.io/projected/efe74112-524a-4b94-a527-4115344300f5-kube-api-access-dtg8l\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:26:41.786895 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.786810    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-oauth-serving-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:26:41.786895 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.786818    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-console-config\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:26:41.786895 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:41.786826    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efe74112-524a-4b94-a527-4115344300f5-trusted-ca-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:26:42.414980 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.414943    2578 generic.go:356] "Generic (PLEG): container finished" podID="efe74112-524a-4b94-a527-4115344300f5" containerID="93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c" exitCode=0
Sep 14 10:26:42.415425 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.415005    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4cd77f9d-mjntz"
Sep 14 10:26:42.415425 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.415038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4cd77f9d-mjntz" event={"ID":"efe74112-524a-4b94-a527-4115344300f5","Type":"ContainerDied","Data":"93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c"}
Sep 14 10:26:42.415425 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.415118    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4cd77f9d-mjntz" event={"ID":"efe74112-524a-4b94-a527-4115344300f5","Type":"ContainerDied","Data":"6da04a3d6e19156df28ee0b8f6d65442d8fe04fadcb30ef3cf6c42e3d1c8929a"}
Sep 14 10:26:42.415425 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.415144    2578 scope.go:117] "RemoveContainer" containerID="93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c"
Sep 14 10:26:42.423725 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.423709    2578 scope.go:117] "RemoveContainer" containerID="93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c"
Sep 14 10:26:42.423989 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:26:42.423967    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c\": container with ID starting with 93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c not found: ID does not exist" containerID="93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c"
Sep 14 10:26:42.424054 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.423996    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c"} err="failed to get container status \"93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c\": rpc error: code = NotFound desc = could not find container \"93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c\": container with ID starting with 93cd13f86a6af64aada3133182a727e3d9af1d271cb60ce63f3f09a33e86c09c not found: ID does not exist"
Sep 14 10:26:42.440969 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.440948    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4cd77f9d-mjntz"]
Sep 14 10:26:42.448274 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.448252    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f4cd77f9d-mjntz"]
Sep 14 10:26:42.975550 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:42.975521    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efe74112-524a-4b94-a527-4115344300f5" path="/var/lib/kubelet/pods/efe74112-524a-4b94-a527-4115344300f5/volumes"
Sep 14 10:26:47.333153 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:47.333122    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hfzjz"
Sep 14 10:26:48.414292 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:48.414265    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:48.417786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:48.417764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f6975b68b-n8vjg"
Sep 14 10:26:50.935244 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:50.935203    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ffc649769-2f4gc"]
Sep 14 10:26:50.935728 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:50.935536    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe74112-524a-4b94-a527-4115344300f5" containerName="console"
Sep 14 10:26:50.935728 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:50.935554    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe74112-524a-4b94-a527-4115344300f5" containerName="console"
Sep 14 10:26:50.935728 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:50.935610    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe74112-524a-4b94-a527-4115344300f5" containerName="console"
Sep 14 10:26:50.986458 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:50.986426    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:50.991879 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:50.991853    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ffc649769-2f4gc"]
Sep 14 10:26:51.000320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:50.997005    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 10:26:51.000320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:50.997005    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 10:26:51.000851 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.000828    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 10:26:51.000985 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.000884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 10:26:51.000985 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.000896    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 14 10:26:51.000985 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.000884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r7wmm\""
Sep 14 10:26:51.000985 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.000884    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 10:26:51.003530 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.003513    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 14 10:26:51.005501 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.005485    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 10:26:51.152363 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.152323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-config\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.152529 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.152369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-service-ca\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.152529 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.152455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-oauth-serving-cert\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.152529 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.152488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh4vb\" (UniqueName: \"kubernetes.io/projected/6244fda8-c0df-4da6-bf2d-504c12b0fae8-kube-api-access-sh4vb\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.152529 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.152518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-trusted-ca-bundle\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.152709 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.152573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-serving-cert\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.152709 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.152597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-oauth-config\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.253714 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.253608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-oauth-serving-cert\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.253714 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.253653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh4vb\" (UniqueName: \"kubernetes.io/projected/6244fda8-c0df-4da6-bf2d-504c12b0fae8-kube-api-access-sh4vb\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.253714 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.253712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-trusted-ca-bundle\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.253976 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.253730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-serving-cert\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.253976 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.253898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-oauth-config\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.253976 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.253971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-config\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.254142 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.254003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-service-ca\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.254397 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.254375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-oauth-serving-cert\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.254657 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.254635    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-service-ca\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.254735 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.254724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-trusted-ca-bundle\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.254863 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.254843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-config\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.256327 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.256294    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-oauth-config\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.256508 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.256488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-serving-cert\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.277704 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.277658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh4vb\" (UniqueName: \"kubernetes.io/projected/6244fda8-c0df-4da6-bf2d-504c12b0fae8-kube-api-access-sh4vb\") pod \"console-ffc649769-2f4gc\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") " pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.296402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.296381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:26:51.605442 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:51.605412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ffc649769-2f4gc"]
Sep 14 10:26:51.609057 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:26:51.609031    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6244fda8_c0df_4da6_bf2d_504c12b0fae8.slice/crio-2cb0b2745630ce68921885e76b368ab86c89c51b85bb59a2ecbf0d20a3843558 WatchSource:0}: Error finding container 2cb0b2745630ce68921885e76b368ab86c89c51b85bb59a2ecbf0d20a3843558: Status 404 returned error can't find the container with id 2cb0b2745630ce68921885e76b368ab86c89c51b85bb59a2ecbf0d20a3843558
Sep 14 10:26:52.454115 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:52.454078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffc649769-2f4gc" event={"ID":"6244fda8-c0df-4da6-bf2d-504c12b0fae8","Type":"ContainerStarted","Data":"967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845"}
Sep 14 10:26:52.454601 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:52.454127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffc649769-2f4gc" event={"ID":"6244fda8-c0df-4da6-bf2d-504c12b0fae8","Type":"ContainerStarted","Data":"2cb0b2745630ce68921885e76b368ab86c89c51b85bb59a2ecbf0d20a3843558"}
Sep 14 10:26:52.498018 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:26:52.497974    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ffc649769-2f4gc" podStartSLOduration=2.497957491 podStartE2EDuration="2.497957491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:52.496354553 +0000 UTC m=+110.037756367" watchObservedRunningTime="2026-09-14 10:26:52.497957491 +0000 UTC m=+110.039359337"
Sep 14 10:27:01.297449 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:01.297415    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:27:01.297842 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:01.297706    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:27:01.302094 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:01.302076    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:27:01.493216 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:01.493189    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:27:44.393821 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.393787    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"]
Sep 14 10:27:44.395784 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.395768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.403403 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.403385    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 10:27:44.403758 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.403742    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 10:27:44.404642 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.404630    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrtj6\""
Sep 14 10:27:44.426687 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.426648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"]
Sep 14 10:27:44.519563 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.519541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.519701 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.519577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24cw4\" (UniqueName: \"kubernetes.io/projected/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-kube-api-access-24cw4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.519701 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.519603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.620434 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.620410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24cw4\" (UniqueName: \"kubernetes.io/projected/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-kube-api-access-24cw4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.620533 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.620444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.620590 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.620575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.620786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.620771    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.620891 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.620872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.632767 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.632744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24cw4\" (UniqueName: \"kubernetes.io/projected/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-kube-api-access-24cw4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:44.703548 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:44.703498    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:27:45.007423 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:27:45.007393    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eaadf24_bafb_4365_929a_5d8c3d4f7b57.slice/crio-b08e050adb73390970599bc36493fe73d918236196e6d8678f6b009d489a0d85 WatchSource:0}: Error finding container b08e050adb73390970599bc36493fe73d918236196e6d8678f6b009d489a0d85: Status 404 returned error can't find the container with id b08e050adb73390970599bc36493fe73d918236196e6d8678f6b009d489a0d85
Sep 14 10:27:45.022873 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:45.022849    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"]
Sep 14 10:27:45.631324 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:45.631285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb" event={"ID":"1eaadf24-bafb-4365-929a-5d8c3d4f7b57","Type":"ContainerStarted","Data":"b08e050adb73390970599bc36493fe73d918236196e6d8678f6b009d489a0d85"}
Sep 14 10:27:50.650958 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:50.650879    2578 generic.go:356] "Generic (PLEG): container finished" podID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerID="3918e9da8ac4784df1968864410255ce4e1c0d45b0f6a8c5ee9f7fe8d36f5fce" exitCode=0
Sep 14 10:27:50.651286 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:50.650956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb" event={"ID":"1eaadf24-bafb-4365-929a-5d8c3d4f7b57","Type":"ContainerDied","Data":"3918e9da8ac4784df1968864410255ce4e1c0d45b0f6a8c5ee9f7fe8d36f5fce"}
Sep 14 10:27:53.668125 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:53.668096    2578 generic.go:356] "Generic (PLEG): container finished" podID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerID="3ad9a894ab0903e35e85a4b25cd3e61c1e804273853fcbeee661236311c2032e" exitCode=0
Sep 14 10:27:53.668520 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:27:53.668138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb" event={"ID":"1eaadf24-bafb-4365-929a-5d8c3d4f7b57","Type":"ContainerDied","Data":"3ad9a894ab0903e35e85a4b25cd3e61c1e804273853fcbeee661236311c2032e"}
Sep 14 10:28:00.695974 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:00.695942    2578 generic.go:356] "Generic (PLEG): container finished" podID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerID="dd19356b70acbf655a3125fa7696d19648ee87413734fbacf9dfc0e586abc1d7" exitCode=0
Sep 14 10:28:00.696374 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:00.696016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb" event={"ID":"1eaadf24-bafb-4365-929a-5d8c3d4f7b57","Type":"ContainerDied","Data":"dd19356b70acbf655a3125fa7696d19648ee87413734fbacf9dfc0e586abc1d7"}
Sep 14 10:28:01.815529 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:01.815503    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:28:01.964835 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:01.964766    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-bundle\") pod \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") "
Sep 14 10:28:01.964835 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:01.964824    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-util\") pod \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") "
Sep 14 10:28:01.964987 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:01.964851    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24cw4\" (UniqueName: \"kubernetes.io/projected/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-kube-api-access-24cw4\") pod \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\" (UID: \"1eaadf24-bafb-4365-929a-5d8c3d4f7b57\") "
Sep 14 10:28:01.965389 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:01.965359    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-bundle" (OuterVolumeSpecName: "bundle") pod "1eaadf24-bafb-4365-929a-5d8c3d4f7b57" (UID: "1eaadf24-bafb-4365-929a-5d8c3d4f7b57"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:28:01.967009 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:01.966987    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-kube-api-access-24cw4" (OuterVolumeSpecName: "kube-api-access-24cw4") pod "1eaadf24-bafb-4365-929a-5d8c3d4f7b57" (UID: "1eaadf24-bafb-4365-929a-5d8c3d4f7b57"). InnerVolumeSpecName "kube-api-access-24cw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:28:01.969618 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:01.969589    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-util" (OuterVolumeSpecName: "util") pod "1eaadf24-bafb-4365-929a-5d8c3d4f7b57" (UID: "1eaadf24-bafb-4365-929a-5d8c3d4f7b57"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:28:02.065392 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:02.065373    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-util\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:02.065392 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:02.065391    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24cw4\" (UniqueName: \"kubernetes.io/projected/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-kube-api-access-24cw4\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:02.065556 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:02.065401    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eaadf24-bafb-4365-929a-5d8c3d4f7b57-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:02.704224 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:02.704192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb" event={"ID":"1eaadf24-bafb-4365-929a-5d8c3d4f7b57","Type":"ContainerDied","Data":"b08e050adb73390970599bc36493fe73d918236196e6d8678f6b009d489a0d85"}
Sep 14 10:28:02.704419 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:02.704235    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b08e050adb73390970599bc36493fe73d918236196e6d8678f6b009d489a0d85"
Sep 14 10:28:02.704419 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:02.704234    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xkbb"
Sep 14 10:28:10.058524 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.058493    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"]
Sep 14 10:28:10.058964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.058744    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerName="util"
Sep 14 10:28:10.058964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.058754    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerName="util"
Sep 14 10:28:10.058964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.058766    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerName="pull"
Sep 14 10:28:10.058964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.058772    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerName="pull"
Sep 14 10:28:10.058964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.058783    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerName="extract"
Sep 14 10:28:10.058964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.058788    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerName="extract"
Sep 14 10:28:10.058964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.058824    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eaadf24-bafb-4365-929a-5d8c3d4f7b57" containerName="extract"
Sep 14 10:28:10.061077 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.061057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"
Sep 14 10:28:10.064768 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.064749    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 14 10:28:10.065017 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.064998    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6485v\""
Sep 14 10:28:10.068036 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.068021    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:28:10.220278 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.220250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6197fe08-2124-4f76-a634-4c4eb4798c78-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-79nkn\" (UID: \"6197fe08-2124-4f76-a634-4c4eb4798c78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"
Sep 14 10:28:10.220430 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.220304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6dl4\" (UniqueName: \"kubernetes.io/projected/6197fe08-2124-4f76-a634-4c4eb4798c78-kube-api-access-d6dl4\") pod \"cert-manager-operator-controller-manager-55c444bf86-79nkn\" (UID: \"6197fe08-2124-4f76-a634-4c4eb4798c78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"
Sep 14 10:28:10.285352 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.285314    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"]
Sep 14 10:28:10.321707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.321631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6dl4\" (UniqueName: \"kubernetes.io/projected/6197fe08-2124-4f76-a634-4c4eb4798c78-kube-api-access-d6dl4\") pod \"cert-manager-operator-controller-manager-55c444bf86-79nkn\" (UID: \"6197fe08-2124-4f76-a634-4c4eb4798c78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"
Sep 14 10:28:10.321816 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.321703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6197fe08-2124-4f76-a634-4c4eb4798c78-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-79nkn\" (UID: \"6197fe08-2124-4f76-a634-4c4eb4798c78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"
Sep 14 10:28:10.322010 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.321995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6197fe08-2124-4f76-a634-4c4eb4798c78-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-79nkn\" (UID: \"6197fe08-2124-4f76-a634-4c4eb4798c78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"
Sep 14 10:28:10.341689 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.341649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6dl4\" (UniqueName: \"kubernetes.io/projected/6197fe08-2124-4f76-a634-4c4eb4798c78-kube-api-access-d6dl4\") pod \"cert-manager-operator-controller-manager-55c444bf86-79nkn\" (UID: \"6197fe08-2124-4f76-a634-4c4eb4798c78\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"
Sep 14 10:28:10.369423 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.369399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"
Sep 14 10:28:10.675455 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.675425    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn"]
Sep 14 10:28:10.680054 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:28:10.680029    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6197fe08_2124_4f76_a634_4c4eb4798c78.slice/crio-b476ac7cf6931dba2ec791dc27437a629e8b3637f71666e85c88b362996aaa99 WatchSource:0}: Error finding container b476ac7cf6931dba2ec791dc27437a629e8b3637f71666e85c88b362996aaa99: Status 404 returned error can't find the container with id b476ac7cf6931dba2ec791dc27437a629e8b3637f71666e85c88b362996aaa99
Sep 14 10:28:10.729373 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:10.729346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn" event={"ID":"6197fe08-2124-4f76-a634-4c4eb4798c78","Type":"ContainerStarted","Data":"b476ac7cf6931dba2ec791dc27437a629e8b3637f71666e85c88b362996aaa99"}
Sep 14 10:28:12.739494 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:12.739458    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn" event={"ID":"6197fe08-2124-4f76-a634-4c4eb4798c78","Type":"ContainerStarted","Data":"88d71984ec30cb7ac05379773878adade085fc29734a61fd3825a3c1f4608f74"}
Sep 14 10:28:12.808192 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:12.808135    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79nkn" podStartSLOduration=2.538051503 podStartE2EDuration="3.808116782s" totalImagesPullingTime="1.270065279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:28:12.801518956 +0000 UTC m=+190.342920757" watchObservedRunningTime="2026-09-14 10:28:12.808116782 +0000 UTC m=+190.349518587"
Sep 14 10:28:14.142372 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.142337    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"]
Sep 14 10:28:14.145580 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.145563    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.148575 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.148553    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 10:28:14.149712 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.149691    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrtj6\""
Sep 14 10:28:14.149812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.149699    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 10:28:14.178726 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.178691    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"]
Sep 14 10:28:14.250053 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.250017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2x9m\" (UniqueName: \"kubernetes.io/projected/c84b9391-cda1-491f-970c-63c12e726b05-kube-api-access-w2x9m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.250227 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.250061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.250227 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.250117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.351176 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.351146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.351334 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.351188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2x9m\" (UniqueName: \"kubernetes.io/projected/c84b9391-cda1-491f-970c-63c12e726b05-kube-api-access-w2x9m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.351334 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.351312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.351500 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.351484    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.351584 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.351569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.396466 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.396400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2x9m\" (UniqueName: \"kubernetes.io/projected/c84b9391-cda1-491f-970c-63c12e726b05-kube-api-access-w2x9m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.441367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.441345    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2vg6t"]
Sep 14 10:28:14.444277 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.444264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:14.447387 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.447363    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 14 10:28:14.447498 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.447433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 14 10:28:14.453494 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.453476    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:14.553164 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.553129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/718602f6-a46d-494e-a4c2-5dbdc341356b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2vg6t\" (UID: \"718602f6-a46d-494e-a4c2-5dbdc341356b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:14.553301 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.553188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghm2l\" (UniqueName: \"kubernetes.io/projected/718602f6-a46d-494e-a4c2-5dbdc341356b-kube-api-access-ghm2l\") pod \"cert-manager-webhook-6486ffd997-2vg6t\" (UID: \"718602f6-a46d-494e-a4c2-5dbdc341356b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:14.557943 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.557920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2vg6t"]
Sep 14 10:28:14.653935 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.653871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/718602f6-a46d-494e-a4c2-5dbdc341356b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2vg6t\" (UID: \"718602f6-a46d-494e-a4c2-5dbdc341356b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:14.654050 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.653931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghm2l\" (UniqueName: \"kubernetes.io/projected/718602f6-a46d-494e-a4c2-5dbdc341356b-kube-api-access-ghm2l\") pod \"cert-manager-webhook-6486ffd997-2vg6t\" (UID: \"718602f6-a46d-494e-a4c2-5dbdc341356b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:14.673766 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.673737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghm2l\" (UniqueName: \"kubernetes.io/projected/718602f6-a46d-494e-a4c2-5dbdc341356b-kube-api-access-ghm2l\") pod \"cert-manager-webhook-6486ffd997-2vg6t\" (UID: \"718602f6-a46d-494e-a4c2-5dbdc341356b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:14.674744 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.674725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/718602f6-a46d-494e-a4c2-5dbdc341356b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2vg6t\" (UID: \"718602f6-a46d-494e-a4c2-5dbdc341356b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:14.754746 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.754722    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"]
Sep 14 10:28:14.757540 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:28:14.757512    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84b9391_cda1_491f_970c_63c12e726b05.slice/crio-afad7f6d2fdb21dfb6342918a1f4b8f70eecdebbabd5481818ec6c171756d1a3 WatchSource:0}: Error finding container afad7f6d2fdb21dfb6342918a1f4b8f70eecdebbabd5481818ec6c171756d1a3: Status 404 returned error can't find the container with id afad7f6d2fdb21dfb6342918a1f4b8f70eecdebbabd5481818ec6c171756d1a3
Sep 14 10:28:14.768458 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:14.768443    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:15.092174 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:15.092146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2vg6t"]
Sep 14 10:28:15.100914 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:28:15.100890    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod718602f6_a46d_494e_a4c2_5dbdc341356b.slice/crio-8fee780e323c43837cf76b5b0dbb09fb7fe661ded57c63f83f9924ba60b6afdd WatchSource:0}: Error finding container 8fee780e323c43837cf76b5b0dbb09fb7fe661ded57c63f83f9924ba60b6afdd: Status 404 returned error can't find the container with id 8fee780e323c43837cf76b5b0dbb09fb7fe661ded57c63f83f9924ba60b6afdd
Sep 14 10:28:15.753459 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:15.753412    2578 generic.go:356] "Generic (PLEG): container finished" podID="c84b9391-cda1-491f-970c-63c12e726b05" containerID="9e987205133e535b2c2a371f2443c3e49acd401886661d18428cf1f0d7f91f22" exitCode=0
Sep 14 10:28:15.754033 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:15.753502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6" event={"ID":"c84b9391-cda1-491f-970c-63c12e726b05","Type":"ContainerDied","Data":"9e987205133e535b2c2a371f2443c3e49acd401886661d18428cf1f0d7f91f22"}
Sep 14 10:28:15.754033 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:15.753562    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6" event={"ID":"c84b9391-cda1-491f-970c-63c12e726b05","Type":"ContainerStarted","Data":"afad7f6d2fdb21dfb6342918a1f4b8f70eecdebbabd5481818ec6c171756d1a3"}
Sep 14 10:28:15.755107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:15.755077    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t" event={"ID":"718602f6-a46d-494e-a4c2-5dbdc341356b","Type":"ContainerStarted","Data":"8fee780e323c43837cf76b5b0dbb09fb7fe661ded57c63f83f9924ba60b6afdd"}
Sep 14 10:28:18.770366 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:18.770335    2578 generic.go:356] "Generic (PLEG): container finished" podID="c84b9391-cda1-491f-970c-63c12e726b05" containerID="df44bbd6e459862128e982550ebdce721976919a63cda9a2441751f5f863b2d4" exitCode=0
Sep 14 10:28:18.770789 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:18.770416    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6" event={"ID":"c84b9391-cda1-491f-970c-63c12e726b05","Type":"ContainerDied","Data":"df44bbd6e459862128e982550ebdce721976919a63cda9a2441751f5f863b2d4"}
Sep 14 10:28:18.772080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:18.772058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t" event={"ID":"718602f6-a46d-494e-a4c2-5dbdc341356b","Type":"ContainerStarted","Data":"5c905f055eb8f62cf2eb84cbdaf65f2898f8e72a5b929e33458803d190252343"}
Sep 14 10:28:18.772209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:18.772194    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:19.777929 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:19.777899    2578 generic.go:356] "Generic (PLEG): container finished" podID="c84b9391-cda1-491f-970c-63c12e726b05" containerID="1943e29b939959aa8fd87508aaaff5939131a842b9256cfa571bda278201ab62" exitCode=0
Sep 14 10:28:19.778308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:19.777978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6" event={"ID":"c84b9391-cda1-491f-970c-63c12e726b05","Type":"ContainerDied","Data":"1943e29b939959aa8fd87508aaaff5939131a842b9256cfa571bda278201ab62"}
Sep 14 10:28:19.814968 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:19.814918    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t" podStartSLOduration=2.768852347 podStartE2EDuration="5.814900287s" totalImagesPullingTime="3.04604794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:28:18.835593406 +0000 UTC m=+196.376995207" watchObservedRunningTime="2026-09-14 10:28:19.814900287 +0000 UTC m=+197.356302089"
Sep 14 10:28:20.745707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.745666    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"]
Sep 14 10:28:20.749267 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.749247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"
Sep 14 10:28:20.759753 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.759735    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6sr82\""
Sep 14 10:28:20.797382 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.797358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48bb2076-a50a-44af-a4e1-ff7ff7688308-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tbmpb\" (UID: \"48bb2076-a50a-44af-a4e1-ff7ff7688308\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"
Sep 14 10:28:20.797744 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.797393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktx2n\" (UniqueName: \"kubernetes.io/projected/48bb2076-a50a-44af-a4e1-ff7ff7688308-kube-api-access-ktx2n\") pod \"cert-manager-cainjector-559cdd8c87-tbmpb\" (UID: \"48bb2076-a50a-44af-a4e1-ff7ff7688308\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"
Sep 14 10:28:20.799285 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.799265    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"]
Sep 14 10:28:20.897848 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.897823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48bb2076-a50a-44af-a4e1-ff7ff7688308-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tbmpb\" (UID: \"48bb2076-a50a-44af-a4e1-ff7ff7688308\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"
Sep 14 10:28:20.897967 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.897870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktx2n\" (UniqueName: \"kubernetes.io/projected/48bb2076-a50a-44af-a4e1-ff7ff7688308-kube-api-access-ktx2n\") pod \"cert-manager-cainjector-559cdd8c87-tbmpb\" (UID: \"48bb2076-a50a-44af-a4e1-ff7ff7688308\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"
Sep 14 10:28:20.902163 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.902145    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:20.914031 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.913989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48bb2076-a50a-44af-a4e1-ff7ff7688308-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tbmpb\" (UID: \"48bb2076-a50a-44af-a4e1-ff7ff7688308\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"
Sep 14 10:28:20.915105 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:20.915087    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktx2n\" (UniqueName: \"kubernetes.io/projected/48bb2076-a50a-44af-a4e1-ff7ff7688308-kube-api-access-ktx2n\") pod \"cert-manager-cainjector-559cdd8c87-tbmpb\" (UID: \"48bb2076-a50a-44af-a4e1-ff7ff7688308\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"
Sep 14 10:28:21.061235 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.061180    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"
Sep 14 10:28:21.099092 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.099064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-util\") pod \"c84b9391-cda1-491f-970c-63c12e726b05\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") "
Sep 14 10:28:21.099220 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.099157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2x9m\" (UniqueName: \"kubernetes.io/projected/c84b9391-cda1-491f-970c-63c12e726b05-kube-api-access-w2x9m\") pod \"c84b9391-cda1-491f-970c-63c12e726b05\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") "
Sep 14 10:28:21.099220 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.099190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-bundle\") pod \"c84b9391-cda1-491f-970c-63c12e726b05\" (UID: \"c84b9391-cda1-491f-970c-63c12e726b05\") "
Sep 14 10:28:21.099617 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.099585    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-bundle" (OuterVolumeSpecName: "bundle") pod "c84b9391-cda1-491f-970c-63c12e726b05" (UID: "c84b9391-cda1-491f-970c-63c12e726b05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:28:21.101717 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.101693    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c84b9391-cda1-491f-970c-63c12e726b05-kube-api-access-w2x9m" (OuterVolumeSpecName: "kube-api-access-w2x9m") pod "c84b9391-cda1-491f-970c-63c12e726b05" (UID: "c84b9391-cda1-491f-970c-63c12e726b05"). InnerVolumeSpecName "kube-api-access-w2x9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:28:21.103753 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.103731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-util" (OuterVolumeSpecName: "util") pod "c84b9391-cda1-491f-970c-63c12e726b05" (UID: "c84b9391-cda1-491f-970c-63c12e726b05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:28:21.200187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.200164    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-util\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:21.200187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.200187    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2x9m\" (UniqueName: \"kubernetes.io/projected/c84b9391-cda1-491f-970c-63c12e726b05-kube-api-access-w2x9m\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:21.200333 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.200200    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c84b9391-cda1-491f-970c-63c12e726b05-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:21.373864 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.373835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb"]
Sep 14 10:28:21.377653 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:28:21.377620    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48bb2076_a50a_44af_a4e1_ff7ff7688308.slice/crio-994cbc59a29ce0abcdee057e5a5501d2bb75bc113d0d81daf709f4e145c8df0c WatchSource:0}: Error finding container 994cbc59a29ce0abcdee057e5a5501d2bb75bc113d0d81daf709f4e145c8df0c: Status 404 returned error can't find the container with id 994cbc59a29ce0abcdee057e5a5501d2bb75bc113d0d81daf709f4e145c8df0c
Sep 14 10:28:21.787794 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.787708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6" event={"ID":"c84b9391-cda1-491f-970c-63c12e726b05","Type":"ContainerDied","Data":"afad7f6d2fdb21dfb6342918a1f4b8f70eecdebbabd5481818ec6c171756d1a3"}
Sep 14 10:28:21.787794 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.787729    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzg5w6"
Sep 14 10:28:21.787794 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.787761    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afad7f6d2fdb21dfb6342918a1f4b8f70eecdebbabd5481818ec6c171756d1a3"
Sep 14 10:28:21.789379 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.789351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb" event={"ID":"48bb2076-a50a-44af-a4e1-ff7ff7688308","Type":"ContainerStarted","Data":"26b7c7b70174aa0b4d10a19469bcca672b94da02249cc6e05c244fa9836186fd"}
Sep 14 10:28:21.789511 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.789388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb" event={"ID":"48bb2076-a50a-44af-a4e1-ff7ff7688308","Type":"ContainerStarted","Data":"994cbc59a29ce0abcdee057e5a5501d2bb75bc113d0d81daf709f4e145c8df0c"}
Sep 14 10:28:21.827097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:21.827047    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tbmpb" podStartSLOduration=1.826986399 podStartE2EDuration="1.826986399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:28:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:28:21.823838112 +0000 UTC m=+199.365239914" watchObservedRunningTime="2026-09-14 10:28:21.826986399 +0000 UTC m=+199.368388201"
Sep 14 10:28:24.780208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:24.780174    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2vg6t"
Sep 14 10:28:33.110053 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.110021    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"]
Sep 14 10:28:33.110523 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.110272    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84b9391-cda1-491f-970c-63c12e726b05" containerName="pull"
Sep 14 10:28:33.110523 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.110282    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84b9391-cda1-491f-970c-63c12e726b05" containerName="pull"
Sep 14 10:28:33.110523 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.110297    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84b9391-cda1-491f-970c-63c12e726b05" containerName="util"
Sep 14 10:28:33.110523 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.110302    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84b9391-cda1-491f-970c-63c12e726b05" containerName="util"
Sep 14 10:28:33.110523 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.110309    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84b9391-cda1-491f-970c-63c12e726b05" containerName="extract"
Sep 14 10:28:33.110523 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.110313    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84b9391-cda1-491f-970c-63c12e726b05" containerName="extract"
Sep 14 10:28:33.110523 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.110360    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c84b9391-cda1-491f-970c-63c12e726b05" containerName="extract"
Sep 14 10:28:33.161635 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.161611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"]
Sep 14 10:28:33.161801 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.161735    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.164564 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.164538    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 10:28:33.165773 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.165754    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 10:28:33.165878 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.165791    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrtj6\""
Sep 14 10:28:33.179889 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.179868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.179970 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.179894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrh5w\" (UniqueName: \"kubernetes.io/projected/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-kube-api-access-xrh5w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.179970 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.179927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.280319 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.280296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.280411 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.280324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrh5w\" (UniqueName: \"kubernetes.io/projected/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-kube-api-access-xrh5w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.280411 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.280353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.280630 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.280613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.280690 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.280645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.292146 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.292118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrh5w\" (UniqueName: \"kubernetes.io/projected/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-kube-api-access-xrh5w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.471237 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.471146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:33.743984 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.743905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"]
Sep 14 10:28:33.747930 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:28:33.747902    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53cb4d9_06c5_4a7b_bb9a_12c1a5b18d87.slice/crio-3a6c3afa9851e4bf89144c4858eaa91c39220de1645eba7a2d1720d1529f5b38 WatchSource:0}: Error finding container 3a6c3afa9851e4bf89144c4858eaa91c39220de1645eba7a2d1720d1529f5b38: Status 404 returned error can't find the container with id 3a6c3afa9851e4bf89144c4858eaa91c39220de1645eba7a2d1720d1529f5b38
Sep 14 10:28:33.837763 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.837726    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw" event={"ID":"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87","Type":"ContainerStarted","Data":"a08971fb99a046e0e1b70c5ddcafa9fadec97560e905e0a3bbb65d8c4aa2ee3b"}
Sep 14 10:28:33.837952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:33.837784    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw" event={"ID":"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87","Type":"ContainerStarted","Data":"3a6c3afa9851e4bf89144c4858eaa91c39220de1645eba7a2d1720d1529f5b38"}
Sep 14 10:28:34.842930 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:34.842897    2578 generic.go:356] "Generic (PLEG): container finished" podID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerID="a08971fb99a046e0e1b70c5ddcafa9fadec97560e905e0a3bbb65d8c4aa2ee3b" exitCode=0
Sep 14 10:28:34.843307 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:34.842981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw" event={"ID":"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87","Type":"ContainerDied","Data":"a08971fb99a046e0e1b70c5ddcafa9fadec97560e905e0a3bbb65d8c4aa2ee3b"}
Sep 14 10:28:35.848212 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:35.848180    2578 generic.go:356] "Generic (PLEG): container finished" podID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerID="3a5fee270d34adc6a23f27ed36bd0d80fbc0d8b9ed321ab263b1486d7db43ee1" exitCode=0
Sep 14 10:28:35.848561 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:35.848216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw" event={"ID":"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87","Type":"ContainerDied","Data":"3a5fee270d34adc6a23f27ed36bd0d80fbc0d8b9ed321ab263b1486d7db43ee1"}
Sep 14 10:28:36.854093 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:36.854065    2578 generic.go:356] "Generic (PLEG): container finished" podID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerID="7259a60d4e2b6bdb540f29025dae9701d31fecc6a962e3b1931cdeec4dce3d50" exitCode=0
Sep 14 10:28:36.854428 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:36.854130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw" event={"ID":"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87","Type":"ContainerDied","Data":"7259a60d4e2b6bdb540f29025dae9701d31fecc6a962e3b1931cdeec4dce3d50"}
Sep 14 10:28:37.975748 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:37.975726    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:38.017595 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.017574    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-util\") pod \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") "
Sep 14 10:28:38.017745 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.017667    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrh5w\" (UniqueName: \"kubernetes.io/projected/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-kube-api-access-xrh5w\") pod \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") "
Sep 14 10:28:38.017745 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.017712    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-bundle\") pod \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\" (UID: \"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87\") "
Sep 14 10:28:38.018448 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.018421    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-bundle" (OuterVolumeSpecName: "bundle") pod "c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" (UID: "c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:28:38.019856 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.019830    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-kube-api-access-xrh5w" (OuterVolumeSpecName: "kube-api-access-xrh5w") pod "c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" (UID: "c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87"). InnerVolumeSpecName "kube-api-access-xrh5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:28:38.025442 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.025411    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-util" (OuterVolumeSpecName: "util") pod "c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" (UID: "c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:28:38.119171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.119124    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrh5w\" (UniqueName: \"kubernetes.io/projected/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-kube-api-access-xrh5w\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:38.119171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.119145    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:38.119171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.119154    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87-util\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:38.862700 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.862660    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw"
Sep 14 10:28:38.862854 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.862698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af4sztw" event={"ID":"c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87","Type":"ContainerDied","Data":"3a6c3afa9851e4bf89144c4858eaa91c39220de1645eba7a2d1720d1529f5b38"}
Sep 14 10:28:38.862854 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:38.862744    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a6c3afa9851e4bf89144c4858eaa91c39220de1645eba7a2d1720d1529f5b38"
Sep 14 10:28:49.304954 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.304925    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"]
Sep 14 10:28:49.305305 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.305140    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerName="pull"
Sep 14 10:28:49.305305 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.305150    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerName="pull"
Sep 14 10:28:49.305305 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.305157    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerName="extract"
Sep 14 10:28:49.305305 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.305162    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerName="extract"
Sep 14 10:28:49.305305 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.305180    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerName="util"
Sep 14 10:28:49.305305 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.305186    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerName="util"
Sep 14 10:28:49.305305 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.305227    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c53cb4d9-06c5-4a7b-bb9a-12c1a5b18d87" containerName="extract"
Sep 14 10:28:49.310195 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.310175    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.316959 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.316935    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 10:28:49.317172 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.317159    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 10:28:49.318195 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.318180    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrtj6\""
Sep 14 10:28:49.336763 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.336744    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"]
Sep 14 10:28:49.395848 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.395826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjb5w\" (UniqueName: \"kubernetes.io/projected/e8025a64-435d-4051-b061-a5b0a1836cc3-kube-api-access-rjb5w\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.395926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.395882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.395970 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.395954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.496926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.496899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.497066 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.496933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.497066 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.496956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjb5w\" (UniqueName: \"kubernetes.io/projected/e8025a64-435d-4051-b061-a5b0a1836cc3-kube-api-access-rjb5w\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.497269 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.497252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.497307 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.497295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.510818 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.510796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjb5w\" (UniqueName: \"kubernetes.io/projected/e8025a64-435d-4051-b061-a5b0a1836cc3-kube-api-access-rjb5w\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.618443 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.618414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:49.926448 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:49.926380    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"]
Sep 14 10:28:49.929410 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:28:49.929350    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8025a64_435d_4051_b061_a5b0a1836cc3.slice/crio-d03cb476ca8beb5b903fc936908352dba4c5d4c7c8540fe7bdb64e07540ca147 WatchSource:0}: Error finding container d03cb476ca8beb5b903fc936908352dba4c5d4c7c8540fe7bdb64e07540ca147: Status 404 returned error can't find the container with id d03cb476ca8beb5b903fc936908352dba4c5d4c7c8540fe7bdb64e07540ca147
Sep 14 10:28:50.910819 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:50.910787    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerID="5632cf1d10f9ef5c2cd34ff501e69cd05f0d9d2a460d6a65bcb2ae21f2b7e93a" exitCode=0
Sep 14 10:28:50.911298 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:50.910837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz" event={"ID":"e8025a64-435d-4051-b061-a5b0a1836cc3","Type":"ContainerDied","Data":"5632cf1d10f9ef5c2cd34ff501e69cd05f0d9d2a460d6a65bcb2ae21f2b7e93a"}
Sep 14 10:28:50.911298 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:50.910885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz" event={"ID":"e8025a64-435d-4051-b061-a5b0a1836cc3","Type":"ContainerStarted","Data":"d03cb476ca8beb5b903fc936908352dba4c5d4c7c8540fe7bdb64e07540ca147"}
Sep 14 10:28:51.333811 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.333787    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"]
Sep 14 10:28:51.335849 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.335835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.339741 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.339720    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 14 10:28:51.339878 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.339836    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 14 10:28:51.339946 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.339929    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 14 10:28:51.340087 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.340073    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 14 10:28:51.342103 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.341939    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sfzpx\""
Sep 14 10:28:51.368814 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.368784    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"]
Sep 14 10:28:51.411743 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.411699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sc4h\" (UniqueName: \"kubernetes.io/projected/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-kube-api-access-9sc4h\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.411865 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.411755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-manifests\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.411865 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.411819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-tmp\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.411865 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.411842    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-webhook-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.412009 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.411884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.512230 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.512198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-webhook-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.512401 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.512252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.512401 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.512306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sc4h\" (UniqueName: \"kubernetes.io/projected/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-kube-api-access-9sc4h\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.512401 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.512338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-manifests\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.512401 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.512386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-tmp\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.513034 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.513010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-manifests\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.514817 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.514768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-tmp\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.515217 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.515197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-webhook-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.515307 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.515254    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.525904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.525875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sc4h\" (UniqueName: \"kubernetes.io/projected/dc0e9989-341b-497d-9eeb-f5ec9239ecaf-kube-api-access-9sc4h\") pod \"opendatahub-operator-controller-manager-757dcccd8b-svws6\" (UID: \"dc0e9989-341b-497d-9eeb-f5ec9239ecaf\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.645380 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.645353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:51.916396 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.916317    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerID="960810aa8b27e55b0b8cfeb154e31a0a43ed26b94805fbd873f06b23430118ef" exitCode=0
Sep 14 10:28:51.916396 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.916385    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz" event={"ID":"e8025a64-435d-4051-b061-a5b0a1836cc3","Type":"ContainerDied","Data":"960810aa8b27e55b0b8cfeb154e31a0a43ed26b94805fbd873f06b23430118ef"}
Sep 14 10:28:51.946197 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:51.946174    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"]
Sep 14 10:28:51.954047 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:28:51.954024    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0e9989_341b_497d_9eeb_f5ec9239ecaf.slice/crio-bb70ae4f53b1e9718d5092686cdc9ed99313f7e8dad6916912386dd109f6a258 WatchSource:0}: Error finding container bb70ae4f53b1e9718d5092686cdc9ed99313f7e8dad6916912386dd109f6a258: Status 404 returned error can't find the container with id bb70ae4f53b1e9718d5092686cdc9ed99313f7e8dad6916912386dd109f6a258
Sep 14 10:28:52.924922 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:52.924887    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerID="e02a58029dbeebf8e809d8f7e3f7927f7aad5db8ae3f00d190e89addf64802bb" exitCode=0
Sep 14 10:28:52.925306 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:52.924997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz" event={"ID":"e8025a64-435d-4051-b061-a5b0a1836cc3","Type":"ContainerDied","Data":"e02a58029dbeebf8e809d8f7e3f7927f7aad5db8ae3f00d190e89addf64802bb"}
Sep 14 10:28:52.926919 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:52.926889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6" event={"ID":"dc0e9989-341b-497d-9eeb-f5ec9239ecaf","Type":"ContainerStarted","Data":"bb70ae4f53b1e9718d5092686cdc9ed99313f7e8dad6916912386dd109f6a258"}
Sep 14 10:28:54.696915 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.696892    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:54.739614 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.739594    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-util\") pod \"e8025a64-435d-4051-b061-a5b0a1836cc3\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") "
Sep 14 10:28:54.739719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.739659    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjb5w\" (UniqueName: \"kubernetes.io/projected/e8025a64-435d-4051-b061-a5b0a1836cc3-kube-api-access-rjb5w\") pod \"e8025a64-435d-4051-b061-a5b0a1836cc3\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") "
Sep 14 10:28:54.739719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.739705    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-bundle\") pod \"e8025a64-435d-4051-b061-a5b0a1836cc3\" (UID: \"e8025a64-435d-4051-b061-a5b0a1836cc3\") "
Sep 14 10:28:54.740625 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.740596    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-bundle" (OuterVolumeSpecName: "bundle") pod "e8025a64-435d-4051-b061-a5b0a1836cc3" (UID: "e8025a64-435d-4051-b061-a5b0a1836cc3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:28:54.741861 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.741834    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8025a64-435d-4051-b061-a5b0a1836cc3-kube-api-access-rjb5w" (OuterVolumeSpecName: "kube-api-access-rjb5w") pod "e8025a64-435d-4051-b061-a5b0a1836cc3" (UID: "e8025a64-435d-4051-b061-a5b0a1836cc3"). InnerVolumeSpecName "kube-api-access-rjb5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:28:54.745557 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.745420    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-util" (OuterVolumeSpecName: "util") pod "e8025a64-435d-4051-b061-a5b0a1836cc3" (UID: "e8025a64-435d-4051-b061-a5b0a1836cc3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:28:54.840930 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.840908    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-util\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:54.840930 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.840929    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjb5w\" (UniqueName: \"kubernetes.io/projected/e8025a64-435d-4051-b061-a5b0a1836cc3-kube-api-access-rjb5w\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:54.841071 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.840939    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8025a64-435d-4051-b061-a5b0a1836cc3-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:28:54.937915 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.937831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz" event={"ID":"e8025a64-435d-4051-b061-a5b0a1836cc3","Type":"ContainerDied","Data":"d03cb476ca8beb5b903fc936908352dba4c5d4c7c8540fe7bdb64e07540ca147"}
Sep 14 10:28:54.937915 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.937854    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04xcqz"
Sep 14 10:28:54.937915 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.937888    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d03cb476ca8beb5b903fc936908352dba4c5d4c7c8540fe7bdb64e07540ca147"
Sep 14 10:28:54.939505 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:54.939478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6" event={"ID":"dc0e9989-341b-497d-9eeb-f5ec9239ecaf","Type":"ContainerStarted","Data":"b2b5ce5e2974753e5f7e8727668e7c07c2d120e1adca5a62de854632ddcb6361"}
Sep 14 10:28:55.945006 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:55.944975    2578 generic.go:356] "Generic (PLEG): container finished" podID="dc0e9989-341b-497d-9eeb-f5ec9239ecaf" containerID="b2b5ce5e2974753e5f7e8727668e7c07c2d120e1adca5a62de854632ddcb6361" exitCode=0
Sep 14 10:28:55.945349 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:55.945063    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6" event={"ID":"dc0e9989-341b-497d-9eeb-f5ec9239ecaf","Type":"ContainerDied","Data":"b2b5ce5e2974753e5f7e8727668e7c07c2d120e1adca5a62de854632ddcb6361"}
Sep 14 10:28:56.951809 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:56.951770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6" event={"ID":"dc0e9989-341b-497d-9eeb-f5ec9239ecaf","Type":"ContainerStarted","Data":"b48f3bf41df33c81eea1ce6cd42fa8bb9ef085f70144c526ac9e4dd136ba9d3e"}
Sep 14 10:28:56.952204 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:56.951875    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:28:56.979122 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:28:56.979078    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6" podStartSLOduration=1.887144554 podStartE2EDuration="5.979065286s" totalImagesPullingTime="3.066016414s" totalInitContainerRuntime="1.025904318s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:28:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:28:56.977950883 +0000 UTC m=+234.519352685" watchObservedRunningTime="2026-09-14 10:28:56.979065286 +0000 UTC m=+234.520467087"
Sep 14 10:29:07.959410 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:07.959377    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-svws6"
Sep 14 10:29:08.561051 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.561011    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"]
Sep 14 10:29:08.561333 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.561317    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerName="extract"
Sep 14 10:29:08.561416 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.561337    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerName="extract"
Sep 14 10:29:08.561416 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.561353    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerName="util"
Sep 14 10:29:08.561416 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.561361    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerName="util"
Sep 14 10:29:08.561416 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.561396    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerName="pull"
Sep 14 10:29:08.561416 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.561406    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerName="pull"
Sep 14 10:29:08.561644 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.561468    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8025a64-435d-4051-b061-a5b0a1836cc3" containerName="extract"
Sep 14 10:29:08.570986 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.570956    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.575789 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.575767    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 14 10:29:08.576099 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.576075    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 14 10:29:08.576204 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.576170    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 14 10:29:08.576258 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.576171    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 14 10:29:08.576379 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.576360    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:29:08.577574 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.577028    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mhq6q\""
Sep 14 10:29:08.578594 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.578571    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"]
Sep 14 10:29:08.652394 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.652367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47f244df-100b-4787-8c15-4afa23a72440-cert\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.652513 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.652416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwps6\" (UniqueName: \"kubernetes.io/projected/47f244df-100b-4787-8c15-4afa23a72440-kube-api-access-cwps6\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.652513 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.652465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47f244df-100b-4787-8c15-4afa23a72440-manager-config\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.652513 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.652481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47f244df-100b-4787-8c15-4afa23a72440-metrics-cert\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.752898 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.752863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47f244df-100b-4787-8c15-4afa23a72440-manager-config\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.752898 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.752896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47f244df-100b-4787-8c15-4afa23a72440-metrics-cert\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.753054 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.752916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47f244df-100b-4787-8c15-4afa23a72440-cert\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.753054 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.752959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwps6\" (UniqueName: \"kubernetes.io/projected/47f244df-100b-4787-8c15-4afa23a72440-kube-api-access-cwps6\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.753571 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.753552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47f244df-100b-4787-8c15-4afa23a72440-manager-config\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.755400 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.755379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47f244df-100b-4787-8c15-4afa23a72440-metrics-cert\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.755522 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.755501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47f244df-100b-4787-8c15-4afa23a72440-cert\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.766385 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.766367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwps6\" (UniqueName: \"kubernetes.io/projected/47f244df-100b-4787-8c15-4afa23a72440-kube-api-access-cwps6\") pod \"lws-controller-manager-594c4c57b7-s7x5d\" (UID: \"47f244df-100b-4787-8c15-4afa23a72440\") " pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:08.879712 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:08.879660    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:09.155610 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:09.155412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"]
Sep 14 10:29:09.157995 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:29:09.157970    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f244df_100b_4787_8c15_4afa23a72440.slice/crio-a3ca79e6b53a9dcc639604dc7e513029ff2515ce0e6595259de49a05f084c529 WatchSource:0}: Error finding container a3ca79e6b53a9dcc639604dc7e513029ff2515ce0e6595259de49a05f084c529: Status 404 returned error can't find the container with id a3ca79e6b53a9dcc639604dc7e513029ff2515ce0e6595259de49a05f084c529
Sep 14 10:29:10.011481 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:10.011444    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d" event={"ID":"47f244df-100b-4787-8c15-4afa23a72440","Type":"ContainerStarted","Data":"a3ca79e6b53a9dcc639604dc7e513029ff2515ce0e6595259de49a05f084c529"}
Sep 14 10:29:11.017990 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:11.017958    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d" event={"ID":"47f244df-100b-4787-8c15-4afa23a72440","Type":"ContainerStarted","Data":"3e842f0fc935b65ace7233b4f2545c4d49ac2b9ace5bfd3076cf7ad30c1483f9"}
Sep 14 10:29:11.018375 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:11.018106    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:11.064634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:11.064567    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d" podStartSLOduration=1.818503488 podStartE2EDuration="3.064547431s" totalImagesPullingTime="1.246043943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:29:11.062718106 +0000 UTC m=+248.604119903" watchObservedRunningTime="2026-09-14 10:29:11.064547431 +0000 UTC m=+248.605949233"
Sep 14 10:29:22.025154 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:22.025121    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-594c4c57b7-s7x5d"
Sep 14 10:29:29.742458 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.742374    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"]
Sep 14 10:29:29.749356 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.749336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:29.754188 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.754166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 14 10:29:29.755486 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.755128    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 14 10:29:29.755486 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.755317    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 14 10:29:29.755486 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.755346    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dgskx\""
Sep 14 10:29:29.755663 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.755508    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 14 10:29:29.756209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.756196    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 14 10:29:29.756257 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.756224    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 14 10:29:29.777409 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.777369    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"]
Sep 14 10:29:29.910982 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.910944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/337398ff-eb90-4c47-aedc-387a3672b408-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:29.911187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.911005    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/337398ff-eb90-4c47-aedc-387a3672b408-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:29.911187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.911030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/337398ff-eb90-4c47-aedc-387a3672b408-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:29.911187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.911054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/337398ff-eb90-4c47-aedc-387a3672b408-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:29.911187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.911085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/337398ff-eb90-4c47-aedc-387a3672b408-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:29.911187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.911115    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdht7\" (UniqueName: \"kubernetes.io/projected/337398ff-eb90-4c47-aedc-387a3672b408-kube-api-access-mdht7\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:29.911187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:29.911133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/337398ff-eb90-4c47-aedc-387a3672b408-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.012111 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.012032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/337398ff-eb90-4c47-aedc-387a3672b408-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.012111 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.012077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdht7\" (UniqueName: \"kubernetes.io/projected/337398ff-eb90-4c47-aedc-387a3672b408-kube-api-access-mdht7\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.012111 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.012096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/337398ff-eb90-4c47-aedc-387a3672b408-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.012111 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.012115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/337398ff-eb90-4c47-aedc-387a3672b408-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.012423 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.012237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/337398ff-eb90-4c47-aedc-387a3672b408-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.012423 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.012291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/337398ff-eb90-4c47-aedc-387a3672b408-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.012423 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.012344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/337398ff-eb90-4c47-aedc-387a3672b408-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.012759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.012734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/337398ff-eb90-4c47-aedc-387a3672b408-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.014627 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.014607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/337398ff-eb90-4c47-aedc-387a3672b408-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.014731 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.014611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/337398ff-eb90-4c47-aedc-387a3672b408-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.014731 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.014701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/337398ff-eb90-4c47-aedc-387a3672b408-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.014731 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.014700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/337398ff-eb90-4c47-aedc-387a3672b408-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.022489 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.022470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdht7\" (UniqueName: \"kubernetes.io/projected/337398ff-eb90-4c47-aedc-387a3672b408-kube-api-access-mdht7\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.030479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.030458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/337398ff-eb90-4c47-aedc-387a3672b408-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vkhlm\" (UID: \"337398ff-eb90-4c47-aedc-387a3672b408\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.058123 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.058102    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:30.358530 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:30.358498    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"]
Sep 14 10:29:30.361878 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:29:30.361853    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337398ff_eb90_4c47_aedc_387a3672b408.slice/crio-e121c7d15dae4054ea5670f693e9bef5e21591b45ac8dd9378b9e68f95662a8d WatchSource:0}: Error finding container e121c7d15dae4054ea5670f693e9bef5e21591b45ac8dd9378b9e68f95662a8d: Status 404 returned error can't find the container with id e121c7d15dae4054ea5670f693e9bef5e21591b45ac8dd9378b9e68f95662a8d
Sep 14 10:29:31.108066 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:31.108031    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm" event={"ID":"337398ff-eb90-4c47-aedc-387a3672b408","Type":"ContainerStarted","Data":"e121c7d15dae4054ea5670f693e9bef5e21591b45ac8dd9378b9e68f95662a8d"}
Sep 14 10:29:32.375312 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:32.375273    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:29:32.375591 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:32.375341    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:29:33.120956 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:33.120910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm" event={"ID":"337398ff-eb90-4c47-aedc-387a3672b408","Type":"ContainerStarted","Data":"ddbebf62986aa9a35a13232e14f842fe230fb86c1964569b0fd2cf8421ceb9b3"}
Sep 14 10:29:33.121128 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:33.121105    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:29:33.122684 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:33.122643    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-vkhlm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:29:33.122796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:33.122707    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm" podUID="337398ff-eb90-4c47-aedc-387a3672b408" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:29:33.321955 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:33.321902    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm" podStartSLOduration=2.310867212 podStartE2EDuration="4.321885071s" totalImagesPullingTime="2.011017859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:29:33.320277513 +0000 UTC m=+270.861679313" watchObservedRunningTime="2026-09-14 10:29:33.321885071 +0000 UTC m=+270.863286871"
Sep 14 10:29:34.126159 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:29:34.126133    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkhlm"
Sep 14 10:30:02.848463 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:02.848436    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 14 10:30:27.318616 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.318587    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"]
Sep 14 10:30:27.321680 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.321655    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.324688 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.324651    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 10:30:27.324807 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.324705    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 10:30:27.324872 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.324812    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrtj6\""
Sep 14 10:30:27.330920 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.330900    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"]
Sep 14 10:30:27.420575 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.420548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms64f\" (UniqueName: \"kubernetes.io/projected/dd235fd5-5741-403b-b82b-2e64bfe8850d-kube-api-access-ms64f\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.420719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.420662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.420801 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.420783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.422249 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.422231    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"]
Sep 14 10:30:27.425220 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.425207    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.434105 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.434083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"]
Sep 14 10:30:27.517065 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.517035    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"]
Sep 14 10:30:27.520132 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.520113    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.521118 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.521099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9g7v\" (UniqueName: \"kubernetes.io/projected/f9bdd04c-ea95-4c1c-856d-39acb7b99893-kube-api-access-s9g7v\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.521194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.521132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.521194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.521158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.521296 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.521196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.521354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.521311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms64f\" (UniqueName: \"kubernetes.io/projected/dd235fd5-5741-403b-b82b-2e64bfe8850d-kube-api-access-ms64f\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.521354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.521344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.521541 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.521524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.521600 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.521569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.528385 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.528354    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"]
Sep 14 10:30:27.531150 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.531131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms64f\" (UniqueName: \"kubernetes.io/projected/dd235fd5-5741-403b-b82b-2e64bfe8850d-kube-api-access-ms64f\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.619069 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.619034    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"]
Sep 14 10:30:27.624834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.624809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.624945 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.624846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.624945 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.624865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.625048 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.624938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.625048 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.625027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9g7v\" (UniqueName: \"kubernetes.io/projected/f9bdd04c-ea95-4c1c-856d-39acb7b99893-kube-api-access-s9g7v\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.625121 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.625068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k8ck\" (UniqueName: \"kubernetes.io/projected/9518a1f6-0756-40e3-91a2-6fbf775548db-kube-api-access-7k8ck\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.625208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.625190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.625254 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.625222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.627245 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.627228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.630841 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.630823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:27.631542 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.631523    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"]
Sep 14 10:30:27.634764 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.634736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9g7v\" (UniqueName: \"kubernetes.io/projected/f9bdd04c-ea95-4c1c-856d-39acb7b99893-kube-api-access-s9g7v\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.725690 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.725650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jzt\" (UniqueName: \"kubernetes.io/projected/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-kube-api-access-r2jzt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.725831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.725708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.725831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.725782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.725831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.725815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.725971 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.725910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k8ck\" (UniqueName: \"kubernetes.io/projected/9518a1f6-0756-40e3-91a2-6fbf775548db-kube-api-access-7k8ck\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.725971 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.725935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.726095 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.726076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.726183 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.726168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.733280 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.733255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:27.734339 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.734311    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k8ck\" (UniqueName: \"kubernetes.io/projected/9518a1f6-0756-40e3-91a2-6fbf775548db-kube-api-access-7k8ck\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.827223 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.827182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jzt\" (UniqueName: \"kubernetes.io/projected/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-kube-api-access-r2jzt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.827366 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.827250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.827366 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.827277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.827633 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.827611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.827633 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.827626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.829142 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.829124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:27.837380 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.837353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jzt\" (UniqueName: \"kubernetes.io/projected/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-kube-api-access-r2jzt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:27.908167 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.908101    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"]
Sep 14 10:30:27.910209 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:30:27.910175    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd235fd5_5741_403b_b82b_2e64bfe8850d.slice/crio-1c78840a4e47127dd32ba6d92a9e806f23c01eccfefc8169bc6802632e401add WatchSource:0}: Error finding container 1c78840a4e47127dd32ba6d92a9e806f23c01eccfefc8169bc6802632e401add: Status 404 returned error can't find the container with id 1c78840a4e47127dd32ba6d92a9e806f23c01eccfefc8169bc6802632e401add
Sep 14 10:30:27.951715 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:27.951691    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:28.015354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.015289    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"]
Sep 14 10:30:28.019126 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:30:28.019102    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bdd04c_ea95_4c1c_856d_39acb7b99893.slice/crio-dbf9b8b0aa99615f87dc53a851b94abffd54fc7907dfe922763bfea15a6a34a0 WatchSource:0}: Error finding container dbf9b8b0aa99615f87dc53a851b94abffd54fc7907dfe922763bfea15a6a34a0: Status 404 returned error can't find the container with id dbf9b8b0aa99615f87dc53a851b94abffd54fc7907dfe922763bfea15a6a34a0
Sep 14 10:30:28.100065 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.099962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"]
Sep 14 10:30:28.102230 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:30:28.102207    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9518a1f6_0756_40e3_91a2_6fbf775548db.slice/crio-d9cf29005a40eff1ae76efdc08ee32d85ada6696f747eb17becd27e2686814d3 WatchSource:0}: Error finding container d9cf29005a40eff1ae76efdc08ee32d85ada6696f747eb17becd27e2686814d3: Status 404 returned error can't find the container with id d9cf29005a40eff1ae76efdc08ee32d85ada6696f747eb17becd27e2686814d3
Sep 14 10:30:28.227541 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.227518    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"]
Sep 14 10:30:28.251432 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:30:28.251408    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ae82ef_5ffe_4ca3_bf75_c38eba16e517.slice/crio-0e87a48c5cf3b3964f915d825b638020fd3b731f0d4232de071056861e2c2fa6 WatchSource:0}: Error finding container 0e87a48c5cf3b3964f915d825b638020fd3b731f0d4232de071056861e2c2fa6: Status 404 returned error can't find the container with id 0e87a48c5cf3b3964f915d825b638020fd3b731f0d4232de071056861e2c2fa6
Sep 14 10:30:28.361562 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.361538    2578 generic.go:356] "Generic (PLEG): container finished" podID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerID="0cfd8299a2d58fc6564c6fe8566ca70f8f31a3ae9433239aa2c0d165916ae39d" exitCode=0
Sep 14 10:30:28.361919 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.361614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5" event={"ID":"f9bdd04c-ea95-4c1c-856d-39acb7b99893","Type":"ContainerDied","Data":"0cfd8299a2d58fc6564c6fe8566ca70f8f31a3ae9433239aa2c0d165916ae39d"}
Sep 14 10:30:28.361919 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.361696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5" event={"ID":"f9bdd04c-ea95-4c1c-856d-39acb7b99893","Type":"ContainerStarted","Data":"dbf9b8b0aa99615f87dc53a851b94abffd54fc7907dfe922763bfea15a6a34a0"}
Sep 14 10:30:28.362686 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.362649    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:30:28.363271 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.363252    2578 generic.go:356] "Generic (PLEG): container finished" podID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerID="2913418e544fe49713dc55a6e07162b215acee0375b474095cf94c563ef5f008" exitCode=0
Sep 14 10:30:28.363349 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.363311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn" event={"ID":"dd235fd5-5741-403b-b82b-2e64bfe8850d","Type":"ContainerDied","Data":"2913418e544fe49713dc55a6e07162b215acee0375b474095cf94c563ef5f008"}
Sep 14 10:30:28.363401 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.363357    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn" event={"ID":"dd235fd5-5741-403b-b82b-2e64bfe8850d","Type":"ContainerStarted","Data":"1c78840a4e47127dd32ba6d92a9e806f23c01eccfefc8169bc6802632e401add"}
Sep 14 10:30:28.364889 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.364868    2578 generic.go:356] "Generic (PLEG): container finished" podID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerID="7064848179f5189aced04466046aa9142af8c72296ecfdf588900f9beaf33d2c" exitCode=0
Sep 14 10:30:28.364970 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.364901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj" event={"ID":"78ae82ef-5ffe-4ca3-bf75-c38eba16e517","Type":"ContainerDied","Data":"7064848179f5189aced04466046aa9142af8c72296ecfdf588900f9beaf33d2c"}
Sep 14 10:30:28.364970 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.364936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj" event={"ID":"78ae82ef-5ffe-4ca3-bf75-c38eba16e517","Type":"ContainerStarted","Data":"0e87a48c5cf3b3964f915d825b638020fd3b731f0d4232de071056861e2c2fa6"}
Sep 14 10:30:28.366838 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.366805    2578 generic.go:356] "Generic (PLEG): container finished" podID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerID="8a8b99cb2aa426deff31f558a7873131287a33ebf8df03f93807c76ba8648bbd" exitCode=0
Sep 14 10:30:28.366999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.366843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w" event={"ID":"9518a1f6-0756-40e3-91a2-6fbf775548db","Type":"ContainerDied","Data":"8a8b99cb2aa426deff31f558a7873131287a33ebf8df03f93807c76ba8648bbd"}
Sep 14 10:30:28.366999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:28.366872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w" event={"ID":"9518a1f6-0756-40e3-91a2-6fbf775548db","Type":"ContainerStarted","Data":"d9cf29005a40eff1ae76efdc08ee32d85ada6696f747eb17becd27e2686814d3"}
Sep 14 10:30:29.374531 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:29.374499    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn" event={"ID":"dd235fd5-5741-403b-b82b-2e64bfe8850d","Type":"ContainerStarted","Data":"f5d17c23aef156eccac76947a0f865eac805a370e215236f3615b3ec1f8c0ee4"}
Sep 14 10:30:29.376754 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:29.376727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5" event={"ID":"f9bdd04c-ea95-4c1c-856d-39acb7b99893","Type":"ContainerStarted","Data":"fedd762b024c672e8e507b0a67f4d74b7f0eeeb42cdf474a2244890cdc9a1047"}
Sep 14 10:30:30.382434 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:30.382404    2578 generic.go:356] "Generic (PLEG): container finished" podID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerID="fedd762b024c672e8e507b0a67f4d74b7f0eeeb42cdf474a2244890cdc9a1047" exitCode=0
Sep 14 10:30:30.382854 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:30.382441    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5" event={"ID":"f9bdd04c-ea95-4c1c-856d-39acb7b99893","Type":"ContainerDied","Data":"fedd762b024c672e8e507b0a67f4d74b7f0eeeb42cdf474a2244890cdc9a1047"}
Sep 14 10:30:30.384539 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:30.384513    2578 generic.go:356] "Generic (PLEG): container finished" podID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerID="f5d17c23aef156eccac76947a0f865eac805a370e215236f3615b3ec1f8c0ee4" exitCode=0
Sep 14 10:30:30.384618 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:30.384546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn" event={"ID":"dd235fd5-5741-403b-b82b-2e64bfe8850d","Type":"ContainerDied","Data":"f5d17c23aef156eccac76947a0f865eac805a370e215236f3615b3ec1f8c0ee4"}
Sep 14 10:30:30.386427 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:30.386401    2578 generic.go:356] "Generic (PLEG): container finished" podID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerID="9cf69e7a3ed0ab7fe8d5efc9a0fef23e70c3c66958c0ee3b6237b64416f9608e" exitCode=0
Sep 14 10:30:30.386512 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:30.386450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj" event={"ID":"78ae82ef-5ffe-4ca3-bf75-c38eba16e517","Type":"ContainerDied","Data":"9cf69e7a3ed0ab7fe8d5efc9a0fef23e70c3c66958c0ee3b6237b64416f9608e"}
Sep 14 10:30:31.393488 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:31.393457    2578 generic.go:356] "Generic (PLEG): container finished" podID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerID="209aaf7703172a2ab6ca4f689b6f8002db897d5068269c73bf2b0e7bc2e6815d" exitCode=0
Sep 14 10:30:31.393865 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:31.393546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5" event={"ID":"f9bdd04c-ea95-4c1c-856d-39acb7b99893","Type":"ContainerDied","Data":"209aaf7703172a2ab6ca4f689b6f8002db897d5068269c73bf2b0e7bc2e6815d"}
Sep 14 10:30:31.395517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:31.395490    2578 generic.go:356] "Generic (PLEG): container finished" podID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerID="10e425e0cd3b6fba109ead0c5e3ecfabb89d2f5d0eff6b1bd92048cd57feddb8" exitCode=0
Sep 14 10:30:31.395640 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:31.395567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn" event={"ID":"dd235fd5-5741-403b-b82b-2e64bfe8850d","Type":"ContainerDied","Data":"10e425e0cd3b6fba109ead0c5e3ecfabb89d2f5d0eff6b1bd92048cd57feddb8"}
Sep 14 10:30:31.397510 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:31.397490    2578 generic.go:356] "Generic (PLEG): container finished" podID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerID="542e0bfe865f39ab1be805380c68eeb6aed0c8a71e2f8bc9f4982b216b3d938a" exitCode=0
Sep 14 10:30:31.397594 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:31.397533    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj" event={"ID":"78ae82ef-5ffe-4ca3-bf75-c38eba16e517","Type":"ContainerDied","Data":"542e0bfe865f39ab1be805380c68eeb6aed0c8a71e2f8bc9f4982b216b3d938a"}
Sep 14 10:30:32.545546 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.545524    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:32.567370 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.567349    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:32.570011 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.569977    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:32.662139 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2jzt\" (UniqueName: \"kubernetes.io/projected/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-kube-api-access-r2jzt\") pod \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") "
Sep 14 10:30:32.662139 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662137    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9g7v\" (UniqueName: \"kubernetes.io/projected/f9bdd04c-ea95-4c1c-856d-39acb7b99893-kube-api-access-s9g7v\") pod \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") "
Sep 14 10:30:32.662322 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-util\") pod \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") "
Sep 14 10:30:32.662322 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662186    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-bundle\") pod \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") "
Sep 14 10:30:32.662322 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-bundle\") pod \"dd235fd5-5741-403b-b82b-2e64bfe8850d\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") "
Sep 14 10:30:32.662322 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662227    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-util\") pod \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\" (UID: \"78ae82ef-5ffe-4ca3-bf75-c38eba16e517\") "
Sep 14 10:30:32.662322 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662248    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-util\") pod \"dd235fd5-5741-403b-b82b-2e64bfe8850d\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") "
Sep 14 10:30:32.662322 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662287    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms64f\" (UniqueName: \"kubernetes.io/projected/dd235fd5-5741-403b-b82b-2e64bfe8850d-kube-api-access-ms64f\") pod \"dd235fd5-5741-403b-b82b-2e64bfe8850d\" (UID: \"dd235fd5-5741-403b-b82b-2e64bfe8850d\") "
Sep 14 10:30:32.662322 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662311    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-bundle\") pod \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\" (UID: \"f9bdd04c-ea95-4c1c-856d-39acb7b99893\") "
Sep 14 10:30:32.663031 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.662976    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-bundle" (OuterVolumeSpecName: "bundle") pod "f9bdd04c-ea95-4c1c-856d-39acb7b99893" (UID: "f9bdd04c-ea95-4c1c-856d-39acb7b99893"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:30:32.663137 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.663111    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-bundle" (OuterVolumeSpecName: "bundle") pod "78ae82ef-5ffe-4ca3-bf75-c38eba16e517" (UID: "78ae82ef-5ffe-4ca3-bf75-c38eba16e517"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:30:32.663484 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.663455    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-bundle" (OuterVolumeSpecName: "bundle") pod "dd235fd5-5741-403b-b82b-2e64bfe8850d" (UID: "dd235fd5-5741-403b-b82b-2e64bfe8850d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:30:32.664643 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.664624    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9bdd04c-ea95-4c1c-856d-39acb7b99893-kube-api-access-s9g7v" (OuterVolumeSpecName: "kube-api-access-s9g7v") pod "f9bdd04c-ea95-4c1c-856d-39acb7b99893" (UID: "f9bdd04c-ea95-4c1c-856d-39acb7b99893"). InnerVolumeSpecName "kube-api-access-s9g7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:30:32.664988 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.664832    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-kube-api-access-r2jzt" (OuterVolumeSpecName: "kube-api-access-r2jzt") pod "78ae82ef-5ffe-4ca3-bf75-c38eba16e517" (UID: "78ae82ef-5ffe-4ca3-bf75-c38eba16e517"). InnerVolumeSpecName "kube-api-access-r2jzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:30:32.665425 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.665394    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd235fd5-5741-403b-b82b-2e64bfe8850d-kube-api-access-ms64f" (OuterVolumeSpecName: "kube-api-access-ms64f") pod "dd235fd5-5741-403b-b82b-2e64bfe8850d" (UID: "dd235fd5-5741-403b-b82b-2e64bfe8850d"). InnerVolumeSpecName "kube-api-access-ms64f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:30:32.668608 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.668571    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-util" (OuterVolumeSpecName: "util") pod "dd235fd5-5741-403b-b82b-2e64bfe8850d" (UID: "dd235fd5-5741-403b-b82b-2e64bfe8850d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:30:32.668608 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.668578    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-util" (OuterVolumeSpecName: "util") pod "f9bdd04c-ea95-4c1c-856d-39acb7b99893" (UID: "f9bdd04c-ea95-4c1c-856d-39acb7b99893"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:30:32.668969 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.668948    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-util" (OuterVolumeSpecName: "util") pod "78ae82ef-5ffe-4ca3-bf75-c38eba16e517" (UID: "78ae82ef-5ffe-4ca3-bf75-c38eba16e517"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:30:32.763431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.763412    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-util\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:32.763431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.763431    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-util\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:32.763543 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.763439    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms64f\" (UniqueName: \"kubernetes.io/projected/dd235fd5-5741-403b-b82b-2e64bfe8850d-kube-api-access-ms64f\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:32.763543 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.763448    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:32.763543 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.763456    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2jzt\" (UniqueName: \"kubernetes.io/projected/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-kube-api-access-r2jzt\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:32.763543 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.763464    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9g7v\" (UniqueName: \"kubernetes.io/projected/f9bdd04c-ea95-4c1c-856d-39acb7b99893-kube-api-access-s9g7v\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:32.763543 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.763472    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9bdd04c-ea95-4c1c-856d-39acb7b99893-util\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:32.763543 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.763479    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78ae82ef-5ffe-4ca3-bf75-c38eba16e517-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:32.763543 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:32.763486    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd235fd5-5741-403b-b82b-2e64bfe8850d-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:33.407907 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:33.407878    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj"
Sep 14 10:30:33.407907 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:33.407887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcpxj" event={"ID":"78ae82ef-5ffe-4ca3-bf75-c38eba16e517","Type":"ContainerDied","Data":"0e87a48c5cf3b3964f915d825b638020fd3b731f0d4232de071056861e2c2fa6"}
Sep 14 10:30:33.408135 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:33.407923    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e87a48c5cf3b3964f915d825b638020fd3b731f0d4232de071056861e2c2fa6"
Sep 14 10:30:33.409918 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:33.409895    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5"
Sep 14 10:30:33.409918 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:33.409903    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nqph5" event={"ID":"f9bdd04c-ea95-4c1c-856d-39acb7b99893","Type":"ContainerDied","Data":"dbf9b8b0aa99615f87dc53a851b94abffd54fc7907dfe922763bfea15a6a34a0"}
Sep 14 10:30:33.410084 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:33.409941    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbf9b8b0aa99615f87dc53a851b94abffd54fc7907dfe922763bfea15a6a34a0"
Sep 14 10:30:33.412102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:33.412078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn" event={"ID":"dd235fd5-5741-403b-b82b-2e64bfe8850d","Type":"ContainerDied","Data":"1c78840a4e47127dd32ba6d92a9e806f23c01eccfefc8169bc6802632e401add"}
Sep 14 10:30:33.412102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:33.412095    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68rsxn"
Sep 14 10:30:33.412231 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:33.412114    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c78840a4e47127dd32ba6d92a9e806f23c01eccfefc8169bc6802632e401add"
Sep 14 10:30:43.457207 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:43.457176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w" event={"ID":"9518a1f6-0756-40e3-91a2-6fbf775548db","Type":"ContainerStarted","Data":"6812827969d3c88700bb43bfa3ed9e2c4d46df341d80742db23e045f19c1ded5"}
Sep 14 10:30:44.463892 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:44.463860    2578 generic.go:356] "Generic (PLEG): container finished" podID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerID="6812827969d3c88700bb43bfa3ed9e2c4d46df341d80742db23e045f19c1ded5" exitCode=0
Sep 14 10:30:44.464267 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:44.463935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w" event={"ID":"9518a1f6-0756-40e3-91a2-6fbf775548db","Type":"ContainerDied","Data":"6812827969d3c88700bb43bfa3ed9e2c4d46df341d80742db23e045f19c1ded5"}
Sep 14 10:30:45.470219 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:45.470189    2578 generic.go:356] "Generic (PLEG): container finished" podID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerID="9afcf6fe2edd35b7d518adb8d82847ee22fc8242b455d784dfb37fb14b580a18" exitCode=0
Sep 14 10:30:45.470575 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:45.470272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w" event={"ID":"9518a1f6-0756-40e3-91a2-6fbf775548db","Type":"ContainerDied","Data":"9afcf6fe2edd35b7d518adb8d82847ee22fc8242b455d784dfb37fb14b580a18"}
Sep 14 10:30:46.601501 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.601478    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:30:46.665627 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.665601    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-util\") pod \"9518a1f6-0756-40e3-91a2-6fbf775548db\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") "
Sep 14 10:30:46.665769 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.665657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k8ck\" (UniqueName: \"kubernetes.io/projected/9518a1f6-0756-40e3-91a2-6fbf775548db-kube-api-access-7k8ck\") pod \"9518a1f6-0756-40e3-91a2-6fbf775548db\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") "
Sep 14 10:30:46.665769 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.665707    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-bundle\") pod \"9518a1f6-0756-40e3-91a2-6fbf775548db\" (UID: \"9518a1f6-0756-40e3-91a2-6fbf775548db\") "
Sep 14 10:30:46.666249 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.666223    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-bundle" (OuterVolumeSpecName: "bundle") pod "9518a1f6-0756-40e3-91a2-6fbf775548db" (UID: "9518a1f6-0756-40e3-91a2-6fbf775548db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:30:46.667830 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.667808    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9518a1f6-0756-40e3-91a2-6fbf775548db-kube-api-access-7k8ck" (OuterVolumeSpecName: "kube-api-access-7k8ck") pod "9518a1f6-0756-40e3-91a2-6fbf775548db" (UID: "9518a1f6-0756-40e3-91a2-6fbf775548db"). InnerVolumeSpecName "kube-api-access-7k8ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:30:46.669717 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.669697    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-util" (OuterVolumeSpecName: "util") pod "9518a1f6-0756-40e3-91a2-6fbf775548db" (UID: "9518a1f6-0756-40e3-91a2-6fbf775548db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:30:46.766711 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.766620    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-util\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:46.766711 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.766644    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k8ck\" (UniqueName: \"kubernetes.io/projected/9518a1f6-0756-40e3-91a2-6fbf775548db-kube-api-access-7k8ck\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:46.766711 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:46.766653    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9518a1f6-0756-40e3-91a2-6fbf775548db-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:30:47.487116 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:47.487080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w" event={"ID":"9518a1f6-0756-40e3-91a2-6fbf775548db","Type":"ContainerDied","Data":"d9cf29005a40eff1ae76efdc08ee32d85ada6696f747eb17becd27e2686814d3"}
Sep 14 10:30:47.487278 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:47.487129    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9cf29005a40eff1ae76efdc08ee32d85ada6696f747eb17becd27e2686814d3"
Sep 14 10:30:47.487278 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:30:47.487129    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cq6s8w"
Sep 14 10:31:08.075501 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075469    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"]
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075755    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerName="extract"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075771    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerName="extract"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075782    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerName="util"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075787    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerName="util"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075793    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerName="pull"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075797    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerName="pull"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075804    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerName="extract"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075810    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerName="extract"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075816    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerName="pull"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075822    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerName="pull"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075828    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerName="pull"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075835    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerName="pull"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075850    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerName="extract"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075856    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerName="extract"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075862    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerName="util"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075866    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerName="util"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075872    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerName="util"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075877    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerName="util"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075884    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerName="util"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075888    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerName="util"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075894    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerName="pull"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075899    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerName="pull"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075905    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerName="extract"
Sep 14 10:31:08.075926 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075909    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerName="extract"
Sep 14 10:31:08.076584 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075955    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="78ae82ef-5ffe-4ca3-bf75-c38eba16e517" containerName="extract"
Sep 14 10:31:08.076584 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075961    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9518a1f6-0756-40e3-91a2-6fbf775548db" containerName="extract"
Sep 14 10:31:08.076584 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075967    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9bdd04c-ea95-4c1c-856d-39acb7b99893" containerName="extract"
Sep 14 10:31:08.076584 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.075972    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd235fd5-5741-403b-b82b-2e64bfe8850d" containerName="extract"
Sep 14 10:31:08.080120 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.080103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:08.083055 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.083038    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hkbhn\""
Sep 14 10:31:08.083298 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.083281    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 14 10:31:08.084272 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.084258    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 14 10:31:08.090098 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.090075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"]
Sep 14 10:31:08.227499 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.227471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d55p\" (UniqueName: \"kubernetes.io/projected/7573cdae-b4fd-4324-bb46-efb60393a418-kube-api-access-5d55p\") pod \"limitador-operator-controller-manager-74495c69f8-l6kbc\" (UID: \"7573cdae-b4fd-4324-bb46-efb60393a418\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:08.328498 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.328443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d55p\" (UniqueName: \"kubernetes.io/projected/7573cdae-b4fd-4324-bb46-efb60393a418-kube-api-access-5d55p\") pod \"limitador-operator-controller-manager-74495c69f8-l6kbc\" (UID: \"7573cdae-b4fd-4324-bb46-efb60393a418\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:08.338766 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.338747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d55p\" (UniqueName: \"kubernetes.io/projected/7573cdae-b4fd-4324-bb46-efb60393a418-kube-api-access-5d55p\") pod \"limitador-operator-controller-manager-74495c69f8-l6kbc\" (UID: \"7573cdae-b4fd-4324-bb46-efb60393a418\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:08.389482 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.389465    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:08.660636 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:08.660614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"]
Sep 14 10:31:08.662280 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:31:08.662259    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7573cdae_b4fd_4324_bb46_efb60393a418.slice/crio-f103c7fcd2298a2d497a016d89cc18c13afed48e7f37787185de24d886df25bf WatchSource:0}: Error finding container f103c7fcd2298a2d497a016d89cc18c13afed48e7f37787185de24d886df25bf: Status 404 returned error can't find the container with id f103c7fcd2298a2d497a016d89cc18c13afed48e7f37787185de24d886df25bf
Sep 14 10:31:09.587475 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:09.587435    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc" event={"ID":"7573cdae-b4fd-4324-bb46-efb60393a418","Type":"ContainerStarted","Data":"f103c7fcd2298a2d497a016d89cc18c13afed48e7f37787185de24d886df25bf"}
Sep 14 10:31:11.598516 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:11.598481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc" event={"ID":"7573cdae-b4fd-4324-bb46-efb60393a418","Type":"ContainerStarted","Data":"3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552"}
Sep 14 10:31:11.598937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:11.598602    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:11.615128 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:11.615082    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc" podStartSLOduration=1.371588579 podStartE2EDuration="3.615066309s" totalImagesPullingTime="2.24347773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:11.614409387 +0000 UTC m=+369.155811189" watchObservedRunningTime="2026-09-14 10:31:11.615066309 +0000 UTC m=+369.156468101"
Sep 14 10:31:11.925208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:11.925127    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ffc649769-2f4gc"]
Sep 14 10:31:17.329561 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.329530    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"]
Sep 14 10:31:17.330041 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.329750    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" containerName="manager" containerID="cri-o://3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552" gracePeriod=2
Sep 14 10:31:17.332172 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.332137    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:17.338697 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.338654    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"]
Sep 14 10:31:17.351037 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:31:17.351008    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-l6kbc\" is forbidden: User \"system:node:ip-10-0-135-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-139.ec2.internal' and this object" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:17.393103 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.393072    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"]
Sep 14 10:31:17.393380 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.393359    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" containerName="manager"
Sep 14 10:31:17.393433 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.393382    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" containerName="manager"
Sep 14 10:31:17.393466 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.393459    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" containerName="manager"
Sep 14 10:31:17.400308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.400281    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"
Sep 14 10:31:17.402898 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:31:17.402866    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-l6kbc\" is forbidden: User \"system:node:ip-10-0-135-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-139.ec2.internal' and this object" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:17.422134 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.422113    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"]
Sep 14 10:31:17.492123 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.492093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbgfv\" (UniqueName: \"kubernetes.io/projected/906d74f1-d207-4362-b1ea-36d734133363-kube-api-access-dbgfv\") pod \"limitador-operator-controller-manager-74495c69f8-f2htw\" (UID: \"906d74f1-d207-4362-b1ea-36d734133363\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"
Sep 14 10:31:17.568354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.568332    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:17.571115 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:31:17.571078    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-l6kbc\" is forbidden: User \"system:node:ip-10-0-135-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-139.ec2.internal' and this object" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:17.592761 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.592741    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d55p\" (UniqueName: \"kubernetes.io/projected/7573cdae-b4fd-4324-bb46-efb60393a418-kube-api-access-5d55p\") pod \"7573cdae-b4fd-4324-bb46-efb60393a418\" (UID: \"7573cdae-b4fd-4324-bb46-efb60393a418\") "
Sep 14 10:31:17.592872 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.592843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbgfv\" (UniqueName: \"kubernetes.io/projected/906d74f1-d207-4362-b1ea-36d734133363-kube-api-access-dbgfv\") pod \"limitador-operator-controller-manager-74495c69f8-f2htw\" (UID: \"906d74f1-d207-4362-b1ea-36d734133363\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"
Sep 14 10:31:17.594820 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.594798    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7573cdae-b4fd-4324-bb46-efb60393a418-kube-api-access-5d55p" (OuterVolumeSpecName: "kube-api-access-5d55p") pod "7573cdae-b4fd-4324-bb46-efb60393a418" (UID: "7573cdae-b4fd-4324-bb46-efb60393a418"). InnerVolumeSpecName "kube-api-access-5d55p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:31:17.602191 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.602169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbgfv\" (UniqueName: \"kubernetes.io/projected/906d74f1-d207-4362-b1ea-36d734133363-kube-api-access-dbgfv\") pod \"limitador-operator-controller-manager-74495c69f8-f2htw\" (UID: \"906d74f1-d207-4362-b1ea-36d734133363\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"
Sep 14 10:31:17.626933 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.626903    2578 generic.go:356] "Generic (PLEG): container finished" podID="7573cdae-b4fd-4324-bb46-efb60393a418" containerID="3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552" exitCode=0
Sep 14 10:31:17.627021 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.626941    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:17.627021 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.626974    2578 scope.go:117] "RemoveContainer" containerID="3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552"
Sep 14 10:31:17.629805 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:31:17.629781    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-l6kbc\" is forbidden: User \"system:node:ip-10-0-135-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-139.ec2.internal' and this object" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:17.634873 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.634854    2578 scope.go:117] "RemoveContainer" containerID="3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552"
Sep 14 10:31:17.635122 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:31:17.635102    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552\": container with ID starting with 3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552 not found: ID does not exist" containerID="3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552"
Sep 14 10:31:17.635187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.635133    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552"} err="failed to get container status \"3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552\": rpc error: code = NotFound desc = could not find container \"3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552\": container with ID starting with 3787a352ae8979888ecbdb6a04dfa756b680fa1edd9f06938bde840eba8bd552 not found: ID does not exist"
Sep 14 10:31:17.637386 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:31:17.637357    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-l6kbc\" is forbidden: User \"system:node:ip-10-0-135-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-139.ec2.internal' and this object" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:17.693359 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.693328    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d55p\" (UniqueName: \"kubernetes.io/projected/7573cdae-b4fd-4324-bb46-efb60393a418-kube-api-access-5d55p\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:31:17.710317 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:17.710295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"
Sep 14 10:31:18.002076 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:31:18.002052    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906d74f1_d207_4362_b1ea_36d734133363.slice/crio-523129a7334a35b97b1911084d402fc52773c50666bb76a80b26a1c58e991e23 WatchSource:0}: Error finding container 523129a7334a35b97b1911084d402fc52773c50666bb76a80b26a1c58e991e23: Status 404 returned error can't find the container with id 523129a7334a35b97b1911084d402fc52773c50666bb76a80b26a1c58e991e23
Sep 14 10:31:18.007438 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:18.007414    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"]
Sep 14 10:31:18.632642 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:18.632607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw" event={"ID":"906d74f1-d207-4362-b1ea-36d734133363","Type":"ContainerStarted","Data":"7a9595df213746b1ca4f5be9facf982143cf9786cef89ac43b081b4cbb5ce926"}
Sep 14 10:31:18.633062 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:18.632654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw" event={"ID":"906d74f1-d207-4362-b1ea-36d734133363","Type":"ContainerStarted","Data":"523129a7334a35b97b1911084d402fc52773c50666bb76a80b26a1c58e991e23"}
Sep 14 10:31:18.633062 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:18.632806    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"
Sep 14 10:31:18.650412 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:18.650373    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw" podStartSLOduration=1.650360709 podStartE2EDuration="1.650360709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:18.649615306 +0000 UTC m=+376.191017107" watchObservedRunningTime="2026-09-14 10:31:18.650360709 +0000 UTC m=+376.191762509"
Sep 14 10:31:18.651949 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:31:18.651922    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-l6kbc\" is forbidden: User \"system:node:ip-10-0-135-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-139.ec2.internal' and this object" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-l6kbc"
Sep 14 10:31:18.976588 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:18.976514    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7573cdae-b4fd-4324-bb46-efb60393a418" path="/var/lib/kubelet/pods/7573cdae-b4fd-4324-bb46-efb60393a418/volumes"
Sep 14 10:31:29.640828 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:29.640797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f2htw"
Sep 14 10:31:36.944074 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:36.944033    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-ffc649769-2f4gc" podUID="6244fda8-c0df-4da6-bf2d-504c12b0fae8" containerName="console" containerID="cri-o://967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845" gracePeriod=15
Sep 14 10:31:37.177757 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.177736    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:31:37.222616 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.222557    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-trusted-ca-bundle\") pod \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") "
Sep 14 10:31:37.222616 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.222598    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-oauth-serving-cert\") pod \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") "
Sep 14 10:31:37.222616 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.222617    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-service-ca\") pod \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") "
Sep 14 10:31:37.222808 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.222712    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh4vb\" (UniqueName: \"kubernetes.io/projected/6244fda8-c0df-4da6-bf2d-504c12b0fae8-kube-api-access-sh4vb\") pod \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") "
Sep 14 10:31:37.222808 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.222766    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-serving-cert\") pod \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") "
Sep 14 10:31:37.222808 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.222785    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-oauth-config\") pod \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") "
Sep 14 10:31:37.222937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.222816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-config\") pod \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\" (UID: \"6244fda8-c0df-4da6-bf2d-504c12b0fae8\") "
Sep 14 10:31:37.223019 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.222994    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6244fda8-c0df-4da6-bf2d-504c12b0fae8" (UID: "6244fda8-c0df-4da6-bf2d-504c12b0fae8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:31:37.223019 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.223003    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-service-ca" (OuterVolumeSpecName: "service-ca") pod "6244fda8-c0df-4da6-bf2d-504c12b0fae8" (UID: "6244fda8-c0df-4da6-bf2d-504c12b0fae8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:31:37.223149 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.223011    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6244fda8-c0df-4da6-bf2d-504c12b0fae8" (UID: "6244fda8-c0df-4da6-bf2d-504c12b0fae8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:31:37.223333 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.223312    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-config" (OuterVolumeSpecName: "console-config") pod "6244fda8-c0df-4da6-bf2d-504c12b0fae8" (UID: "6244fda8-c0df-4da6-bf2d-504c12b0fae8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:31:37.224951 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.224933    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6244fda8-c0df-4da6-bf2d-504c12b0fae8" (UID: "6244fda8-c0df-4da6-bf2d-504c12b0fae8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:31:37.225034 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.224967    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6244fda8-c0df-4da6-bf2d-504c12b0fae8" (UID: "6244fda8-c0df-4da6-bf2d-504c12b0fae8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:31:37.225072 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.225056    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6244fda8-c0df-4da6-bf2d-504c12b0fae8-kube-api-access-sh4vb" (OuterVolumeSpecName: "kube-api-access-sh4vb") pod "6244fda8-c0df-4da6-bf2d-504c12b0fae8" (UID: "6244fda8-c0df-4da6-bf2d-504c12b0fae8"). InnerVolumeSpecName "kube-api-access-sh4vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:31:37.324259 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.324234    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-serving-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:31:37.324259 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.324257    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-oauth-config\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:31:37.324431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.324266    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-console-config\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:31:37.324431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.324276    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-trusted-ca-bundle\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:31:37.324431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.324283    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-oauth-serving-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:31:37.324431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.324292    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6244fda8-c0df-4da6-bf2d-504c12b0fae8-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:31:37.324431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.324299    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh4vb\" (UniqueName: \"kubernetes.io/projected/6244fda8-c0df-4da6-bf2d-504c12b0fae8-kube-api-access-sh4vb\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:31:37.723997 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.723959    2578 generic.go:356] "Generic (PLEG): container finished" podID="6244fda8-c0df-4da6-bf2d-504c12b0fae8" containerID="967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845" exitCode=0
Sep 14 10:31:37.724165 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.724005    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffc649769-2f4gc"
Sep 14 10:31:37.724165 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.724040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffc649769-2f4gc" event={"ID":"6244fda8-c0df-4da6-bf2d-504c12b0fae8","Type":"ContainerDied","Data":"967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845"}
Sep 14 10:31:37.724165 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.724096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffc649769-2f4gc" event={"ID":"6244fda8-c0df-4da6-bf2d-504c12b0fae8","Type":"ContainerDied","Data":"2cb0b2745630ce68921885e76b368ab86c89c51b85bb59a2ecbf0d20a3843558"}
Sep 14 10:31:37.724165 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.724116    2578 scope.go:117] "RemoveContainer" containerID="967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845"
Sep 14 10:31:37.733032 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.733016    2578 scope.go:117] "RemoveContainer" containerID="967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845"
Sep 14 10:31:37.733288 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:31:37.733270    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845\": container with ID starting with 967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845 not found: ID does not exist" containerID="967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845"
Sep 14 10:31:37.733360 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.733292    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845"} err="failed to get container status \"967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845\": rpc error: code = NotFound desc = could not find container \"967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845\": container with ID starting with 967b9dfd958a508ffa592773a73efeef997b3c6db3a7388a2cc4343c450ad845 not found: ID does not exist"
Sep 14 10:31:37.747032 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.747011    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ffc649769-2f4gc"]
Sep 14 10:31:37.752217 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:37.752198    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ffc649769-2f4gc"]
Sep 14 10:31:38.976400 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:31:38.976372    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6244fda8-c0df-4da6-bf2d-504c12b0fae8" path="/var/lib/kubelet/pods/6244fda8-c0df-4da6-bf2d-504c12b0fae8/volumes"
Sep 14 10:32:02.862762 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:02.862740    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fqpt2"]
Sep 14 10:32:02.863050 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:02.863037    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6244fda8-c0df-4da6-bf2d-504c12b0fae8" containerName="console"
Sep 14 10:32:02.863121 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:02.863054    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6244fda8-c0df-4da6-bf2d-504c12b0fae8" containerName="console"
Sep 14 10:32:02.863121 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:02.863118    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6244fda8-c0df-4da6-bf2d-504c12b0fae8" containerName="console"
Sep 14 10:32:02.867056 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:02.867040    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2"
Sep 14 10:32:02.869952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:02.869934    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2sn7g\""
Sep 14 10:32:02.883388 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:02.883354    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fqpt2"]
Sep 14 10:32:02.904474 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:02.904446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbkh2\" (UniqueName: \"kubernetes.io/projected/c9ea5108-b273-407f-b057-6979729dc547-kube-api-access-xbkh2\") pod \"authorino-7bcfd8f9cd-fqpt2\" (UID: \"c9ea5108-b273-407f-b057-6979729dc547\") " pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2"
Sep 14 10:32:03.004825 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:03.004794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbkh2\" (UniqueName: \"kubernetes.io/projected/c9ea5108-b273-407f-b057-6979729dc547-kube-api-access-xbkh2\") pod \"authorino-7bcfd8f9cd-fqpt2\" (UID: \"c9ea5108-b273-407f-b057-6979729dc547\") " pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2"
Sep 14 10:32:03.018149 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:03.018118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbkh2\" (UniqueName: \"kubernetes.io/projected/c9ea5108-b273-407f-b057-6979729dc547-kube-api-access-xbkh2\") pod \"authorino-7bcfd8f9cd-fqpt2\" (UID: \"c9ea5108-b273-407f-b057-6979729dc547\") " pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2"
Sep 14 10:32:03.176146 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:03.176078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2"
Sep 14 10:32:03.446920 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:03.446896    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fqpt2"]
Sep 14 10:32:03.448661 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:32:03.448633    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9ea5108_b273_407f_b057_6979729dc547.slice/crio-2684dc709db629e25af9ced4ba81710ccf4e125abd3fa24b649ef661bf7ff6e0 WatchSource:0}: Error finding container 2684dc709db629e25af9ced4ba81710ccf4e125abd3fa24b649ef661bf7ff6e0: Status 404 returned error can't find the container with id 2684dc709db629e25af9ced4ba81710ccf4e125abd3fa24b649ef661bf7ff6e0
Sep 14 10:32:03.842339 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:03.842309    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2" event={"ID":"c9ea5108-b273-407f-b057-6979729dc547","Type":"ContainerStarted","Data":"2684dc709db629e25af9ced4ba81710ccf4e125abd3fa24b649ef661bf7ff6e0"}
Sep 14 10:32:05.786006 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:05.785973    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fqpt2"]
Sep 14 10:32:06.857969 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:06.857931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2" event={"ID":"c9ea5108-b273-407f-b057-6979729dc547","Type":"ContainerStarted","Data":"8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a"}
Sep 14 10:32:06.857969 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:06.857947    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2" podUID="c9ea5108-b273-407f-b057-6979729dc547" containerName="authorino" containerID="cri-o://8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a" gracePeriod=30
Sep 14 10:32:06.877162 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:06.877121    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2" podStartSLOduration=2.184713156 podStartE2EDuration="4.877106951s" totalImagesPullingTime="2.692393795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:32:06.87471993 +0000 UTC m=+424.416121732" watchObservedRunningTime="2026-09-14 10:32:06.877106951 +0000 UTC m=+424.418508752"
Sep 14 10:32:07.098251 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.098223    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2"
Sep 14 10:32:07.238862 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.238782    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbkh2\" (UniqueName: \"kubernetes.io/projected/c9ea5108-b273-407f-b057-6979729dc547-kube-api-access-xbkh2\") pod \"c9ea5108-b273-407f-b057-6979729dc547\" (UID: \"c9ea5108-b273-407f-b057-6979729dc547\") "
Sep 14 10:32:07.240893 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.240871    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9ea5108-b273-407f-b057-6979729dc547-kube-api-access-xbkh2" (OuterVolumeSpecName: "kube-api-access-xbkh2") pod "c9ea5108-b273-407f-b057-6979729dc547" (UID: "c9ea5108-b273-407f-b057-6979729dc547"). InnerVolumeSpecName "kube-api-access-xbkh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:32:07.339896 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.339868    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbkh2\" (UniqueName: \"kubernetes.io/projected/c9ea5108-b273-407f-b057-6979729dc547-kube-api-access-xbkh2\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:32:07.864209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.864173    2578 generic.go:356] "Generic (PLEG): container finished" podID="c9ea5108-b273-407f-b057-6979729dc547" containerID="8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a" exitCode=0
Sep 14 10:32:07.864209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.864212    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2"
Sep 14 10:32:07.864762 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.864219    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2" event={"ID":"c9ea5108-b273-407f-b057-6979729dc547","Type":"ContainerDied","Data":"8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a"}
Sep 14 10:32:07.864762 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.864255    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fqpt2" event={"ID":"c9ea5108-b273-407f-b057-6979729dc547","Type":"ContainerDied","Data":"2684dc709db629e25af9ced4ba81710ccf4e125abd3fa24b649ef661bf7ff6e0"}
Sep 14 10:32:07.864762 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.864276    2578 scope.go:117] "RemoveContainer" containerID="8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a"
Sep 14 10:32:07.872497 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.872480    2578 scope.go:117] "RemoveContainer" containerID="8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a"
Sep 14 10:32:07.872789 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:32:07.872768    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a\": container with ID starting with 8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a not found: ID does not exist" containerID="8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a"
Sep 14 10:32:07.872841 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.872798    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a"} err="failed to get container status \"8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a\": rpc error: code = NotFound desc = could not find container \"8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a\": container with ID starting with 8530acbccb1ca7bacbb589a960cb6238b88d7724c34f087ab56d5846bd1f748a not found: ID does not exist"
Sep 14 10:32:07.886123 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.886100    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fqpt2"]
Sep 14 10:32:07.890439 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:07.890422    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fqpt2"]
Sep 14 10:32:08.975615 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:32:08.975589    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9ea5108-b273-407f-b057-6979729dc547" path="/var/lib/kubelet/pods/c9ea5108-b273-407f-b057-6979729dc547/volumes"
Sep 14 10:33:15.927888 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.927851    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"]
Sep 14 10:33:15.928273 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.928101    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ea5108-b273-407f-b057-6979729dc547" containerName="authorino"
Sep 14 10:33:15.928273 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.928113    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ea5108-b273-407f-b057-6979729dc547" containerName="authorino"
Sep 14 10:33:15.928273 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.928172    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ea5108-b273-407f-b057-6979729dc547" containerName="authorino"
Sep 14 10:33:15.932121 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.932105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:15.936086 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.936049    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 10:33:15.937303 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.937276    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 14 10:33:15.937535 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.937514    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9bhlx\""
Sep 14 10:33:15.937745 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.937728    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 14 10:33:15.937898 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.937866    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 14 10:33:15.944004 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:15.943983    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"]
Sep 14 10:33:16.123902 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.123871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-maas-api-tls\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.124091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.124058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-metrics-certs\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.124155 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.124114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njp9g\" (UniqueName: \"kubernetes.io/projected/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-kube-api-access-njp9g\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.124243 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.124224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-openshift-service-ca\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.224608 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.224537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-metrics-certs\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.224608 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.224568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njp9g\" (UniqueName: \"kubernetes.io/projected/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-kube-api-access-njp9g\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.224608 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.224597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-openshift-service-ca\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.224885 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.224614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-maas-api-tls\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.224885 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:33:16.224709    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 14 10:33:16.224885 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:33:16.224789    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-metrics-certs podName:b8229365-3c1b-4e3c-86a7-4fd43ec8bd90 nodeName:}" failed. No retries permitted until 2026-09-14 10:33:16.724767747 +0000 UTC m=+494.266169544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-metrics-certs") pod "maas-api-6997c4c9fc-7c94j" (UID: "b8229365-3c1b-4e3c-86a7-4fd43ec8bd90") : secret "maas-api-metrics-tls" not found
Sep 14 10:33:16.225232 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.225213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-openshift-service-ca\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.227016 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.226999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-maas-api-tls\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.240380 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.240342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njp9g\" (UniqueName: \"kubernetes.io/projected/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-kube-api-access-njp9g\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.728927 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.728870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-metrics-certs\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.731359 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.731338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-metrics-certs\") pod \"maas-api-6997c4c9fc-7c94j\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") " pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:16.843915 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:16.843879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:17.124791 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:17.124766    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"]
Sep 14 10:33:17.126273 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:33:17.126249    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8229365_3c1b_4e3c_86a7_4fd43ec8bd90.slice/crio-589be3a4a3d1feed2cc82cfce34317210ec27b52acda705dcd66bf974faa9674 WatchSource:0}: Error finding container 589be3a4a3d1feed2cc82cfce34317210ec27b52acda705dcd66bf974faa9674: Status 404 returned error can't find the container with id 589be3a4a3d1feed2cc82cfce34317210ec27b52acda705dcd66bf974faa9674
Sep 14 10:33:17.173391 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:17.173360    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j" event={"ID":"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90","Type":"ContainerStarted","Data":"589be3a4a3d1feed2cc82cfce34317210ec27b52acda705dcd66bf974faa9674"}
Sep 14 10:33:20.191208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:20.191168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j" event={"ID":"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90","Type":"ContainerStarted","Data":"0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f"}
Sep 14 10:33:20.191566 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:20.191244    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:20.210340 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:20.210289    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j" podStartSLOduration=2.956563559 podStartE2EDuration="5.210274487s" totalImagesPullingTime="2.253710928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:33:20.209960612 +0000 UTC m=+497.751362416" watchObservedRunningTime="2026-09-14 10:33:20.210274487 +0000 UTC m=+497.751676287"
Sep 14 10:33:26.200775 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:26.200748    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 10:33:44.199529 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.199496    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"]
Sep 14 10:33:44.202585 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.202568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.213065 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.213047    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 14 10:33:44.213159 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.213068    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 14 10:33:44.213159 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.213074    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f5d8v\""
Sep 14 10:33:44.213159 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.213126    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 14 10:33:44.221332 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.221309    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"]
Sep 14 10:33:44.316097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.316063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac964901-034f-483f-9a5c-d49b840dbfcc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.316097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.316096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.316354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.316130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qp29\" (UniqueName: \"kubernetes.io/projected/ac964901-034f-483f-9a5c-d49b840dbfcc-kube-api-access-7qp29\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.316354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.316167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.316354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.316250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.316354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.316292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.416853 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.416816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.417021 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.416859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.417021 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.416896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac964901-034f-483f-9a5c-d49b840dbfcc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.417021 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.416917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.417021 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.416949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qp29\" (UniqueName: \"kubernetes.io/projected/ac964901-034f-483f-9a5c-d49b840dbfcc-kube-api-access-7qp29\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.417021 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.416989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.417354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.417325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.417472 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.417439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.417561 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.417543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.419778 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.419758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac964901-034f-483f-9a5c-d49b840dbfcc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.420183 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.420167    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac964901-034f-483f-9a5c-d49b840dbfcc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.429396 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.429373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qp29\" (UniqueName: \"kubernetes.io/projected/ac964901-034f-483f-9a5c-d49b840dbfcc-kube-api-access-7qp29\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v2bs8\" (UID: \"ac964901-034f-483f-9a5c-d49b840dbfcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.512467 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.512386    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:44.800423 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:44.800346    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"]
Sep 14 10:33:44.805481 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:33:44.805453    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac964901_034f_483f_9a5c_d49b840dbfcc.slice/crio-1f99d26b6b225336264b041c6699e6aa47d8017bce9eb513d12b06ca9d6fd6dc WatchSource:0}: Error finding container 1f99d26b6b225336264b041c6699e6aa47d8017bce9eb513d12b06ca9d6fd6dc: Status 404 returned error can't find the container with id 1f99d26b6b225336264b041c6699e6aa47d8017bce9eb513d12b06ca9d6fd6dc
Sep 14 10:33:45.305221 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:45.305181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8" event={"ID":"ac964901-034f-483f-9a5c-d49b840dbfcc","Type":"ContainerStarted","Data":"1f99d26b6b225336264b041c6699e6aa47d8017bce9eb513d12b06ca9d6fd6dc"}
Sep 14 10:33:46.312110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:46.312071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8" event={"ID":"ac964901-034f-483f-9a5c-d49b840dbfcc","Type":"ContainerStarted","Data":"8c920e8e52b0d5c68d18b1709fb427e0e4a700e49241bb6b41101907b0918294"}
Sep 14 10:33:46.332060 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:46.332017    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8" podStartSLOduration=1.357334058 podStartE2EDuration="2.332002706s" totalImagesPullingTime="974.668648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:33:46.329998137 +0000 UTC m=+523.871399940" watchObservedRunningTime="2026-09-14 10:33:46.332002706 +0000 UTC m=+523.873404530"
Sep 14 10:33:54.513411 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:54.513316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:54.513411 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:54.513391    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:54.525705 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:54.525661    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:33:55.363537 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:33:55.363500    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v2bs8"
Sep 14 10:34:00.959940 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:00.959908    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"]
Sep 14 10:34:00.963007 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:00.962984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:00.965722 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:00.965701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 14 10:34:00.978016 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:00.977991    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"]
Sep 14 10:34:01.049056 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.049029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.049056 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.049067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.049280 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.049086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28ad35a9-abe0-4543-af50-73c7d3d090de-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.049280 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.049131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.049280 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.049264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5254\" (UniqueName: \"kubernetes.io/projected/28ad35a9-abe0-4543-af50-73c7d3d090de-kube-api-access-j5254\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.049400 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.049336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.150325 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.150297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.150475 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.150332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28ad35a9-abe0-4543-af50-73c7d3d090de-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.150475 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.150354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.150475 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.150375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5254\" (UniqueName: \"kubernetes.io/projected/28ad35a9-abe0-4543-af50-73c7d3d090de-kube-api-access-j5254\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.150475 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.150447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.150662 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.150498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.150746 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.150655    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.150746 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.150737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.150848 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.150793    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.152631 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.152607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28ad35a9-abe0-4543-af50-73c7d3d090de-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.152746 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.152724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28ad35a9-abe0-4543-af50-73c7d3d090de-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.159514 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.159497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5254\" (UniqueName: \"kubernetes.io/projected/28ad35a9-abe0-4543-af50-73c7d3d090de-kube-api-access-j5254\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x7bx7\" (UID: \"28ad35a9-abe0-4543-af50-73c7d3d090de\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.273939 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.273850    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:01.553286 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:01.553264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"]
Sep 14 10:34:01.555209 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:34:01.555186    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ad35a9_abe0_4543_af50_73c7d3d090de.slice/crio-8f2c39eb181ff1c98522b3a1cbc33ca1430c30a7103ca523842922b181833212 WatchSource:0}: Error finding container 8f2c39eb181ff1c98522b3a1cbc33ca1430c30a7103ca523842922b181833212: Status 404 returned error can't find the container with id 8f2c39eb181ff1c98522b3a1cbc33ca1430c30a7103ca523842922b181833212
Sep 14 10:34:02.386183 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:02.386144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7" event={"ID":"28ad35a9-abe0-4543-af50-73c7d3d090de","Type":"ContainerStarted","Data":"f58907bcce11f78ef5be671990fd39a7f3911038f2d748b9cf5ce018d99a348b"}
Sep 14 10:34:02.386638 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:02.386197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7" event={"ID":"28ad35a9-abe0-4543-af50-73c7d3d090de","Type":"ContainerStarted","Data":"8f2c39eb181ff1c98522b3a1cbc33ca1430c30a7103ca523842922b181833212"}
Sep 14 10:34:02.407916 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:02.407866    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7" podStartSLOduration=2.205893879 podStartE2EDuration="2.407851155s" totalImagesPullingTime="201.957276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:34:02.406168612 +0000 UTC m=+539.947570454" watchObservedRunningTime="2026-09-14 10:34:02.407851155 +0000 UTC m=+539.949252956"
Sep 14 10:34:11.274636 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:11.274581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:11.275122 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:11.274661    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:11.287063 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:11.287036    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:11.437207 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:11.437178    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x7bx7"
Sep 14 10:34:14.678001 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.677972    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"]
Sep 14 10:34:14.681283 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.681268    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.685256 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.685232    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 14 10:34:14.694396 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.694369    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"]
Sep 14 10:34:14.759111 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.759071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.759111 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.759113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.759275 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.759132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.759275 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.759228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.759349 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.759302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smxzl\" (UniqueName: \"kubernetes.io/projected/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-kube-api-access-smxzl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.759349 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.759326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.860318 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.860285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.860447 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.860338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.860447 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.860365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.860447 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.860390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.860447 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.860437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.860752 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.860528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smxzl\" (UniqueName: \"kubernetes.io/projected/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-kube-api-access-smxzl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.860805 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.860755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.860886 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.860855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.860998 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.860973    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.862939 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.862921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.863479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.863449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.873868 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.873848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smxzl\" (UniqueName: \"kubernetes.io/projected/dc9fbd6a-1f38-456d-9472-e0f6b437abfa-kube-api-access-smxzl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd\" (UID: \"dc9fbd6a-1f38-456d-9472-e0f6b437abfa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:14.991402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:14.991335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:15.271585 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:15.271510    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"]
Sep 14 10:34:15.274712 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:34:15.274666    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9fbd6a_1f38_456d_9472_e0f6b437abfa.slice/crio-9f66a15898616f0ad70c0d7bc6cf9e7a7670e19daad53785083360f80068eef2 WatchSource:0}: Error finding container 9f66a15898616f0ad70c0d7bc6cf9e7a7670e19daad53785083360f80068eef2: Status 404 returned error can't find the container with id 9f66a15898616f0ad70c0d7bc6cf9e7a7670e19daad53785083360f80068eef2
Sep 14 10:34:15.447167 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:15.447134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd" event={"ID":"dc9fbd6a-1f38-456d-9472-e0f6b437abfa","Type":"ContainerStarted","Data":"9f66a15898616f0ad70c0d7bc6cf9e7a7670e19daad53785083360f80068eef2"}
Sep 14 10:34:16.453266 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:16.453220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd" event={"ID":"dc9fbd6a-1f38-456d-9472-e0f6b437abfa","Type":"ContainerStarted","Data":"457bab46da736fbdf0b05c85c261153e4cb7bc1203b8508139048777fd649723"}
Sep 14 10:34:16.504322 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:16.504270    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd" podStartSLOduration=2.328153791 podStartE2EDuration="2.50425279s" totalImagesPullingTime="176.098999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:34:16.500961 +0000 UTC m=+554.042362800" watchObservedRunningTime="2026-09-14 10:34:16.50425279 +0000 UTC m=+554.045654587"
Sep 14 10:34:24.991782 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:24.991751    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:24.992194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:24.991800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:25.003998 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:25.003977    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:34:25.508279 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:34:25.508253    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd"
Sep 14 10:36:13.572200 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.572166    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"]
Sep 14 10:36:13.575389 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.575368    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.578786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.578770    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-1910e9-openshift-default-dockercfg-rtwsm\""
Sep 14 10:36:13.588853 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.588827    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"]
Sep 14 10:36:13.686449 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.686417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8337f636-aaa5-445b-a337-4bbca91667e8-istio-podinfo\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.686449 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.686459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-istio-token\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.686656 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.686480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5zn8\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-kube-api-access-r5zn8\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.686656 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.686572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8337f636-aaa5-445b-a337-4bbca91667e8-istiod-ca-cert\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.686656 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.686613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-credential-socket\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.686656 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.686630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-data\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.686832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.686658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-socket\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.686832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.686754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-certs\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.686832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.686769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-envoy\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.787961 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.787927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-certs\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.787961 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.787958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-envoy\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788207 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.787973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8337f636-aaa5-445b-a337-4bbca91667e8-istio-podinfo\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788207 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.787991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-istio-token\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788207 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.788142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5zn8\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-kube-api-access-r5zn8\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788361 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.788214    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8337f636-aaa5-445b-a337-4bbca91667e8-istiod-ca-cert\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788361 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.788265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-credential-socket\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788361 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.788289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-data\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788361 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.788321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-socket\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788537 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.788444    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-certs\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788723 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.788706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-socket\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.788875 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.788822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-data\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.789073 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.789056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-credential-socket\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.789185 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.789162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8337f636-aaa5-445b-a337-4bbca91667e8-istiod-ca-cert\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.790479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.790460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-envoy\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.790606 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.790590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8337f636-aaa5-445b-a337-4bbca91667e8-istio-podinfo\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.796339 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.796318    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5zn8\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-kube-api-access-r5zn8\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.796477 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.796458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-istio-token\") pod \"e2e-worker-w4-1910e9-openshift-default-68f655766-s56th\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") " pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:13.885654 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:13.885617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:14.162698 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:14.162647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"]
Sep 14 10:36:14.164875 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:14.164849    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8337f636_aaa5_445b_a337_4bbca91667e8.slice/crio-b07986736736fa5aaf17810d89eeaceef73420cbd3238de67bede886b5827823 WatchSource:0}: Error finding container b07986736736fa5aaf17810d89eeaceef73420cbd3238de67bede886b5827823: Status 404 returned error can't find the container with id b07986736736fa5aaf17810d89eeaceef73420cbd3238de67bede886b5827823
Sep 14 10:36:14.167331 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:14.167316    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:36:15.013911 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:15.013879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" event={"ID":"8337f636-aaa5-445b-a337-4bbca91667e8","Type":"ContainerStarted","Data":"b07986736736fa5aaf17810d89eeaceef73420cbd3238de67bede886b5827823"}
Sep 14 10:36:18.030708 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.030653    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:36:18.031068 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.030753    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:36:18.031068 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.030802    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:36:18.489221 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.489187    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"]
Sep 14 10:36:18.492853 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.492831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.495280 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.495262    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d36f67-serving-cert\""
Sep 14 10:36:18.504057 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.504034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"]
Sep 14 10:36:18.632469 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.632429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-maas-api-tls\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.632634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.632491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.632634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.632529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p74t\" (UniqueName: \"kubernetes.io/projected/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-kube-api-access-6p74t\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.632748 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.632631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-metrics-certs\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.733857 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.733822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-metrics-certs\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.734032 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.733868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-maas-api-tls\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.734032 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.733895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.734032 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.733924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p74t\" (UniqueName: \"kubernetes.io/projected/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-kube-api-access-6p74t\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.734032 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:18.733981    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-serving-cert: secret "maas-api-e2e-inf-a-d36f67-serving-cert" not found
Sep 14 10:36:18.734183 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:18.734048    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-maas-api-tls podName:7ec2806d-4f4f-46c1-a2c0-620ff2a19774 nodeName:}" failed. No retries permitted until 2026-09-14 10:36:19.234032501 +0000 UTC m=+676.775434281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-maas-api-tls") pod "maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp" (UID: "7ec2806d-4f4f-46c1-a2c0-620ff2a19774") : secret "maas-api-e2e-inf-a-d36f67-serving-cert" not found
Sep 14 10:36:18.734581 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.734552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.736287 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.736268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-metrics-certs\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:18.743606 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:18.743548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p74t\" (UniqueName: \"kubernetes.io/projected/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-kube-api-access-6p74t\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:19.036524 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.036423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" event={"ID":"8337f636-aaa5-445b-a337-4bbca91667e8","Type":"ContainerStarted","Data":"1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979"}
Sep 14 10:36:19.064160 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.064108    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" podStartSLOduration=2.201163566 podStartE2EDuration="6.064089914s" totalImagesPullingTime="3.862926348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:19.062092265 +0000 UTC m=+676.603494078" watchObservedRunningTime="2026-09-14 10:36:19.064089914 +0000 UTC m=+676.605491715"
Sep 14 10:36:19.242168 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.242126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-maas-api-tls\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:19.245537 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.245508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-maas-api-tls\") pod \"maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:19.386379 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.386345    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"]
Sep 14 10:36:19.389825 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.389803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.393037 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.393018    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-85d3ec-serving-cert\""
Sep 14 10:36:19.403594 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.403553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:19.405090 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.405068    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"]
Sep 14 10:36:19.444043 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.444011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jft9j\" (UniqueName: \"kubernetes.io/projected/d137b411-2aea-4083-b5c1-81a8d486a71d-kube-api-access-jft9j\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.444189 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.444053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-metrics-certs\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.444189 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.444112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d137b411-2aea-4083-b5c1-81a8d486a71d-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.444189 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.444139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.545526 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.545492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.545746 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.545549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jft9j\" (UniqueName: \"kubernetes.io/projected/d137b411-2aea-4083-b5c1-81a8d486a71d-kube-api-access-jft9j\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.545746 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:19.545664    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-serving-cert: secret "maas-api-e2e-worker-w0-85d3ec-serving-cert" not found
Sep 14 10:36:19.545746 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.545720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-metrics-certs\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.545924 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:19.545765    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-maas-api-tls podName:d137b411-2aea-4083-b5c1-81a8d486a71d nodeName:}" failed. No retries permitted until 2026-09-14 10:36:20.045743638 +0000 UTC m=+677.587145418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-maas-api-tls") pod "maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk" (UID: "d137b411-2aea-4083-b5c1-81a8d486a71d") : secret "maas-api-e2e-worker-w0-85d3ec-serving-cert" not found
Sep 14 10:36:19.545924 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.545858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d137b411-2aea-4083-b5c1-81a8d486a71d-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.546459 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.546442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d137b411-2aea-4083-b5c1-81a8d486a71d-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.548137 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.548122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-metrics-certs\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.554935 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.554915    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jft9j\" (UniqueName: \"kubernetes.io/projected/d137b411-2aea-4083-b5c1-81a8d486a71d-kube-api-access-jft9j\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:19.682510 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.682338    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"]
Sep 14 10:36:19.684934 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:19.684902    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec2806d_4f4f_46c1_a2c0_620ff2a19774.slice/crio-4e01b1a026c3cff5f6591d6c26377fed074230b07052944efad656bbe3c2bd0b WatchSource:0}: Error finding container 4e01b1a026c3cff5f6591d6c26377fed074230b07052944efad656bbe3c2bd0b: Status 404 returned error can't find the container with id 4e01b1a026c3cff5f6591d6c26377fed074230b07052944efad656bbe3c2bd0b
Sep 14 10:36:19.886215 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.886180    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:19.890978 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:19.890951    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:20.043808 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:20.043735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp" event={"ID":"7ec2806d-4f4f-46c1-a2c0-620ff2a19774","Type":"ContainerStarted","Data":"4e01b1a026c3cff5f6591d6c26377fed074230b07052944efad656bbe3c2bd0b"}
Sep 14 10:36:20.044207 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:20.044078    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:20.045072 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:20.045044    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:20.051474 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:20.051450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:20.054097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:20.054073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:20.300817 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:20.300740    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:20.589896 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:20.589870    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd137b411_2aea_4083_b5c1_81a8d486a71d.slice/crio-3875c68231107005aad332fd785efb134a8ea524eabdf897f9b0df39fdb1b914 WatchSource:0}: Error finding container 3875c68231107005aad332fd785efb134a8ea524eabdf897f9b0df39fdb1b914: Status 404 returned error can't find the container with id 3875c68231107005aad332fd785efb134a8ea524eabdf897f9b0df39fdb1b914
Sep 14 10:36:20.590129 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:20.590106    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"]
Sep 14 10:36:21.050855 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:21.050812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk" event={"ID":"d137b411-2aea-4083-b5c1-81a8d486a71d","Type":"ContainerStarted","Data":"3875c68231107005aad332fd785efb134a8ea524eabdf897f9b0df39fdb1b914"}
Sep 14 10:36:21.052399 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:21.052375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp" event={"ID":"7ec2806d-4f4f-46c1-a2c0-620ff2a19774","Type":"ContainerStarted","Data":"14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178"}
Sep 14 10:36:21.075224 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:21.075179    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp" podStartSLOduration=2.699476861 podStartE2EDuration="3.075163712s" totalImagesPullingTime="375.686851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:21.073752612 +0000 UTC m=+678.615154404" watchObservedRunningTime="2026-09-14 10:36:21.075163712 +0000 UTC m=+678.616565512"
Sep 14 10:36:22.058379 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:22.058337    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk" event={"ID":"d137b411-2aea-4083-b5c1-81a8d486a71d","Type":"ContainerStarted","Data":"9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef"}
Sep 14 10:36:22.058900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:22.058542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:22.058900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:22.058590    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:22.082668 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:22.082613    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk" podStartSLOduration=2.660124268 podStartE2EDuration="3.082596639s" totalImagesPullingTime="422.472371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:22.080817134 +0000 UTC m=+679.622218957" watchObservedRunningTime="2026-09-14 10:36:22.082596639 +0000 UTC m=+679.623998440"
Sep 14 10:36:24.789632 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.789602    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"]
Sep 14 10:36:24.792999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.792979    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:24.797381 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.797351    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-1910e9-serving-cert\""
Sep 14 10:36:24.811026 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.811003    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"]
Sep 14 10:36:24.898558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.898522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb9fh\" (UniqueName: \"kubernetes.io/projected/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-kube-api-access-mb9fh\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:24.898558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.898562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-maas-api-tls\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:24.898804 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.898598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-metrics-certs\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:24.898804 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.898645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:24.999339 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.999303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb9fh\" (UniqueName: \"kubernetes.io/projected/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-kube-api-access-mb9fh\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:24.999514 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.999364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-maas-api-tls\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:24.999514 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.999401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-metrics-certs\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:24.999514 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:24.999453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:24.999726 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:24.999553    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-serving-cert: secret "maas-api-e2e-worker-w4-1910e9-serving-cert" not found
Sep 14 10:36:24.999784 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:24.999732    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-maas-api-tls podName:c9535705-d1d0-4c5b-ad5f-6a089d1322d3 nodeName:}" failed. No retries permitted until 2026-09-14 10:36:25.499708981 +0000 UTC m=+683.041110782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-maas-api-tls") pod "maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb" (UID: "c9535705-d1d0-4c5b-ad5f-6a089d1322d3") : secret "maas-api-e2e-worker-w4-1910e9-serving-cert" not found
Sep 14 10:36:25.000208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.000187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:25.002491 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.002467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-metrics-certs\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:25.012620 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.012591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb9fh\" (UniqueName: \"kubernetes.io/projected/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-kube-api-access-mb9fh\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:25.503920 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.503879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-maas-api-tls\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:25.506363 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.506334    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-maas-api-tls\") pod \"maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:25.703907 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.703869    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:25.800469 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.800439    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"]
Sep 14 10:36:25.804894 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.804873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:25.808004 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.807973    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-1910e9-dockercfg-mqrd7\""
Sep 14 10:36:25.808130 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.808036    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-1910e9\""
Sep 14 10:36:25.816176 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.816151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"]
Sep 14 10:36:25.908036 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.907991    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzx8v\" (UniqueName: \"kubernetes.io/projected/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-kube-api-access-mzx8v\") pod \"payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw\" (UID: \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:25.908212 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.908053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw\" (UID: \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:25.976138 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:25.976111    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"]
Sep 14 10:36:25.977821 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:25.977794    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9535705_d1d0_4c5b_ad5f_6a089d1322d3.slice/crio-255a1ff62f5489fcafc21cddc45567ca52fe6c63dba83dcab22110ede4099fe9 WatchSource:0}: Error finding container 255a1ff62f5489fcafc21cddc45567ca52fe6c63dba83dcab22110ede4099fe9: Status 404 returned error can't find the container with id 255a1ff62f5489fcafc21cddc45567ca52fe6c63dba83dcab22110ede4099fe9
Sep 14 10:36:26.009170 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:26.009098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw\" (UID: \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:26.009296 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:26.009182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzx8v\" (UniqueName: \"kubernetes.io/projected/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-kube-api-access-mzx8v\") pod \"payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw\" (UID: \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:26.009803 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:26.009784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw\" (UID: \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:26.017921 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:26.017898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzx8v\" (UniqueName: \"kubernetes.io/projected/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-kube-api-access-mzx8v\") pod \"payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw\" (UID: \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:26.078095 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:26.078061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb" event={"ID":"c9535705-d1d0-4c5b-ad5f-6a089d1322d3","Type":"ContainerStarted","Data":"255a1ff62f5489fcafc21cddc45567ca52fe6c63dba83dcab22110ede4099fe9"}
Sep 14 10:36:26.116528 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:26.116488    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:26.391331 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:26.391303    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"]
Sep 14 10:36:26.392793 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:26.392768    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88332ab_3d7e_42d6_a814_7d5f4a61f8a4.slice/crio-396b83ecf2b6fba014b6f74c01378855bb6fff07136ce5c854c15b1a74c5923a WatchSource:0}: Error finding container 396b83ecf2b6fba014b6f74c01378855bb6fff07136ce5c854c15b1a74c5923a: Status 404 returned error can't find the container with id 396b83ecf2b6fba014b6f74c01378855bb6fff07136ce5c854c15b1a74c5923a
Sep 14 10:36:27.085795 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.085757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb" event={"ID":"c9535705-d1d0-4c5b-ad5f-6a089d1322d3","Type":"ContainerStarted","Data":"b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364"}
Sep 14 10:36:27.086249 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.085830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:27.087080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.087057    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw" event={"ID":"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4","Type":"ContainerStarted","Data":"396b83ecf2b6fba014b6f74c01378855bb6fff07136ce5c854c15b1a74c5923a"}
Sep 14 10:36:27.103451 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.103401    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb" podStartSLOduration=2.724508236 podStartE2EDuration="3.103383828s" totalImagesPullingTime="378.875592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:27.103045317 +0000 UTC m=+684.644447119" watchObservedRunningTime="2026-09-14 10:36:27.103383828 +0000 UTC m=+684.644785628"
Sep 14 10:36:27.168655 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.168327    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"]
Sep 14 10:36:27.172235 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.172210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.175211 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.175181    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-30eaba-serving-cert\""
Sep 14 10:36:27.187226 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.187155    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"]
Sep 14 10:36:27.321312 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.321279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvdrw\" (UniqueName: \"kubernetes.io/projected/b1919046-7b0f-4c03-9e23-8f912b54d53c-kube-api-access-tvdrw\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.321502 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.321405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-maas-api-tls\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.321502 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.321484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-metrics-certs\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.321602 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.321512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1919046-7b0f-4c03-9e23-8f912b54d53c-openshift-service-ca\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.423040 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.422908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvdrw\" (UniqueName: \"kubernetes.io/projected/b1919046-7b0f-4c03-9e23-8f912b54d53c-kube-api-access-tvdrw\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.423040 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.423004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-maas-api-tls\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.423320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.423067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-metrics-certs\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.423320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.423101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1919046-7b0f-4c03-9e23-8f912b54d53c-openshift-service-ca\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.423320 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:27.423151    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-serving-cert: secret "maas-api-e2e-autores-30eaba-serving-cert" not found
Sep 14 10:36:27.423320 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:27.423218    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-maas-api-tls podName:b1919046-7b0f-4c03-9e23-8f912b54d53c nodeName:}" failed. No retries permitted until 2026-09-14 10:36:27.923201398 +0000 UTC m=+685.464603200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-maas-api-tls") pod "maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk" (UID: "b1919046-7b0f-4c03-9e23-8f912b54d53c") : secret "maas-api-e2e-autores-30eaba-serving-cert" not found
Sep 14 10:36:27.423925 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.423898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1919046-7b0f-4c03-9e23-8f912b54d53c-openshift-service-ca\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.426040 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.426015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-metrics-certs\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.434202 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.434174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvdrw\" (UniqueName: \"kubernetes.io/projected/b1919046-7b0f-4c03-9e23-8f912b54d53c-kube-api-access-tvdrw\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.928091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.928044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-maas-api-tls\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:27.930769 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:27.930736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-maas-api-tls\") pod \"maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:28.067842 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:28.067813    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:36:28.068253 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:28.068234    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:36:28.088821 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:28.088795    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:28.093935 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:28.093909    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw" event={"ID":"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4","Type":"ContainerStarted","Data":"f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c"}
Sep 14 10:36:28.132089 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:28.131785    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw" podStartSLOduration=2.007490572 podStartE2EDuration="3.131764164s" totalImagesPullingTime="1.124273592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:28.12974537 +0000 UTC m=+685.671147171" watchObservedRunningTime="2026-09-14 10:36:28.131764164 +0000 UTC m=+685.673165966"
Sep 14 10:36:28.381269 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:28.381244    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"]
Sep 14 10:36:28.383116 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:28.383086    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1919046_7b0f_4c03_9e23_8f912b54d53c.slice/crio-b54730072c4cb6b280c49109340d71ae08e1f18d33d237904c0561f0dc2ce2f8 WatchSource:0}: Error finding container b54730072c4cb6b280c49109340d71ae08e1f18d33d237904c0561f0dc2ce2f8: Status 404 returned error can't find the container with id b54730072c4cb6b280c49109340d71ae08e1f18d33d237904c0561f0dc2ce2f8
Sep 14 10:36:29.100706 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:29.100653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk" event={"ID":"b1919046-7b0f-4c03-9e23-8f912b54d53c","Type":"ContainerStarted","Data":"aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820"}
Sep 14 10:36:29.101074 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:29.100736    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk" event={"ID":"b1919046-7b0f-4c03-9e23-8f912b54d53c","Type":"ContainerStarted","Data":"b54730072c4cb6b280c49109340d71ae08e1f18d33d237904c0561f0dc2ce2f8"}
Sep 14 10:36:29.101074 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:29.100878    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:29.101074 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:29.101017    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:29.121065 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:29.121018    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk" podStartSLOduration=1.730763349 podStartE2EDuration="2.121002758s" totalImagesPullingTime="390.239409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:29.119266313 +0000 UTC m=+686.660668116" watchObservedRunningTime="2026-09-14 10:36:29.121002758 +0000 UTC m=+686.662404765"
Sep 14 10:36:33.099125 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:33.099099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:36:34.868789 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:34.868753    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"]
Sep 14 10:36:34.872545 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:34.872524    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:34.875278 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:34.875259    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3be523b2-serving-cert\""
Sep 14 10:36:34.883163 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:34.883136    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"]
Sep 14 10:36:34.994611 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:34.994577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4df1926-427e-4c16-8c7a-90812df78ed9-openshift-service-ca\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:34.994611 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:34.994612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpcr5\" (UniqueName: \"kubernetes.io/projected/e4df1926-427e-4c16-8c7a-90812df78ed9-kube-api-access-hpcr5\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:34.994855 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:34.994649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-metrics-certs\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:34.994855 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:34.994700    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-maas-api-tls\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.095284 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.095251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-maas-api-tls\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.095447 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.095357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4df1926-427e-4c16-8c7a-90812df78ed9-openshift-service-ca\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.095447 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.095393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpcr5\" (UniqueName: \"kubernetes.io/projected/e4df1926-427e-4c16-8c7a-90812df78ed9-kube-api-access-hpcr5\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.095447 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:35.095429    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-serving-cert: secret "maas-api-e2e-ait-3be523b2-serving-cert" not found
Sep 14 10:36:35.095590 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.095474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-metrics-certs\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.095590 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:36:35.095494    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-maas-api-tls podName:e4df1926-427e-4c16-8c7a-90812df78ed9 nodeName:}" failed. No retries permitted until 2026-09-14 10:36:35.595474021 +0000 UTC m=+693.136875814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-maas-api-tls") pod "maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw" (UID: "e4df1926-427e-4c16-8c7a-90812df78ed9") : secret "maas-api-e2e-ait-3be523b2-serving-cert" not found
Sep 14 10:36:35.096058 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.096036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4df1926-427e-4c16-8c7a-90812df78ed9-openshift-service-ca\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.098058 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.098040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-metrics-certs\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.106612 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.106593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpcr5\" (UniqueName: \"kubernetes.io/projected/e4df1926-427e-4c16-8c7a-90812df78ed9-kube-api-access-hpcr5\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.111001 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.110984    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:36:35.600429 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.600397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-maas-api-tls\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.602948 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.602921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-maas-api-tls\") pod \"maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:35.785139 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:35.785103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:36.065719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:36.065619    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"]
Sep 14 10:36:36.068493 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:36.068468    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4df1926_427e_4c16_8c7a_90812df78ed9.slice/crio-5cf1e1e7ce5e1894c13d1bafdd8434ceb3479f6660b3ab0998abd3603503838c WatchSource:0}: Error finding container 5cf1e1e7ce5e1894c13d1bafdd8434ceb3479f6660b3ab0998abd3603503838c: Status 404 returned error can't find the container with id 5cf1e1e7ce5e1894c13d1bafdd8434ceb3479f6660b3ab0998abd3603503838c
Sep 14 10:36:36.140085 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:36.140053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw" event={"ID":"e4df1926-427e-4c16-8c7a-90812df78ed9","Type":"ContainerStarted","Data":"5cf1e1e7ce5e1894c13d1bafdd8434ceb3479f6660b3ab0998abd3603503838c"}
Sep 14 10:36:37.146606 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:37.146567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw" event={"ID":"e4df1926-427e-4c16-8c7a-90812df78ed9","Type":"ContainerStarted","Data":"c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653"}
Sep 14 10:36:37.147097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:37.146702    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:37.165004 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:37.164959    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw" podStartSLOduration=2.771786472 podStartE2EDuration="3.164946229s" totalImagesPullingTime="393.159757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:37.16416089 +0000 UTC m=+694.705562729" watchObservedRunningTime="2026-09-14 10:36:37.164946229 +0000 UTC m=+694.706348050"
Sep 14 10:36:39.293631 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.293594    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"]
Sep 14 10:36:39.297756 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.297714    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.300857 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.300818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e9cc98-serving-cert\""
Sep 14 10:36:39.311859 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.311834    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"]
Sep 14 10:36:39.436763 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.436730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee59810-5227-42b6-8bd9-9149e6188d7b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.436763 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.436766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-metrics-certs\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.436964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.436863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.436964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.436880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vzfd\" (UniqueName: \"kubernetes.io/projected/4ee59810-5227-42b6-8bd9-9149e6188d7b-kube-api-access-6vzfd\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.537575 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.537535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee59810-5227-42b6-8bd9-9149e6188d7b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.537575 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.537575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-metrics-certs\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.537826 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.537645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.537826 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.537663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzfd\" (UniqueName: \"kubernetes.io/projected/4ee59810-5227-42b6-8bd9-9149e6188d7b-kube-api-access-6vzfd\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.538263 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.538230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee59810-5227-42b6-8bd9-9149e6188d7b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.540356 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.540330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-metrics-certs\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.540440 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.540382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-maas-api-tls\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.548539 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.548477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzfd\" (UniqueName: \"kubernetes.io/projected/4ee59810-5227-42b6-8bd9-9149e6188d7b-kube-api-access-6vzfd\") pod \"maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.612562 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.612524    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:39.889448 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:39.889422    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"]
Sep 14 10:36:39.891121 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:39.891095    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee59810_5227_42b6_8bd9_9149e6188d7b.slice/crio-3aa0ca02159d3f9a002adce12a8b6b474b7ce5f9bf1e307f1297e9067484da41 WatchSource:0}: Error finding container 3aa0ca02159d3f9a002adce12a8b6b474b7ce5f9bf1e307f1297e9067484da41: Status 404 returned error can't find the container with id 3aa0ca02159d3f9a002adce12a8b6b474b7ce5f9bf1e307f1297e9067484da41
Sep 14 10:36:40.108384 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.108357    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:36:40.163344 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.163259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54" event={"ID":"4ee59810-5227-42b6-8bd9-9149e6188d7b","Type":"ContainerStarted","Data":"3aa0ca02159d3f9a002adce12a8b6b474b7ce5f9bf1e307f1297e9067484da41"}
Sep 14 10:36:40.338103 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.338075    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"]
Sep 14 10:36:40.342817 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.342796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:40.344539 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.344511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6\" (UID: \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:40.344637 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.344625    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnrgc\" (UniqueName: \"kubernetes.io/projected/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-kube-api-access-vnrgc\") pod \"payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6\" (UID: \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:40.345456 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.345432    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-e9cc98\""
Sep 14 10:36:40.345558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.345478    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-e9cc98-dockercfg-b7jsz\""
Sep 14 10:36:40.350398 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.350234    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"]
Sep 14 10:36:40.415999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.415912    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"]
Sep 14 10:36:40.419422 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.419399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:40.430620 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.430565    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"]
Sep 14 10:36:40.446026 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.445981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnrgc\" (UniqueName: \"kubernetes.io/projected/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-kube-api-access-vnrgc\") pod \"payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6\" (UID: \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:40.446026 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.446028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1422ca0c-fc8f-4f27-8156-356725765ffd-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj\" (UID: \"1422ca0c-fc8f-4f27-8156-356725765ffd\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:40.446289 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.446081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94cpw\" (UniqueName: \"kubernetes.io/projected/1422ca0c-fc8f-4f27-8156-356725765ffd-kube-api-access-94cpw\") pod \"payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj\" (UID: \"1422ca0c-fc8f-4f27-8156-356725765ffd\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:40.446289 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.446125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6\" (UID: \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:40.446900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.446878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6\" (UID: \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:40.455540 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.455513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnrgc\" (UniqueName: \"kubernetes.io/projected/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-kube-api-access-vnrgc\") pod \"payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6\" (UID: \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:40.547519 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.547487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1422ca0c-fc8f-4f27-8156-356725765ffd-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj\" (UID: \"1422ca0c-fc8f-4f27-8156-356725765ffd\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:40.547665 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.547539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94cpw\" (UniqueName: \"kubernetes.io/projected/1422ca0c-fc8f-4f27-8156-356725765ffd-kube-api-access-94cpw\") pod \"payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj\" (UID: \"1422ca0c-fc8f-4f27-8156-356725765ffd\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:40.548254 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.548230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1422ca0c-fc8f-4f27-8156-356725765ffd-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj\" (UID: \"1422ca0c-fc8f-4f27-8156-356725765ffd\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:40.557014 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.556987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94cpw\" (UniqueName: \"kubernetes.io/projected/1422ca0c-fc8f-4f27-8156-356725765ffd-kube-api-access-94cpw\") pod \"payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj\" (UID: \"1422ca0c-fc8f-4f27-8156-356725765ffd\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:40.655888 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.655855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:40.733182 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.733151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:40.931825 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:40.931800    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"]
Sep 14 10:36:40.933258 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:40.933234    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c15e653_8cfe_47a8_80a0_69d9936bfdc3.slice/crio-f8f3f112e3e9edb3fa89896de3f2a83d1db617be4c8e4581c774c018dd21b152 WatchSource:0}: Error finding container f8f3f112e3e9edb3fa89896de3f2a83d1db617be4c8e4581c774c018dd21b152: Status 404 returned error can't find the container with id f8f3f112e3e9edb3fa89896de3f2a83d1db617be4c8e4581c774c018dd21b152
Sep 14 10:36:41.015470 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.015450    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"]
Sep 14 10:36:41.018064 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:36:41.018032    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1422ca0c_fc8f_4f27_8156_356725765ffd.slice/crio-b21f878c5366d6fc6c9a6734420a464c6a7bc00e7d46d60b1e73ab436e9b6405 WatchSource:0}: Error finding container b21f878c5366d6fc6c9a6734420a464c6a7bc00e7d46d60b1e73ab436e9b6405: Status 404 returned error can't find the container with id b21f878c5366d6fc6c9a6734420a464c6a7bc00e7d46d60b1e73ab436e9b6405
Sep 14 10:36:41.170663 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.170627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54" event={"ID":"4ee59810-5227-42b6-8bd9-9149e6188d7b","Type":"ContainerStarted","Data":"9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655"}
Sep 14 10:36:41.170853 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.170783    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:41.172318 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.172296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj" event={"ID":"1422ca0c-fc8f-4f27-8156-356725765ffd","Type":"ContainerStarted","Data":"071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454"}
Sep 14 10:36:41.172441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.172331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj" event={"ID":"1422ca0c-fc8f-4f27-8156-356725765ffd","Type":"ContainerStarted","Data":"b21f878c5366d6fc6c9a6734420a464c6a7bc00e7d46d60b1e73ab436e9b6405"}
Sep 14 10:36:41.172441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.172379    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:41.173908 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.173885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6" event={"ID":"2c15e653-8cfe-47a8-80a0-69d9936bfdc3","Type":"ContainerStarted","Data":"f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e"}
Sep 14 10:36:41.174007 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.173924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6" event={"ID":"2c15e653-8cfe-47a8-80a0-69d9936bfdc3","Type":"ContainerStarted","Data":"f8f3f112e3e9edb3fa89896de3f2a83d1db617be4c8e4581c774c018dd21b152"}
Sep 14 10:36:41.174007 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.173961    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:41.212491 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.212396    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54" podStartSLOduration=1.79763955 podStartE2EDuration="2.212380098s" totalImagesPullingTime="414.740548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:41.210387732 +0000 UTC m=+698.751789531" watchObservedRunningTime="2026-09-14 10:36:41.212380098 +0000 UTC m=+698.753781896"
Sep 14 10:36:41.250743 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.250687    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6" podStartSLOduration=1.250653856 podStartE2EDuration="1.250653856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:41.249047213 +0000 UTC m=+698.790449026" watchObservedRunningTime="2026-09-14 10:36:41.250653856 +0000 UTC m=+698.792055657"
Sep 14 10:36:41.270492 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:41.270425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj" podStartSLOduration=1.270401173 podStartE2EDuration="1.270401173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:41.269027495 +0000 UTC m=+698.810429339" watchObservedRunningTime="2026-09-14 10:36:41.270401173 +0000 UTC m=+698.811802993"
Sep 14 10:36:43.156480 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:43.156443    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:36:47.185317 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:47.185285    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:36:50.046200 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:50.046113    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 14 10:36:50.046200 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:50.046185    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 14 10:36:50.221869 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:50.221838    2578 generic.go:356] "Generic (PLEG): container finished" podID="8337f636-aaa5-445b-a337-4bbca91667e8" containerID="1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979" exitCode=0
Sep 14 10:36:50.222029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:50.221903    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" event={"ID":"8337f636-aaa5-445b-a337-4bbca91667e8","Type":"ContainerDied","Data":"1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979"}
Sep 14 10:36:50.222278 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:50.222265    2578 scope.go:117] "RemoveContainer" containerID="1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979"
Sep 14 10:36:50.223781 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:50.223753    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:36:50.223842 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:50.223821    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:36:50.223877 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:50.223853    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:36:51.230307 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:51.230263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" event={"ID":"8337f636-aaa5-445b-a337-4bbca91667e8","Type":"ContainerStarted","Data":"5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5"}
Sep 14 10:36:51.885948 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:51.885911    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:51.886208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:51.886185    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 14 10:36:51.886252 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:51.886234    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 14 10:36:52.181312 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:52.181220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:36:52.181312 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:52.181300    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:36:52.886300 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:52.886263    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 14 10:36:52.886721 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:52.886315    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 14 10:36:53.886550 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:53.886516    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 14 10:36:53.886985 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:53.886579    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 14 10:36:54.886791 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:54.886749    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 14 10:36:54.887195 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:54.886814    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 14 10:36:55.886652 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:55.886617    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 14 10:36:55.886836 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:55.886691    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 14 10:36:56.886718 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:56.886668    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 14 10:36:56.886883 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:56.886746    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 14 10:36:57.890849 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:57.890818    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:57.891203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:57.891190    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:36:57.892047 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:36:57.892024    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:37:01.378229 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.378182    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"]
Sep 14 10:37:01.378719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.378467    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw" podUID="e4df1926-427e-4c16-8c7a-90812df78ed9" containerName="maas-api" containerID="cri-o://c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653" gracePeriod=30
Sep 14 10:37:01.632531 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.632472    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:37:01.744823 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.744792    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpcr5\" (UniqueName: \"kubernetes.io/projected/e4df1926-427e-4c16-8c7a-90812df78ed9-kube-api-access-hpcr5\") pod \"e4df1926-427e-4c16-8c7a-90812df78ed9\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") "
Sep 14 10:37:01.745005 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.744876    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4df1926-427e-4c16-8c7a-90812df78ed9-openshift-service-ca\") pod \"e4df1926-427e-4c16-8c7a-90812df78ed9\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") "
Sep 14 10:37:01.745005 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.744893    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-metrics-certs\") pod \"e4df1926-427e-4c16-8c7a-90812df78ed9\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") "
Sep 14 10:37:01.745005 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.744937    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-maas-api-tls\") pod \"e4df1926-427e-4c16-8c7a-90812df78ed9\" (UID: \"e4df1926-427e-4c16-8c7a-90812df78ed9\") "
Sep 14 10:37:01.745231 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.745203    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4df1926-427e-4c16-8c7a-90812df78ed9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4df1926-427e-4c16-8c7a-90812df78ed9" (UID: "e4df1926-427e-4c16-8c7a-90812df78ed9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:37:01.747303 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.747270    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4df1926-427e-4c16-8c7a-90812df78ed9-kube-api-access-hpcr5" (OuterVolumeSpecName: "kube-api-access-hpcr5") pod "e4df1926-427e-4c16-8c7a-90812df78ed9" (UID: "e4df1926-427e-4c16-8c7a-90812df78ed9"). InnerVolumeSpecName "kube-api-access-hpcr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:37:01.747303 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.747278    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e4df1926-427e-4c16-8c7a-90812df78ed9" (UID: "e4df1926-427e-4c16-8c7a-90812df78ed9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:37:01.747303 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.747292    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4df1926-427e-4c16-8c7a-90812df78ed9" (UID: "e4df1926-427e-4c16-8c7a-90812df78ed9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:37:01.846462 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.846418    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4df1926-427e-4c16-8c7a-90812df78ed9-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:37:01.846462 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.846459    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:37:01.846687 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.846472    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4df1926-427e-4c16-8c7a-90812df78ed9-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:37:01.846687 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:01.846484    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpcr5\" (UniqueName: \"kubernetes.io/projected/e4df1926-427e-4c16-8c7a-90812df78ed9-kube-api-access-hpcr5\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:37:02.306595 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.306559    2578 generic.go:356] "Generic (PLEG): container finished" podID="e4df1926-427e-4c16-8c7a-90812df78ed9" containerID="c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653" exitCode=0
Sep 14 10:37:02.306832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.306603    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"
Sep 14 10:37:02.306832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.306642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw" event={"ID":"e4df1926-427e-4c16-8c7a-90812df78ed9","Type":"ContainerDied","Data":"c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653"}
Sep 14 10:37:02.306832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.306720    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw" event={"ID":"e4df1926-427e-4c16-8c7a-90812df78ed9","Type":"ContainerDied","Data":"5cf1e1e7ce5e1894c13d1bafdd8434ceb3479f6660b3ab0998abd3603503838c"}
Sep 14 10:37:02.306832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.306743    2578 scope.go:117] "RemoveContainer" containerID="c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653"
Sep 14 10:37:02.316514 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.316496    2578 scope.go:117] "RemoveContainer" containerID="c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653"
Sep 14 10:37:02.316803 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:37:02.316785    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653\": container with ID starting with c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653 not found: ID does not exist" containerID="c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653"
Sep 14 10:37:02.316870 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.316813    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653"} err="failed to get container status \"c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653\": rpc error: code = NotFound desc = could not find container \"c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653\": container with ID starting with c9354c8415a6c3668b246c98cab49ebb697b7535bfd1828af2a8bb04a6e7c653 not found: ID does not exist"
Sep 14 10:37:02.330512 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.330484    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"]
Sep 14 10:37:02.340265 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.340232    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3be523b2-8596858f7b-dgjtw"]
Sep 14 10:37:02.978227 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:37:02.978199    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4df1926-427e-4c16-8c7a-90812df78ed9" path="/var/lib/kubelet/pods/e4df1926-427e-4c16-8c7a-90812df78ed9/volumes"
Sep 14 10:38:26.254627 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.254546    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"]
Sep 14 10:38:26.255080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.254960    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4df1926-427e-4c16-8c7a-90812df78ed9" containerName="maas-api"
Sep 14 10:38:26.255080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.254974    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4df1926-427e-4c16-8c7a-90812df78ed9" containerName="maas-api"
Sep 14 10:38:26.255080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.255040    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4df1926-427e-4c16-8c7a-90812df78ed9" containerName="maas-api"
Sep 14 10:38:26.258082 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.258067    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.262140 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.262115    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-30eaba\"/\"kube-root-ca.crt\""
Sep 14 10:38:26.262256 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.262186    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-30eaba\"/\"openshift-service-ca.crt\""
Sep 14 10:38:26.262256 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.262208    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-30eaba\"/\"default-dockercfg-wm2fb\""
Sep 14 10:38:26.262359 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.262186    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-30eaba\"/\"autores-model-30eaba-kserve-self-signed-certs\""
Sep 14 10:38:26.268225 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.268205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"]
Sep 14 10:38:26.286971 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.286946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-model-cache\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.287110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.286988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tmp-dir\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.287110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.287039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-dshm\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.287110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.287074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-home\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.287262 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.287143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tls-certs\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.287262 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.287193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxlbx\" (UniqueName: \"kubernetes.io/projected/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-kube-api-access-pxlbx\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.388195 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.388161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-home\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.388353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.388218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tls-certs\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.388353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.388265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxlbx\" (UniqueName: \"kubernetes.io/projected/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-kube-api-access-pxlbx\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.388353 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.388322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-model-cache\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.388514 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.388352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tmp-dir\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.388514 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.388403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-dshm\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.388613 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.388593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-home\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.388661 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.388645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-model-cache\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.388755 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.388738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tmp-dir\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.390634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.390617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-dshm\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.390823 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.390808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tls-certs\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.397028 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.397005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxlbx\" (UniqueName: \"kubernetes.io/projected/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-kube-api-access-pxlbx\") pod \"autores-model-30eaba-kserve-594d74b4b7-8qzdb\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") " pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.567782 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.567667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:26.842793 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:26.842714    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"]
Sep 14 10:38:26.845226 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:38:26.845197    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73ec8f9a_4e94_41cb_a3e8_e78f869645cd.slice/crio-c6b3fb62f527441a10d22d8ad1179d9cb83a40f926338b43b2400a519c3ac5ad WatchSource:0}: Error finding container c6b3fb62f527441a10d22d8ad1179d9cb83a40f926338b43b2400a519c3ac5ad: Status 404 returned error can't find the container with id c6b3fb62f527441a10d22d8ad1179d9cb83a40f926338b43b2400a519c3ac5ad
Sep 14 10:38:27.750813 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:27.750777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb" event={"ID":"73ec8f9a-4e94-41cb-a3e8-e78f869645cd","Type":"ContainerStarted","Data":"ca5ff1248ff458b5cb02f63f101ff9db131e566329c615c5ae5cc11e890c9c16"}
Sep 14 10:38:27.751265 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:27.750827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb" event={"ID":"73ec8f9a-4e94-41cb-a3e8-e78f869645cd","Type":"ContainerStarted","Data":"c6b3fb62f527441a10d22d8ad1179d9cb83a40f926338b43b2400a519c3ac5ad"}
Sep 14 10:38:27.770780 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:27.770733    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb" podStartSLOduration=1.770718913 podStartE2EDuration="1.770718913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:38:27.769490834 +0000 UTC m=+805.310892658" watchObservedRunningTime="2026-09-14 10:38:27.770718913 +0000 UTC m=+805.312120714"
Sep 14 10:38:36.568754 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:36.568718    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:36.569288 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:36.568975    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:36.581059 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:36.581034    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:36.816772 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:36.816736    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:38:39.266204 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.266169    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"]
Sep 14 10:38:39.269984 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.269961    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:38:39.272460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.272435    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-c62bec51\""
Sep 14 10:38:39.272737 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.272716    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-c62bec51-dockercfg-l2fj2\""
Sep 14 10:38:39.283227 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.283196    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"]
Sep 14 10:38:39.410635 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.410602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lv97\" (UniqueName: \"kubernetes.io/projected/82ed2193-ed2a-481c-afd2-c0ce292f80d3-kube-api-access-4lv97\") pod \"payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq\" (UID: \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\") " pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:38:39.410805 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.410658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ed2193-ed2a-481c-afd2-c0ce292f80d3-plugins-config-volume\") pod \"payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq\" (UID: \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\") " pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:38:39.511461 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.511424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lv97\" (UniqueName: \"kubernetes.io/projected/82ed2193-ed2a-481c-afd2-c0ce292f80d3-kube-api-access-4lv97\") pod \"payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq\" (UID: \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\") " pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:38:39.511632 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.511480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ed2193-ed2a-481c-afd2-c0ce292f80d3-plugins-config-volume\") pod \"payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq\" (UID: \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\") " pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:38:39.512141 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.512122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ed2193-ed2a-481c-afd2-c0ce292f80d3-plugins-config-volume\") pod \"payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq\" (UID: \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\") " pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:38:39.520052 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.519982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lv97\" (UniqueName: \"kubernetes.io/projected/82ed2193-ed2a-481c-afd2-c0ce292f80d3-kube-api-access-4lv97\") pod \"payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq\" (UID: \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\") " pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:38:39.584296 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.584264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:38:39.866528 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:39.866502    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"]
Sep 14 10:38:39.867913 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:38:39.867886    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ed2193_ed2a_481c_afd2_c0ce292f80d3.slice/crio-939c570e93db621b1e5457a1f95d7444a60555246b10100b22d93eecd5370462 WatchSource:0}: Error finding container 939c570e93db621b1e5457a1f95d7444a60555246b10100b22d93eecd5370462: Status 404 returned error can't find the container with id 939c570e93db621b1e5457a1f95d7444a60555246b10100b22d93eecd5370462
Sep 14 10:38:40.825685 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:40.825633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq" event={"ID":"82ed2193-ed2a-481c-afd2-c0ce292f80d3","Type":"ContainerStarted","Data":"ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9"}
Sep 14 10:38:40.826068 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:40.825710    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq" event={"ID":"82ed2193-ed2a-481c-afd2-c0ce292f80d3","Type":"ContainerStarted","Data":"939c570e93db621b1e5457a1f95d7444a60555246b10100b22d93eecd5370462"}
Sep 14 10:38:40.826068 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:40.825740    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:38:40.843629 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:40.843567    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq" podStartSLOduration=1.843545692 podStartE2EDuration="1.843545692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:38:40.843418588 +0000 UTC m=+818.384820391" watchObservedRunningTime="2026-09-14 10:38:40.843545692 +0000 UTC m=+818.384947493"
Sep 14 10:38:51.834356 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:38:51.834322    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:39:09.327248 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.327213    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"]
Sep 14 10:39:09.327835 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.327500    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk" podUID="b1919046-7b0f-4c03-9e23-8f912b54d53c" containerName="maas-api" containerID="cri-o://aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820" gracePeriod=30
Sep 14 10:39:09.579699 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.579603    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"]
Sep 14 10:39:09.579910 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.579865    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq" podUID="82ed2193-ed2a-481c-afd2-c0ce292f80d3" containerName="payload-processing" containerID="cri-o://ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9" gracePeriod=30
Sep 14 10:39:09.585346 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.585311    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:39:09.698939 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.698912    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1919046-7b0f-4c03-9e23-8f912b54d53c-openshift-service-ca\") pod \"b1919046-7b0f-4c03-9e23-8f912b54d53c\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") "
Sep 14 10:39:09.699083 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.698981    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvdrw\" (UniqueName: \"kubernetes.io/projected/b1919046-7b0f-4c03-9e23-8f912b54d53c-kube-api-access-tvdrw\") pod \"b1919046-7b0f-4c03-9e23-8f912b54d53c\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") "
Sep 14 10:39:09.699083 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.699027    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-maas-api-tls\") pod \"b1919046-7b0f-4c03-9e23-8f912b54d53c\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") "
Sep 14 10:39:09.699083 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.699046    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-metrics-certs\") pod \"b1919046-7b0f-4c03-9e23-8f912b54d53c\" (UID: \"b1919046-7b0f-4c03-9e23-8f912b54d53c\") "
Sep 14 10:39:09.699368 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.699333    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1919046-7b0f-4c03-9e23-8f912b54d53c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1919046-7b0f-4c03-9e23-8f912b54d53c" (UID: "b1919046-7b0f-4c03-9e23-8f912b54d53c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:39:09.701227 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.701191    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1919046-7b0f-4c03-9e23-8f912b54d53c" (UID: "b1919046-7b0f-4c03-9e23-8f912b54d53c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:39:09.701227 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.701210    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1919046-7b0f-4c03-9e23-8f912b54d53c-kube-api-access-tvdrw" (OuterVolumeSpecName: "kube-api-access-tvdrw") pod "b1919046-7b0f-4c03-9e23-8f912b54d53c" (UID: "b1919046-7b0f-4c03-9e23-8f912b54d53c"). InnerVolumeSpecName "kube-api-access-tvdrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:39:09.701414 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.701264    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b1919046-7b0f-4c03-9e23-8f912b54d53c" (UID: "b1919046-7b0f-4c03-9e23-8f912b54d53c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:39:09.800389 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.800355    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1919046-7b0f-4c03-9e23-8f912b54d53c-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:09.800389 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.800385    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvdrw\" (UniqueName: \"kubernetes.io/projected/b1919046-7b0f-4c03-9e23-8f912b54d53c-kube-api-access-tvdrw\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:09.800389 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.800396    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:09.800631 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.800404    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1919046-7b0f-4c03-9e23-8f912b54d53c-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:09.832932 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.832912    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:39:09.900985 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.900949    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ed2193-ed2a-481c-afd2-c0ce292f80d3-plugins-config-volume\") pod \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\" (UID: \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\") "
Sep 14 10:39:09.901155 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.901027    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lv97\" (UniqueName: \"kubernetes.io/projected/82ed2193-ed2a-481c-afd2-c0ce292f80d3-kube-api-access-4lv97\") pod \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\" (UID: \"82ed2193-ed2a-481c-afd2-c0ce292f80d3\") "
Sep 14 10:39:09.901425 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.901395    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ed2193-ed2a-481c-afd2-c0ce292f80d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82ed2193-ed2a-481c-afd2-c0ce292f80d3" (UID: "82ed2193-ed2a-481c-afd2-c0ce292f80d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:39:09.903467 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.903439    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ed2193-ed2a-481c-afd2-c0ce292f80d3-kube-api-access-4lv97" (OuterVolumeSpecName: "kube-api-access-4lv97") pod "82ed2193-ed2a-481c-afd2-c0ce292f80d3" (UID: "82ed2193-ed2a-481c-afd2-c0ce292f80d3"). InnerVolumeSpecName "kube-api-access-4lv97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:39:09.994538 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.994507    2578 generic.go:356] "Generic (PLEG): container finished" podID="82ed2193-ed2a-481c-afd2-c0ce292f80d3" containerID="ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9" exitCode=0
Sep 14 10:39:09.994759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.994619    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"
Sep 14 10:39:09.994759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.994650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq" event={"ID":"82ed2193-ed2a-481c-afd2-c0ce292f80d3","Type":"ContainerDied","Data":"ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9"}
Sep 14 10:39:09.994759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.994726    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq" event={"ID":"82ed2193-ed2a-481c-afd2-c0ce292f80d3","Type":"ContainerDied","Data":"939c570e93db621b1e5457a1f95d7444a60555246b10100b22d93eecd5370462"}
Sep 14 10:39:09.994759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.994757    2578 scope.go:117] "RemoveContainer" containerID="ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9"
Sep 14 10:39:09.996146 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.996122    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1919046-7b0f-4c03-9e23-8f912b54d53c" containerID="aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820" exitCode=0
Sep 14 10:39:09.996281 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.996159    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"
Sep 14 10:39:09.996281 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.996156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk" event={"ID":"b1919046-7b0f-4c03-9e23-8f912b54d53c","Type":"ContainerDied","Data":"aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820"}
Sep 14 10:39:09.996398 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:09.996297    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk" event={"ID":"b1919046-7b0f-4c03-9e23-8f912b54d53c","Type":"ContainerDied","Data":"b54730072c4cb6b280c49109340d71ae08e1f18d33d237904c0561f0dc2ce2f8"}
Sep 14 10:39:10.001812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.001786    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ed2193-ed2a-481c-afd2-c0ce292f80d3-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:10.001812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.001810    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lv97\" (UniqueName: \"kubernetes.io/projected/82ed2193-ed2a-481c-afd2-c0ce292f80d3-kube-api-access-4lv97\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:10.005496 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.005478    2578 scope.go:117] "RemoveContainer" containerID="ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9"
Sep 14 10:39:10.005885 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:39:10.005788    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9\": container with ID starting with ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9 not found: ID does not exist" containerID="ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9"
Sep 14 10:39:10.005885 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.005816    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9"} err="failed to get container status \"ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9\": rpc error: code = NotFound desc = could not find container \"ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9\": container with ID starting with ec1901b79f5befbd541587e455312813a3a3508bf57fbdc254960ec49cab2dd9 not found: ID does not exist"
Sep 14 10:39:10.005885 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.005840    2578 scope.go:117] "RemoveContainer" containerID="aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820"
Sep 14 10:39:10.014523 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.014508    2578 scope.go:117] "RemoveContainer" containerID="aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820"
Sep 14 10:39:10.014837 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:39:10.014815    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820\": container with ID starting with aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820 not found: ID does not exist" containerID="aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820"
Sep 14 10:39:10.014879 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.014845    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820"} err="failed to get container status \"aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820\": rpc error: code = NotFound desc = could not find container \"aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820\": container with ID starting with aed95fb25e40c1955c1d1ccc9967c43f71f30040dff561ad5d53374493007820 not found: ID does not exist"
Sep 14 10:39:10.020666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.020641    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"]
Sep 14 10:39:10.024464 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.024441    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-30eaba-6c7479f6d5-kpnfk"]
Sep 14 10:39:10.038432 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.038406    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"]
Sep 14 10:39:10.044939 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.044873    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c62bec51-59c8545577-rmgzq"]
Sep 14 10:39:10.977431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.977397    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ed2193-ed2a-481c-afd2-c0ce292f80d3" path="/var/lib/kubelet/pods/82ed2193-ed2a-481c-afd2-c0ce292f80d3/volumes"
Sep 14 10:39:10.977822 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:10.977814    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1919046-7b0f-4c03-9e23-8f912b54d53c" path="/var/lib/kubelet/pods/b1919046-7b0f-4c03-9e23-8f912b54d53c/volumes"
Sep 14 10:39:14.957613 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:14.957577    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"]
Sep 14 10:39:29.977361 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:29.977310    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb" podUID="73ec8f9a-4e94-41cb-a3e8-e78f869645cd" containerName="main" containerID="cri-o://ca5ff1248ff458b5cb02f63f101ff9db131e566329c615c5ae5cc11e890c9c16" gracePeriod=45
Sep 14 10:39:30.109422 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.109395    2578 generic.go:356] "Generic (PLEG): container finished" podID="73ec8f9a-4e94-41cb-a3e8-e78f869645cd" containerID="ca5ff1248ff458b5cb02f63f101ff9db131e566329c615c5ae5cc11e890c9c16" exitCode=0
Sep 14 10:39:30.109530 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.109469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb" event={"ID":"73ec8f9a-4e94-41cb-a3e8-e78f869645cd","Type":"ContainerDied","Data":"ca5ff1248ff458b5cb02f63f101ff9db131e566329c615c5ae5cc11e890c9c16"}
Sep 14 10:39:30.216136 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.216115    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:39:30.388652 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.388619    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-model-cache\") pod \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") "
Sep 14 10:39:30.388888 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.388657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-home\") pod \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") "
Sep 14 10:39:30.388888 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.388709    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxlbx\" (UniqueName: \"kubernetes.io/projected/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-kube-api-access-pxlbx\") pod \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") "
Sep 14 10:39:30.388888 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.388759    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tls-certs\") pod \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") "
Sep 14 10:39:30.388888 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.388828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-dshm\") pod \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") "
Sep 14 10:39:30.388888 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.388852    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tmp-dir\") pod \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\" (UID: \"73ec8f9a-4e94-41cb-a3e8-e78f869645cd\") "
Sep 14 10:39:30.388888 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.388858    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "73ec8f9a-4e94-41cb-a3e8-e78f869645cd" (UID: "73ec8f9a-4e94-41cb-a3e8-e78f869645cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:39:30.389171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.388964    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-home" (OuterVolumeSpecName: "home") pod "73ec8f9a-4e94-41cb-a3e8-e78f869645cd" (UID: "73ec8f9a-4e94-41cb-a3e8-e78f869645cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:39:30.389171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.389091    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73ec8f9a-4e94-41cb-a3e8-e78f869645cd" (UID: "73ec8f9a-4e94-41cb-a3e8-e78f869645cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:39:30.389265 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.389192    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tmp-dir\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:30.389265 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.389206    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-model-cache\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:30.389265 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.389214    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-home\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:30.390994 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.390969    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-dshm" (OuterVolumeSpecName: "dshm") pod "73ec8f9a-4e94-41cb-a3e8-e78f869645cd" (UID: "73ec8f9a-4e94-41cb-a3e8-e78f869645cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:39:30.391093 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.391052    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-kube-api-access-pxlbx" (OuterVolumeSpecName: "kube-api-access-pxlbx") pod "73ec8f9a-4e94-41cb-a3e8-e78f869645cd" (UID: "73ec8f9a-4e94-41cb-a3e8-e78f869645cd"). InnerVolumeSpecName "kube-api-access-pxlbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:39:30.391093 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.391057    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73ec8f9a-4e94-41cb-a3e8-e78f869645cd" (UID: "73ec8f9a-4e94-41cb-a3e8-e78f869645cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:39:30.490203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.490181    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-dshm\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:30.490203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.490201    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxlbx\" (UniqueName: \"kubernetes.io/projected/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-kube-api-access-pxlbx\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:30.490326 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:30.490211    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73ec8f9a-4e94-41cb-a3e8-e78f869645cd-tls-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:39:31.115304 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:31.115276    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"
Sep 14 10:39:31.115696 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:31.115311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb" event={"ID":"73ec8f9a-4e94-41cb-a3e8-e78f869645cd","Type":"ContainerDied","Data":"c6b3fb62f527441a10d22d8ad1179d9cb83a40f926338b43b2400a519c3ac5ad"}
Sep 14 10:39:31.115696 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:31.115359    2578 scope.go:117] "RemoveContainer" containerID="ca5ff1248ff458b5cb02f63f101ff9db131e566329c615c5ae5cc11e890c9c16"
Sep 14 10:39:31.137459 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:31.137438    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"]
Sep 14 10:39:31.139744 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:31.139711    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-30eaba/autores-model-30eaba-kserve-594d74b4b7-8qzdb"]
Sep 14 10:39:32.976520 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:32.976488    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ec8f9a-4e94-41cb-a3e8-e78f869645cd" path="/var/lib/kubelet/pods/73ec8f9a-4e94-41cb-a3e8-e78f869645cd/volumes"
Sep 14 10:39:53.393214 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393184    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"]
Sep 14 10:39:53.393666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393530    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ec8f9a-4e94-41cb-a3e8-e78f869645cd" containerName="main"
Sep 14 10:39:53.393666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393541    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ec8f9a-4e94-41cb-a3e8-e78f869645cd" containerName="main"
Sep 14 10:39:53.393666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393559    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1919046-7b0f-4c03-9e23-8f912b54d53c" containerName="maas-api"
Sep 14 10:39:53.393666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393564    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1919046-7b0f-4c03-9e23-8f912b54d53c" containerName="maas-api"
Sep 14 10:39:53.393666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393576    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ed2193-ed2a-481c-afd2-c0ce292f80d3" containerName="payload-processing"
Sep 14 10:39:53.393666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393581    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ed2193-ed2a-481c-afd2-c0ce292f80d3" containerName="payload-processing"
Sep 14 10:39:53.393666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393637    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ec8f9a-4e94-41cb-a3e8-e78f869645cd" containerName="main"
Sep 14 10:39:53.393666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393645    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ed2193-ed2a-481c-afd2-c0ce292f80d3" containerName="payload-processing"
Sep 14 10:39:53.393666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.393651    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1919046-7b0f-4c03-9e23-8f912b54d53c" containerName="maas-api"
Sep 14 10:39:53.398433 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.398410    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.402391 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.402363    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e9cc98\"/\"openshift-service-ca.crt\""
Sep 14 10:39:53.403688 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.403648    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e9cc98\"/\"kube-root-ca.crt\""
Sep 14 10:39:53.403863 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.403763    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e9cc98\"/\"default-dockercfg-v7t2n\""
Sep 14 10:39:53.404119 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.404101    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e9cc98\"/\"test-model-e9cc98-kserve-self-signed-certs\""
Sep 14 10:39:53.412375 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.412350    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"]
Sep 14 10:39:53.481002 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.480977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-dshm\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.481102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.481017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-tmp-dir\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.481102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.481093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m7bp\" (UniqueName: \"kubernetes.io/projected/44957459-0986-4571-b77a-935ad81bd6c1-kube-api-access-9m7bp\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.481173 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.481163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-model-cache\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.481222 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.481211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-home\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.481261 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.481243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44957459-0986-4571-b77a-935ad81bd6c1-tls-certs\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.582495 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.582455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m7bp\" (UniqueName: \"kubernetes.io/projected/44957459-0986-4571-b77a-935ad81bd6c1-kube-api-access-9m7bp\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.582495 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.582496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-model-cache\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.582730 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.582534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-home\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.582730 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.582554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44957459-0986-4571-b77a-935ad81bd6c1-tls-certs\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.582730 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.582592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-dshm\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.582730 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.582623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-tmp-dir\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.582961 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.582919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-model-cache\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.583017 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.582963    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-home\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.583280 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.583261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-tmp-dir\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.584970 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.584950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-dshm\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.585250 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.585231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44957459-0986-4571-b77a-935ad81bd6c1-tls-certs\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.591276 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.591256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m7bp\" (UniqueName: \"kubernetes.io/projected/44957459-0986-4571-b77a-935ad81bd6c1-kube-api-access-9m7bp\") pod \"test-model-e9cc98-kserve-5f4d4cc5bc-f56hb\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") " pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:53.733716 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:53.733612    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:39:54.007696 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:54.007561    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"]
Sep 14 10:39:54.009861 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:39:54.009836    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44957459_0986_4571_b77a_935ad81bd6c1.slice/crio-cb72733145a51331ac3624abebe21d1ab998f5d780fb545777d363a9bf4347bc WatchSource:0}: Error finding container cb72733145a51331ac3624abebe21d1ab998f5d780fb545777d363a9bf4347bc: Status 404 returned error can't find the container with id cb72733145a51331ac3624abebe21d1ab998f5d780fb545777d363a9bf4347bc
Sep 14 10:39:54.237076 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:54.237047    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb" event={"ID":"44957459-0986-4571-b77a-935ad81bd6c1","Type":"ContainerStarted","Data":"7dfc113e8775717f17475ef95869c09a3465e7b9703f8ecaf4875cfd0a88f705"}
Sep 14 10:39:54.237234 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:54.237084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb" event={"ID":"44957459-0986-4571-b77a-935ad81bd6c1","Type":"ContainerStarted","Data":"cb72733145a51331ac3624abebe21d1ab998f5d780fb545777d363a9bf4347bc"}
Sep 14 10:39:54.259515 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:39:54.259422    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb" podStartSLOduration=1.259403983 podStartE2EDuration="1.259403983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:39:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:39:54.257714399 +0000 UTC m=+891.799116207" watchObservedRunningTime="2026-09-14 10:39:54.259403983 +0000 UTC m=+891.800805783"
Sep 14 10:40:00.218749 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.218710    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"]
Sep 14 10:40:00.222182 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.222165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:00.224904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.224881    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-cc7bcd-dockercfg-9n5th\""
Sep 14 10:40:00.226526 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.226509    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-cc7bcd\""
Sep 14 10:40:00.231715 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.231694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"]
Sep 14 10:40:00.255181 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.255118    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"]
Sep 14 10:40:00.258522 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.258505    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:00.269612 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.269591    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"]
Sep 14 10:40:00.343765 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.343734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a3bf559-296b-41a5-9371-49aa7d3d343b-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg\" (UID: \"9a3bf559-296b-41a5-9371-49aa7d3d343b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:00.343952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.343782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58346d39-aa38-44c8-9183-2406b37b6ad3-plugins-config-volume\") pod \"payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v\" (UID: \"58346d39-aa38-44c8-9183-2406b37b6ad3\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:00.343952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.343836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-582s8\" (UniqueName: \"kubernetes.io/projected/58346d39-aa38-44c8-9183-2406b37b6ad3-kube-api-access-582s8\") pod \"payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v\" (UID: \"58346d39-aa38-44c8-9183-2406b37b6ad3\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:00.343952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.343909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwnz2\" (UniqueName: \"kubernetes.io/projected/9a3bf559-296b-41a5-9371-49aa7d3d343b-kube-api-access-rwnz2\") pod \"payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg\" (UID: \"9a3bf559-296b-41a5-9371-49aa7d3d343b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:00.444608 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.444571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwnz2\" (UniqueName: \"kubernetes.io/projected/9a3bf559-296b-41a5-9371-49aa7d3d343b-kube-api-access-rwnz2\") pod \"payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg\" (UID: \"9a3bf559-296b-41a5-9371-49aa7d3d343b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:00.444812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.444661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a3bf559-296b-41a5-9371-49aa7d3d343b-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg\" (UID: \"9a3bf559-296b-41a5-9371-49aa7d3d343b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:00.444812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.444777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58346d39-aa38-44c8-9183-2406b37b6ad3-plugins-config-volume\") pod \"payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v\" (UID: \"58346d39-aa38-44c8-9183-2406b37b6ad3\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:00.444934 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.444814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-582s8\" (UniqueName: \"kubernetes.io/projected/58346d39-aa38-44c8-9183-2406b37b6ad3-kube-api-access-582s8\") pod \"payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v\" (UID: \"58346d39-aa38-44c8-9183-2406b37b6ad3\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:00.445344 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.445323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a3bf559-296b-41a5-9371-49aa7d3d343b-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg\" (UID: \"9a3bf559-296b-41a5-9371-49aa7d3d343b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:00.445444 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.445409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58346d39-aa38-44c8-9183-2406b37b6ad3-plugins-config-volume\") pod \"payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v\" (UID: \"58346d39-aa38-44c8-9183-2406b37b6ad3\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:00.453713 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.453664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-582s8\" (UniqueName: \"kubernetes.io/projected/58346d39-aa38-44c8-9183-2406b37b6ad3-kube-api-access-582s8\") pod \"payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v\" (UID: \"58346d39-aa38-44c8-9183-2406b37b6ad3\") " pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:00.454032 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.454015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwnz2\" (UniqueName: \"kubernetes.io/projected/9a3bf559-296b-41a5-9371-49aa7d3d343b-kube-api-access-rwnz2\") pod \"payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg\" (UID: \"9a3bf559-296b-41a5-9371-49aa7d3d343b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:00.533545 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.533477    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:00.569945 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.569901    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:00.808328 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.808304    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"]
Sep 14 10:40:00.809591 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:40:00.809564    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3bf559_296b_41a5_9371_49aa7d3d343b.slice/crio-f3bfd12dbe897d4198fa5f93f207e3edfae27e2443536f411e11f3f8c6e7a1a3 WatchSource:0}: Error finding container f3bfd12dbe897d4198fa5f93f207e3edfae27e2443536f411e11f3f8c6e7a1a3: Status 404 returned error can't find the container with id f3bfd12dbe897d4198fa5f93f207e3edfae27e2443536f411e11f3f8c6e7a1a3
Sep 14 10:40:00.852413 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:40:00.852387    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58346d39_aa38_44c8_9183_2406b37b6ad3.slice/crio-abad612d1cdad2c2a3ff8303c781ae6dccb7e8cdb18acc067fee793e04972287 WatchSource:0}: Error finding container abad612d1cdad2c2a3ff8303c781ae6dccb7e8cdb18acc067fee793e04972287: Status 404 returned error can't find the container with id abad612d1cdad2c2a3ff8303c781ae6dccb7e8cdb18acc067fee793e04972287
Sep 14 10:40:00.853186 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:00.853166    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"]
Sep 14 10:40:01.278625 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:01.278586    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v" event={"ID":"58346d39-aa38-44c8-9183-2406b37b6ad3","Type":"ContainerStarted","Data":"e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61"}
Sep 14 10:40:01.279107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:01.278648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v" event={"ID":"58346d39-aa38-44c8-9183-2406b37b6ad3","Type":"ContainerStarted","Data":"abad612d1cdad2c2a3ff8303c781ae6dccb7e8cdb18acc067fee793e04972287"}
Sep 14 10:40:01.279107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:01.278723    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:01.280772 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:01.280744    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg" event={"ID":"9a3bf559-296b-41a5-9371-49aa7d3d343b","Type":"ContainerStarted","Data":"7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6"}
Sep 14 10:40:01.280895 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:01.280791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg" event={"ID":"9a3bf559-296b-41a5-9371-49aa7d3d343b","Type":"ContainerStarted","Data":"f3bfd12dbe897d4198fa5f93f207e3edfae27e2443536f411e11f3f8c6e7a1a3"}
Sep 14 10:40:01.280895 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:01.280821    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:01.300345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:01.300305    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v" podStartSLOduration=1.300293449 podStartE2EDuration="1.300293449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:40:01.298786243 +0000 UTC m=+898.840188061" watchObservedRunningTime="2026-09-14 10:40:01.300293449 +0000 UTC m=+898.841695249"
Sep 14 10:40:01.319023 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:01.318973    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg" podStartSLOduration=1.318956716 podStartE2EDuration="1.318956716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:40:01.317376157 +0000 UTC m=+898.858777960" watchObservedRunningTime="2026-09-14 10:40:01.318956716 +0000 UTC m=+898.860358518"
Sep 14 10:40:03.734146 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:03.734110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:40:03.734146 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:03.734151    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:40:03.746252 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:03.746225    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:40:04.307455 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:04.307423    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:40:12.288731 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:12.288698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:40:12.289201 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:12.288785    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:40:46.595645 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.595610    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"]
Sep 14 10:40:46.599268 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.599243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.602686 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.602648    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-34925ca5-openshift-default-dockercfg-mq88d\""
Sep 14 10:40:46.617505 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.617478    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"]
Sep 14 10:40:46.635295 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.635267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-envoy\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.635402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.635297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-credential-socket\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.635402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.635324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-podinfo\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.635402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.635380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-data\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.635506 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.635415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-certs\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.635506 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.635461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-socket\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.635506 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.635491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8m5q\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-kube-api-access-h8m5q\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.635597 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.635511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c9c221-5694-4d13-8a03-ef586c93897f-istiod-ca-cert\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.635597 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.635527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-token\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737084 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-podinfo\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737273 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-data\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737273 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-certs\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-socket\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8m5q\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-kube-api-access-h8m5q\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c9c221-5694-4d13-8a03-ef586c93897f-istiod-ca-cert\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737555 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-token\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737555 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-envoy\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737555 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-credential-socket\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.737969 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-data\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.738120 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.737949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-socket\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.738120 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.738056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-credential-socket\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.738231 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.738145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-certs\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.738382 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.738361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c9c221-5694-4d13-8a03-ef586c93897f-istiod-ca-cert\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.739868 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.739841    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-envoy\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.739963 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.739931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-podinfo\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.745933 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.745906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-token\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.746143 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.746123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8m5q\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-kube-api-access-h8m5q\") pod \"e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") " pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:46.909564 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:46.909466    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:47.218898 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:47.218862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"]
Sep 14 10:40:47.220250 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:40:47.220224    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c9c221_5694_4d13_8a03_ef586c93897f.slice/crio-6258a42643b4862b179918557a1a35f125579dca4c97a22b9e98817a059597ae WatchSource:0}: Error finding container 6258a42643b4862b179918557a1a35f125579dca4c97a22b9e98817a059597ae: Status 404 returned error can't find the container with id 6258a42643b4862b179918557a1a35f125579dca4c97a22b9e98817a059597ae
Sep 14 10:40:47.222649 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:47.222610    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:40:47.222786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:47.222764    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:40:47.222832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:47.222815    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:40:47.526179 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:47.526099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" event={"ID":"b6c9c221-5694-4d13-8a03-ef586c93897f","Type":"ContainerStarted","Data":"13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580"}
Sep 14 10:40:47.526179 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:47.526146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" event={"ID":"b6c9c221-5694-4d13-8a03-ef586c93897f","Type":"ContainerStarted","Data":"6258a42643b4862b179918557a1a35f125579dca4c97a22b9e98817a059597ae"}
Sep 14 10:40:47.551141 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:47.551085    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" podStartSLOduration=1.551065864 podStartE2EDuration="1.551065864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:40:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:40:47.546841049 +0000 UTC m=+945.088242850" watchObservedRunningTime="2026-09-14 10:40:47.551065864 +0000 UTC m=+945.092467666"
Sep 14 10:40:47.910459 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:47.910429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:48.915640 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:48.915611    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:49.536528 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:49.536497    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:40:49.537500 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:40:49.537484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:41:27.738212 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:27.738179    2578 generic.go:356] "Generic (PLEG): container finished" podID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerID="13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580" exitCode=0
Sep 14 10:41:27.738636 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:27.738216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" event={"ID":"b6c9c221-5694-4d13-8a03-ef586c93897f","Type":"ContainerDied","Data":"13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580"}
Sep 14 10:41:27.738636 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:27.738569    2578 scope.go:117] "RemoveContainer" containerID="13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580"
Sep 14 10:41:27.739650 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:27.739621    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:41:27.739772 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:27.739703    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:41:27.739772 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:27.739734    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:41:28.745421 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:28.745388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" event={"ID":"b6c9c221-5694-4d13-8a03-ef586c93897f","Type":"ContainerStarted","Data":"e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935"}
Sep 14 10:41:28.910659 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:28.910624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:41:28.910851 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:28.910829    2578 patch_prober.go:28] interesting pod/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 14 10:41:28.910901 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:28.910879    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 14 10:41:29.909884 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:29.909851    2578 patch_prober.go:28] interesting pod/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 14 10:41:29.910292 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:29.909915    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 14 10:41:30.910058 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:30.910025    2578 patch_prober.go:28] interesting pod/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 14 10:41:30.910443 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:30.910091    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 14 10:41:31.910121 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:31.910091    2578 patch_prober.go:28] interesting pod/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 14 10:41:31.910538 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:31.910156    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 14 10:41:32.910053 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:32.910012    2578 patch_prober.go:28] interesting pod/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 14 10:41:32.910226 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:32.910076    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 14 10:41:33.913651 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:33.913619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:41:33.914040 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:33.913891    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:41:33.914511 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:33.914490    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:41:35.360496 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.360466    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"]
Sep 14 10:41:35.360980 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.360740    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v" podUID="58346d39-aa38-44c8-9183-2406b37b6ad3" containerName="payload-processing" containerID="cri-o://e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61" gracePeriod=30
Sep 14 10:41:35.368734 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.368701    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"]
Sep 14 10:41:35.368959 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.368927    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg" podUID="9a3bf559-296b-41a5-9371-49aa7d3d343b" containerName="payload-pre-processing" containerID="cri-o://7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6" gracePeriod=30
Sep 14 10:41:35.623827 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.623768    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:41:35.644419 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.644396    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:41:35.688048 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.688014    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-582s8\" (UniqueName: \"kubernetes.io/projected/58346d39-aa38-44c8-9183-2406b37b6ad3-kube-api-access-582s8\") pod \"58346d39-aa38-44c8-9183-2406b37b6ad3\" (UID: \"58346d39-aa38-44c8-9183-2406b37b6ad3\") "
Sep 14 10:41:35.688262 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.688097    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwnz2\" (UniqueName: \"kubernetes.io/projected/9a3bf559-296b-41a5-9371-49aa7d3d343b-kube-api-access-rwnz2\") pod \"9a3bf559-296b-41a5-9371-49aa7d3d343b\" (UID: \"9a3bf559-296b-41a5-9371-49aa7d3d343b\") "
Sep 14 10:41:35.688262 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.688179    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a3bf559-296b-41a5-9371-49aa7d3d343b-plugins-config-volume\") pod \"9a3bf559-296b-41a5-9371-49aa7d3d343b\" (UID: \"9a3bf559-296b-41a5-9371-49aa7d3d343b\") "
Sep 14 10:41:35.688649 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.688264    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58346d39-aa38-44c8-9183-2406b37b6ad3-plugins-config-volume\") pod \"58346d39-aa38-44c8-9183-2406b37b6ad3\" (UID: \"58346d39-aa38-44c8-9183-2406b37b6ad3\") "
Sep 14 10:41:35.688983 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.688959    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58346d39-aa38-44c8-9183-2406b37b6ad3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58346d39-aa38-44c8-9183-2406b37b6ad3" (UID: "58346d39-aa38-44c8-9183-2406b37b6ad3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:41:35.689087 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.688999    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a3bf559-296b-41a5-9371-49aa7d3d343b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a3bf559-296b-41a5-9371-49aa7d3d343b" (UID: "9a3bf559-296b-41a5-9371-49aa7d3d343b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:41:35.691337 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.691316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a3bf559-296b-41a5-9371-49aa7d3d343b-kube-api-access-rwnz2" (OuterVolumeSpecName: "kube-api-access-rwnz2") pod "9a3bf559-296b-41a5-9371-49aa7d3d343b" (UID: "9a3bf559-296b-41a5-9371-49aa7d3d343b"). InnerVolumeSpecName "kube-api-access-rwnz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:41:35.691433 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.691404    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58346d39-aa38-44c8-9183-2406b37b6ad3-kube-api-access-582s8" (OuterVolumeSpecName: "kube-api-access-582s8") pod "58346d39-aa38-44c8-9183-2406b37b6ad3" (UID: "58346d39-aa38-44c8-9183-2406b37b6ad3"). InnerVolumeSpecName "kube-api-access-582s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:41:35.789348 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.789321    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a3bf559-296b-41a5-9371-49aa7d3d343b-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:35.789348 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.789346    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58346d39-aa38-44c8-9183-2406b37b6ad3-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:35.789348 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.789362    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-582s8\" (UniqueName: \"kubernetes.io/projected/58346d39-aa38-44c8-9183-2406b37b6ad3-kube-api-access-582s8\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:35.789348 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.789371    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwnz2\" (UniqueName: \"kubernetes.io/projected/9a3bf559-296b-41a5-9371-49aa7d3d343b-kube-api-access-rwnz2\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:35.793132 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.793107    2578 generic.go:356] "Generic (PLEG): container finished" podID="58346d39-aa38-44c8-9183-2406b37b6ad3" containerID="e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61" exitCode=0
Sep 14 10:41:35.793218 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.793159    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"
Sep 14 10:41:35.793309 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.793203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v" event={"ID":"58346d39-aa38-44c8-9183-2406b37b6ad3","Type":"ContainerDied","Data":"e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61"}
Sep 14 10:41:35.793309 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.793269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v" event={"ID":"58346d39-aa38-44c8-9183-2406b37b6ad3","Type":"ContainerDied","Data":"abad612d1cdad2c2a3ff8303c781ae6dccb7e8cdb18acc067fee793e04972287"}
Sep 14 10:41:35.793309 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.793305    2578 scope.go:117] "RemoveContainer" containerID="e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61"
Sep 14 10:41:35.794483 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.794442    2578 generic.go:356] "Generic (PLEG): container finished" podID="9a3bf559-296b-41a5-9371-49aa7d3d343b" containerID="7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6" exitCode=0
Sep 14 10:41:35.794483 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.794479    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"
Sep 14 10:41:35.794613 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.794527    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg" event={"ID":"9a3bf559-296b-41a5-9371-49aa7d3d343b","Type":"ContainerDied","Data":"7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6"}
Sep 14 10:41:35.794613 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.794578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg" event={"ID":"9a3bf559-296b-41a5-9371-49aa7d3d343b","Type":"ContainerDied","Data":"f3bfd12dbe897d4198fa5f93f207e3edfae27e2443536f411e11f3f8c6e7a1a3"}
Sep 14 10:41:35.803085 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.803068    2578 scope.go:117] "RemoveContainer" containerID="e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61"
Sep 14 10:41:35.803355 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:41:35.803330    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61\": container with ID starting with e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61 not found: ID does not exist" containerID="e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61"
Sep 14 10:41:35.803479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.803365    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61"} err="failed to get container status \"e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61\": rpc error: code = NotFound desc = could not find container \"e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61\": container with ID starting with e5f7db5441d0adc7005fab7c6fa2b1a7e50bd62ac846f765c6c14c0598ca4e61 not found: ID does not exist"
Sep 14 10:41:35.803479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.803386    2578 scope.go:117] "RemoveContainer" containerID="7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6"
Sep 14 10:41:35.811749 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.811734    2578 scope.go:117] "RemoveContainer" containerID="7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6"
Sep 14 10:41:35.811997 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:41:35.811980    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6\": container with ID starting with 7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6 not found: ID does not exist" containerID="7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6"
Sep 14 10:41:35.812058 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.812001    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6"} err="failed to get container status \"7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6\": rpc error: code = NotFound desc = could not find container \"7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6\": container with ID starting with 7f95afd7ef020f237f349710b43b7995971205cf25926d4634a68dd51f789cd6 not found: ID does not exist"
Sep 14 10:41:35.821421 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.821397    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"]
Sep 14 10:41:35.826076 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.826047    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cc7bcd-f48d7657-8gg9v"]
Sep 14 10:41:35.836317 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.836300    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"]
Sep 14 10:41:35.839031 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:35.839011    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cc7bcd-68cc856686-rvmsg"]
Sep 14 10:41:36.977417 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:36.977387    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58346d39-aa38-44c8-9183-2406b37b6ad3" path="/var/lib/kubelet/pods/58346d39-aa38-44c8-9183-2406b37b6ad3/volumes"
Sep 14 10:41:36.977807 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:36.977770    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a3bf559-296b-41a5-9371-49aa7d3d343b" path="/var/lib/kubelet/pods/9a3bf559-296b-41a5-9371-49aa7d3d343b/volumes"
Sep 14 10:41:47.932832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:47.932791    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"]
Sep 14 10:41:47.933248 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:47.933009    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy" containerID="cri-o://e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935" gracePeriod=30
Sep 14 10:41:48.916659 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:48.916621    2578 patch_prober.go:28] interesting pod/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:41:48.916850 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:48.916706    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:41:53.174436 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.174406    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:41:53.244381 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c9c221-5694-4d13-8a03-ef586c93897f-istiod-ca-cert\") pod \"b6c9c221-5694-4d13-8a03-ef586c93897f\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") "
Sep 14 10:41:53.244381 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244347    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-certs\") pod \"b6c9c221-5694-4d13-8a03-ef586c93897f\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") "
Sep 14 10:41:53.244381 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-envoy\") pod \"b6c9c221-5694-4d13-8a03-ef586c93897f\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") "
Sep 14 10:41:53.244643 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244430    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-credential-socket\") pod \"b6c9c221-5694-4d13-8a03-ef586c93897f\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") "
Sep 14 10:41:53.244643 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244465    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-token\") pod \"b6c9c221-5694-4d13-8a03-ef586c93897f\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") "
Sep 14 10:41:53.244643 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-podinfo\") pod \"b6c9c221-5694-4d13-8a03-ef586c93897f\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") "
Sep 14 10:41:53.244643 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244536    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-data\") pod \"b6c9c221-5694-4d13-8a03-ef586c93897f\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") "
Sep 14 10:41:53.244643 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244564    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-socket\") pod \"b6c9c221-5694-4d13-8a03-ef586c93897f\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") "
Sep 14 10:41:53.244643 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244588    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8m5q\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-kube-api-access-h8m5q\") pod \"b6c9c221-5694-4d13-8a03-ef586c93897f\" (UID: \"b6c9c221-5694-4d13-8a03-ef586c93897f\") "
Sep 14 10:41:53.244952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244786    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6c9c221-5694-4d13-8a03-ef586c93897f" (UID: "b6c9c221-5694-4d13-8a03-ef586c93897f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:41:53.244952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244807    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6c9c221-5694-4d13-8a03-ef586c93897f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6c9c221-5694-4d13-8a03-ef586c93897f" (UID: "b6c9c221-5694-4d13-8a03-ef586c93897f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:41:53.244952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244816    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6c9c221-5694-4d13-8a03-ef586c93897f" (UID: "b6c9c221-5694-4d13-8a03-ef586c93897f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:41:53.244952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244948    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c9c221-5694-4d13-8a03-ef586c93897f-istiod-ca-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:53.245114 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244968    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:53.245114 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.244982    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-credential-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:53.245114 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.245001    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6c9c221-5694-4d13-8a03-ef586c93897f" (UID: "b6c9c221-5694-4d13-8a03-ef586c93897f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:41:53.245114 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.245020    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6c9c221-5694-4d13-8a03-ef586c93897f" (UID: "b6c9c221-5694-4d13-8a03-ef586c93897f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:41:53.246793 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.246769    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6c9c221-5694-4d13-8a03-ef586c93897f" (UID: "b6c9c221-5694-4d13-8a03-ef586c93897f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:41:53.246898 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.246841    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-kube-api-access-h8m5q" (OuterVolumeSpecName: "kube-api-access-h8m5q") pod "b6c9c221-5694-4d13-8a03-ef586c93897f" (UID: "b6c9c221-5694-4d13-8a03-ef586c93897f"). InnerVolumeSpecName "kube-api-access-h8m5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:41:53.247282 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.247263    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6c9c221-5694-4d13-8a03-ef586c93897f" (UID: "b6c9c221-5694-4d13-8a03-ef586c93897f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:41:53.247391 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.247271    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6c9c221-5694-4d13-8a03-ef586c93897f" (UID: "b6c9c221-5694-4d13-8a03-ef586c93897f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:41:53.345780 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.345754    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-envoy\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:53.345780 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.345776    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-token\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:53.345780 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.345784    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-podinfo\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:53.345994 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.345793    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-istio-data\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:53.345994 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.345802    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c9c221-5694-4d13-8a03-ef586c93897f-workload-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:53.345994 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.345810    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8m5q\" (UniqueName: \"kubernetes.io/projected/b6c9c221-5694-4d13-8a03-ef586c93897f-kube-api-access-h8m5q\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:41:53.900507 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.900473    2578 generic.go:356] "Generic (PLEG): container finished" podID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerID="e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935" exitCode=0
Sep 14 10:41:53.900682 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.900519    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"
Sep 14 10:41:53.900682 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.900555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" event={"ID":"b6c9c221-5694-4d13-8a03-ef586c93897f","Type":"ContainerDied","Data":"e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935"}
Sep 14 10:41:53.900682 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.900616    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw" event={"ID":"b6c9c221-5694-4d13-8a03-ef586c93897f","Type":"ContainerDied","Data":"6258a42643b4862b179918557a1a35f125579dca4c97a22b9e98817a059597ae"}
Sep 14 10:41:53.900682 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.900646    2578 scope.go:117] "RemoveContainer" containerID="e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935"
Sep 14 10:41:53.910248 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.910233    2578 scope.go:117] "RemoveContainer" containerID="13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580"
Sep 14 10:41:53.917976 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.917958    2578 scope.go:117] "RemoveContainer" containerID="e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935"
Sep 14 10:41:53.918216 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:41:53.918200    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935\": container with ID starting with e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935 not found: ID does not exist" containerID="e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935"
Sep 14 10:41:53.918258 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.918225    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935"} err="failed to get container status \"e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935\": rpc error: code = NotFound desc = could not find container \"e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935\": container with ID starting with e96ed26733c7bb147cb5a2a466b60ce938e1d939476376597d7a69578b2e1935 not found: ID does not exist"
Sep 14 10:41:53.918258 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.918241    2578 scope.go:117] "RemoveContainer" containerID="13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580"
Sep 14 10:41:53.918507 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:41:53.918488    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580\": container with ID starting with 13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580 not found: ID does not exist" containerID="13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580"
Sep 14 10:41:53.918542 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.918513    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580"} err="failed to get container status \"13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580\": rpc error: code = NotFound desc = could not find container \"13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580\": container with ID starting with 13da9ff77499c835a55502c9018d13da4cffd6584dd5fa43ae55098fb37f4580 not found: ID does not exist"
Sep 14 10:41:53.927850 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.927831    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"]
Sep 14 10:41:53.931655 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:53.931636    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-34925ca5-openshift-default-7d4b568588-qzjbw"]
Sep 14 10:41:54.976655 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:41:54.976625    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" path="/var/lib/kubelet/pods/b6c9c221-5694-4d13-8a03-ef586c93897f/volumes"
Sep 14 10:42:01.734740 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.734704    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"]
Sep 14 10:42:01.735209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735193    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy"
Sep 14 10:42:01.735255 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735212    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy"
Sep 14 10:42:01.735255 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735227    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a3bf559-296b-41a5-9371-49aa7d3d343b" containerName="payload-pre-processing"
Sep 14 10:42:01.735255 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735233    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a3bf559-296b-41a5-9371-49aa7d3d343b" containerName="payload-pre-processing"
Sep 14 10:42:01.735255 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735249    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58346d39-aa38-44c8-9183-2406b37b6ad3" containerName="payload-processing"
Sep 14 10:42:01.735255 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735254    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="58346d39-aa38-44c8-9183-2406b37b6ad3" containerName="payload-processing"
Sep 14 10:42:01.735407 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735311    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy"
Sep 14 10:42:01.735407 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735318    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="58346d39-aa38-44c8-9183-2406b37b6ad3" containerName="payload-processing"
Sep 14 10:42:01.735407 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735326    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy"
Sep 14 10:42:01.735407 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.735331    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a3bf559-296b-41a5-9371-49aa7d3d343b" containerName="payload-pre-processing"
Sep 14 10:42:01.738492 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.738474    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:01.741751 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.741730    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-3503d7-openshift-default-dockercfg-blx77\""
Sep 14 10:42:01.752601 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.752575    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"]
Sep 14 10:42:01.920905 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.920869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-token\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:01.921102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.920911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-credential-socket\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:01.921102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.920929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s5nv\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-kube-api-access-7s5nv\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:01.921102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.920980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-certs\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:01.921102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.921043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-data\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:01.921102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.921068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-envoy\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:01.921102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.921086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-socket\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:01.921102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.921115    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-podinfo\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:01.921392 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:01.921168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istiod-ca-cert\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022103 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-token\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022103 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-credential-socket\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022103 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s5nv\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-kube-api-access-7s5nv\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022103 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-certs\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022385 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-data\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022385 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-envoy\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022385 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-socket\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022385 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-podinfo\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022385 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istiod-ca-cert\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022638 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-credential-socket\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022638 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-certs\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022638 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022604    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-data\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022826 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-socket\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.022929 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.022914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istiod-ca-cert\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.024741 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.024718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-envoy\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.024851 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.024807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-podinfo\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.035996 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.035976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s5nv\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-kube-api-access-7s5nv\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.035996 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.035982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-token\") pod \"e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") " pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.049184 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.049160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:02.326768 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.326743    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"]
Sep 14 10:42:02.328412 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:42:02.328385    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3e6f5c_b9be_4aa7_b9c1_a96246737695.slice/crio-75b7de3ee48feac747b2524c80f38c743c15a61be694a454f1a6c3b54b8d09be WatchSource:0}: Error finding container 75b7de3ee48feac747b2524c80f38c743c15a61be694a454f1a6c3b54b8d09be: Status 404 returned error can't find the container with id 75b7de3ee48feac747b2524c80f38c743c15a61be694a454f1a6c3b54b8d09be
Sep 14 10:42:02.330489 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.330456    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:42:02.330541 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.330524    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:42:02.330578 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.330559    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:42:02.951082 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.951050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" event={"ID":"3e3e6f5c-b9be-4aa7-b9c1-a96246737695","Type":"ContainerStarted","Data":"bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7"}
Sep 14 10:42:02.951548 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.951101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" event={"ID":"3e3e6f5c-b9be-4aa7-b9c1-a96246737695","Type":"ContainerStarted","Data":"75b7de3ee48feac747b2524c80f38c743c15a61be694a454f1a6c3b54b8d09be"}
Sep 14 10:42:02.981610 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:02.977399    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" podStartSLOduration=1.977361985 podStartE2EDuration="1.977361985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:42:02.977319878 +0000 UTC m=+1020.518721679" watchObservedRunningTime="2026-09-14 10:42:02.977361985 +0000 UTC m=+1020.518763778"
Sep 14 10:42:03.049628 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:03.049594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:03.051295 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:03.051269    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 14 10:42:03.051398 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:03.051325    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 14 10:42:04.054600 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:04.054572    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:04.961600 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:04.961562    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:04.962626 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:04.962605    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:09.018199 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.018167    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"]
Sep 14 10:42:09.018561 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.018541    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy"
Sep 14 10:42:09.018561 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.018551    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c9c221-5694-4d13-8a03-ef586c93897f" containerName="istio-proxy"
Sep 14 10:42:09.023093 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.023069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:09.026140 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.026121    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-3503d7-dockercfg-h2n6b\""
Sep 14 10:42:09.026312 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.026299    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-3503d7\""
Sep 14 10:42:09.037843 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.037810    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"]
Sep 14 10:42:09.041785 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.041756    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"]
Sep 14 10:42:09.046771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.046750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:09.055332 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.055303    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"]
Sep 14 10:42:09.085401 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.085375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw957\" (UniqueName: \"kubernetes.io/projected/7b09935f-0b31-43ec-ac8e-6d40494b1920-kube-api-access-zw957\") pod \"payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl\" (UID: \"7b09935f-0b31-43ec-ac8e-6d40494b1920\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:09.085401 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.085405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9kl6\" (UniqueName: \"kubernetes.io/projected/6e54a454-396b-4fae-b739-dad6462e51a1-kube-api-access-s9kl6\") pod \"payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5\" (UID: \"6e54a454-396b-4fae-b739-dad6462e51a1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:09.085614 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.085425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b09935f-0b31-43ec-ac8e-6d40494b1920-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl\" (UID: \"7b09935f-0b31-43ec-ac8e-6d40494b1920\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:09.085614 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.085580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e54a454-396b-4fae-b739-dad6462e51a1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5\" (UID: \"6e54a454-396b-4fae-b739-dad6462e51a1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:09.186115 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.186083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw957\" (UniqueName: \"kubernetes.io/projected/7b09935f-0b31-43ec-ac8e-6d40494b1920-kube-api-access-zw957\") pod \"payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl\" (UID: \"7b09935f-0b31-43ec-ac8e-6d40494b1920\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:09.186115 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.186123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9kl6\" (UniqueName: \"kubernetes.io/projected/6e54a454-396b-4fae-b739-dad6462e51a1-kube-api-access-s9kl6\") pod \"payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5\" (UID: \"6e54a454-396b-4fae-b739-dad6462e51a1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:09.186373 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.186296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b09935f-0b31-43ec-ac8e-6d40494b1920-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl\" (UID: \"7b09935f-0b31-43ec-ac8e-6d40494b1920\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:09.186439 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.186424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e54a454-396b-4fae-b739-dad6462e51a1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5\" (UID: \"6e54a454-396b-4fae-b739-dad6462e51a1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:09.186979 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.186962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b09935f-0b31-43ec-ac8e-6d40494b1920-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl\" (UID: \"7b09935f-0b31-43ec-ac8e-6d40494b1920\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:09.187090 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.187073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e54a454-396b-4fae-b739-dad6462e51a1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5\" (UID: \"6e54a454-396b-4fae-b739-dad6462e51a1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:09.194308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.194280    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw957\" (UniqueName: \"kubernetes.io/projected/7b09935f-0b31-43ec-ac8e-6d40494b1920-kube-api-access-zw957\") pod \"payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl\" (UID: \"7b09935f-0b31-43ec-ac8e-6d40494b1920\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:09.194423 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.194365    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9kl6\" (UniqueName: \"kubernetes.io/projected/6e54a454-396b-4fae-b739-dad6462e51a1-kube-api-access-s9kl6\") pod \"payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5\" (UID: \"6e54a454-396b-4fae-b739-dad6462e51a1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:09.334566 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.334537    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:09.359606 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.359573    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:09.609283 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.609257    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"]
Sep 14 10:42:09.610492 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:42:09.610469    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b09935f_0b31_43ec_ac8e_6d40494b1920.slice/crio-2121ca3a788b73e31bdafcb5a251521a78a872b02ecb2e9db148cfd1bb129563 WatchSource:0}: Error finding container 2121ca3a788b73e31bdafcb5a251521a78a872b02ecb2e9db148cfd1bb129563: Status 404 returned error can't find the container with id 2121ca3a788b73e31bdafcb5a251521a78a872b02ecb2e9db148cfd1bb129563
Sep 14 10:42:09.644046 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.643886    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"]
Sep 14 10:42:09.644958 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:42:09.644936    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e54a454_396b_4fae_b739_dad6462e51a1.slice/crio-7c0aac6bdc04fc097abf556c37c61b542e684612f7de8c5458419577a6a298f8 WatchSource:0}: Error finding container 7c0aac6bdc04fc097abf556c37c61b542e684612f7de8c5458419577a6a298f8: Status 404 returned error can't find the container with id 7c0aac6bdc04fc097abf556c37c61b542e684612f7de8c5458419577a6a298f8
Sep 14 10:42:09.989260 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.989167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl" event={"ID":"7b09935f-0b31-43ec-ac8e-6d40494b1920","Type":"ContainerStarted","Data":"7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100"}
Sep 14 10:42:09.989260 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.989232    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl" event={"ID":"7b09935f-0b31-43ec-ac8e-6d40494b1920","Type":"ContainerStarted","Data":"2121ca3a788b73e31bdafcb5a251521a78a872b02ecb2e9db148cfd1bb129563"}
Sep 14 10:42:09.989500 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.989264    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:09.990979 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.990953    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5" event={"ID":"6e54a454-396b-4fae-b739-dad6462e51a1","Type":"ContainerStarted","Data":"6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375"}
Sep 14 10:42:09.991087 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.991000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5" event={"ID":"6e54a454-396b-4fae-b739-dad6462e51a1","Type":"ContainerStarted","Data":"7c0aac6bdc04fc097abf556c37c61b542e684612f7de8c5458419577a6a298f8"}
Sep 14 10:42:09.991087 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:09.991029    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:10.007510 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:10.007468    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl" podStartSLOduration=2.007456328 podStartE2EDuration="2.007456328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:42:10.005784104 +0000 UTC m=+1027.547185926" watchObservedRunningTime="2026-09-14 10:42:10.007456328 +0000 UTC m=+1027.548858161"
Sep 14 10:42:10.028936 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:10.028888    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5" podStartSLOduration=1.028858651 podStartE2EDuration="1.028858651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:42:10.025444859 +0000 UTC m=+1027.566846660" watchObservedRunningTime="2026-09-14 10:42:10.028858651 +0000 UTC m=+1027.570260451"
Sep 14 10:42:20.997492 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:20.997462    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:42:20.997876 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:20.997696    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:42:32.112952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:32.112921    2578 generic.go:356] "Generic (PLEG): container finished" podID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerID="bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7" exitCode=0
Sep 14 10:42:32.113434 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:32.112968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" event={"ID":"3e3e6f5c-b9be-4aa7-b9c1-a96246737695","Type":"ContainerDied","Data":"bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7"}
Sep 14 10:42:32.113434 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:32.113338    2578 scope.go:117] "RemoveContainer" containerID="bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7"
Sep 14 10:42:32.114487 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:32.114456    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:42:32.114587 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:32.114543    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:42:32.114650 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:32.114588    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:42:33.124434 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:33.124389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" event={"ID":"3e3e6f5c-b9be-4aa7-b9c1-a96246737695","Type":"ContainerStarted","Data":"299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a"}
Sep 14 10:42:34.049437 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:34.049403    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:34.050461 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:34.050435    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 14 10:42:34.050597 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:34.050483    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 14 10:42:34.966187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:34.966124    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:35.050397 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.050366    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 14 10:42:35.050554 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.050418    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 14 10:42:35.560004 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.559964    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"]
Sep 14 10:42:35.563219 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.563192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.566196 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.566170    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-558928-openshift-default-dockercfg-8zf4d\""
Sep 14 10:42:35.583955 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.583927    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"]
Sep 14 10:42:35.633200 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.633158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-token\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.633485 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.633462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-credential-socket\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.633622 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.633604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-podinfo\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.633758 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.633741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4dc0fb2-a477-4954-9105-b9f105254cf1-istiod-ca-cert\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.633911 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.633893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-certs\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.634032 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.634016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-data\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.634168 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.634151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-envoy\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.634323 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.634307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-socket\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.634435 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.634419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85br6\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-kube-api-access-85br6\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.735616 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.735573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-socket\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.735834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.735625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85br6\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-kube-api-access-85br6\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.735834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.735717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-token\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.735834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.735763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-credential-socket\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.735834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.735798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-podinfo\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.735834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.735826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4dc0fb2-a477-4954-9105-b9f105254cf1-istiod-ca-cert\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.736116 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.735877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-certs\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.736116 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.735900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-data\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.736116 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.735944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-envoy\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.736790 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.736763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-credential-socket\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.737030 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.737008    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-socket\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.737122 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.737100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4dc0fb2-a477-4954-9105-b9f105254cf1-istiod-ca-cert\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.738720 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.737706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-certs\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.738720 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.737839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-data\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.739965 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.739940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-envoy\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.740271 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.740248    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-podinfo\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.745694 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.745657    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-token\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.745851 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.745834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85br6\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-kube-api-access-85br6\") pod \"e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") " pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:35.875748 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:35.875708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:36.050602 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:36.050569    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 14 10:42:36.051087 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:36.050626    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 14 10:42:36.181525 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:36.181495    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"]
Sep 14 10:42:36.183227 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:42:36.183201    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4dc0fb2_a477_4954_9105_b9f105254cf1.slice/crio-9241610266e466a5e20051d04c0031ddea21ac58446d8447210e666ade11effc WatchSource:0}: Error finding container 9241610266e466a5e20051d04c0031ddea21ac58446d8447210e666ade11effc: Status 404 returned error can't find the container with id 9241610266e466a5e20051d04c0031ddea21ac58446d8447210e666ade11effc
Sep 14 10:42:36.185599 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:36.185569    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:42:36.185658 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:36.185638    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:42:36.185714 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:36.185697    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:42:37.049618 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:37.049583    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 14 10:42:37.049796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:37.049638    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 14 10:42:37.153666 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:37.153629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" event={"ID":"d4dc0fb2-a477-4954-9105-b9f105254cf1","Type":"ContainerStarted","Data":"41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a"}
Sep 14 10:42:37.154069 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:37.153707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" event={"ID":"d4dc0fb2-a477-4954-9105-b9f105254cf1","Type":"ContainerStarted","Data":"9241610266e466a5e20051d04c0031ddea21ac58446d8447210e666ade11effc"}
Sep 14 10:42:37.177808 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:37.177765    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" podStartSLOduration=2.177749058 podStartE2EDuration="2.177749058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:42:37.176015536 +0000 UTC m=+1054.717417336" watchObservedRunningTime="2026-09-14 10:42:37.177749058 +0000 UTC m=+1054.719150891"
Sep 14 10:42:37.876769 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:37.876725    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:37.882002 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:37.881969    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:38.054214 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:38.054189    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:38.055313 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:38.055291    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:42:38.159364 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:38.159263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:38.160347 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:38.160328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:42:39.061895 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:39.061866    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"]
Sep 14 10:42:41.423031 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.422999    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"]
Sep 14 10:42:41.423540 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.423245    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp" podUID="7ec2806d-4f4f-46c1-a2c0-620ff2a19774" containerName="maas-api" containerID="cri-o://14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178" gracePeriod=30
Sep 14 10:42:41.670174 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.670147    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:42:41.789613 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.789536    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-openshift-service-ca\") pod \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") "
Sep 14 10:42:41.789613 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.789587    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-metrics-certs\") pod \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") "
Sep 14 10:42:41.789864 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.789619    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p74t\" (UniqueName: \"kubernetes.io/projected/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-kube-api-access-6p74t\") pod \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") "
Sep 14 10:42:41.789864 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.789756    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-maas-api-tls\") pod \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\" (UID: \"7ec2806d-4f4f-46c1-a2c0-620ff2a19774\") "
Sep 14 10:42:41.789999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.789960    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ec2806d-4f4f-46c1-a2c0-620ff2a19774" (UID: "7ec2806d-4f4f-46c1-a2c0-620ff2a19774"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:42:41.790102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.790054    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:41.791850 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.791824    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ec2806d-4f4f-46c1-a2c0-620ff2a19774" (UID: "7ec2806d-4f4f-46c1-a2c0-620ff2a19774"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:42:41.791923 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.791862    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7ec2806d-4f4f-46c1-a2c0-620ff2a19774" (UID: "7ec2806d-4f4f-46c1-a2c0-620ff2a19774"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:42:41.791979 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.791959    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-kube-api-access-6p74t" (OuterVolumeSpecName: "kube-api-access-6p74t") pod "7ec2806d-4f4f-46c1-a2c0-620ff2a19774" (UID: "7ec2806d-4f4f-46c1-a2c0-620ff2a19774"). InnerVolumeSpecName "kube-api-access-6p74t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:42:41.891363 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.891330    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:41.891363 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.891357    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p74t\" (UniqueName: \"kubernetes.io/projected/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-kube-api-access-6p74t\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:41.891363 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:41.891366    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec2806d-4f4f-46c1-a2c0-620ff2a19774-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:42.183367 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.183329    2578 generic.go:356] "Generic (PLEG): container finished" podID="7ec2806d-4f4f-46c1-a2c0-620ff2a19774" containerID="14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178" exitCode=0
Sep 14 10:42:42.183558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.183379    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"
Sep 14 10:42:42.183558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.183370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp" event={"ID":"7ec2806d-4f4f-46c1-a2c0-620ff2a19774","Type":"ContainerDied","Data":"14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178"}
Sep 14 10:42:42.183558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.183494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp" event={"ID":"7ec2806d-4f4f-46c1-a2c0-620ff2a19774","Type":"ContainerDied","Data":"4e01b1a026c3cff5f6591d6c26377fed074230b07052944efad656bbe3c2bd0b"}
Sep 14 10:42:42.183558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.183531    2578 scope.go:117] "RemoveContainer" containerID="14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178"
Sep 14 10:42:42.193468 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.193443    2578 scope.go:117] "RemoveContainer" containerID="14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178"
Sep 14 10:42:42.193830 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:42:42.193806    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178\": container with ID starting with 14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178 not found: ID does not exist" containerID="14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178"
Sep 14 10:42:42.193944 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.193842    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178"} err="failed to get container status \"14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178\": rpc error: code = NotFound desc = could not find container \"14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178\": container with ID starting with 14fe76dbc24706fbac0033b5880d8ae5d120d06e3f0a5741c2bddf2aac825178 not found: ID does not exist"
Sep 14 10:42:42.207460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.207436    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"]
Sep 14 10:42:42.213267 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.213247    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d36f67-84b5db4f69-g5nrp"]
Sep 14 10:42:42.672009 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.671972    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"]
Sep 14 10:42:42.672457 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.672356    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec2806d-4f4f-46c1-a2c0-620ff2a19774" containerName="maas-api"
Sep 14 10:42:42.672457 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.672368    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec2806d-4f4f-46c1-a2c0-620ff2a19774" containerName="maas-api"
Sep 14 10:42:42.672457 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.672443    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ec2806d-4f4f-46c1-a2c0-620ff2a19774" containerName="maas-api"
Sep 14 10:42:42.675126 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.675106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.678386 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.678361    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-558928-serving-cert\""
Sep 14 10:42:42.689612 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.689587    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"]
Sep 14 10:42:42.799647 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.799619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5119d9-9b64-48ea-b450-ee3151ca38f7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.799647 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.799650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkd9n\" (UniqueName: \"kubernetes.io/projected/8a5119d9-9b64-48ea-b450-ee3151ca38f7-kube-api-access-bkd9n\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.799875 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.799753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.799875 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.799775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.901257 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.901229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5119d9-9b64-48ea-b450-ee3151ca38f7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.901257 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.901260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkd9n\" (UniqueName: \"kubernetes.io/projected/8a5119d9-9b64-48ea-b450-ee3151ca38f7-kube-api-access-bkd9n\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.901477 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.901329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.901477 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.901368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.902034 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.902010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5119d9-9b64-48ea-b450-ee3151ca38f7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.903857 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.903839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.903978 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.903943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.912800 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.912775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkd9n\" (UniqueName: \"kubernetes.io/projected/8a5119d9-9b64-48ea-b450-ee3151ca38f7-kube-api-access-bkd9n\") pod \"maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:42.978843 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.978783    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ec2806d-4f4f-46c1-a2c0-620ff2a19774" path="/var/lib/kubelet/pods/7ec2806d-4f4f-46c1-a2c0-620ff2a19774/volumes"
Sep 14 10:42:42.985884 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:42.985865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:43.260089 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:43.260066    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"]
Sep 14 10:42:43.261462 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:42:43.261435    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5119d9_9b64_48ea_b450_ee3151ca38f7.slice/crio-b449965d56a330ca26cb7db16a1ab417ef9847d5b39405be56d4e94e193ab5b1 WatchSource:0}: Error finding container b449965d56a330ca26cb7db16a1ab417ef9847d5b39405be56d4e94e193ab5b1: Status 404 returned error can't find the container with id b449965d56a330ca26cb7db16a1ab417ef9847d5b39405be56d4e94e193ab5b1
Sep 14 10:42:43.262782 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:43.262767    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:42:44.195812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:44.195771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4" event={"ID":"8a5119d9-9b64-48ea-b450-ee3151ca38f7","Type":"ContainerStarted","Data":"12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0"}
Sep 14 10:42:44.196171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:44.195835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4" event={"ID":"8a5119d9-9b64-48ea-b450-ee3151ca38f7","Type":"ContainerStarted","Data":"b449965d56a330ca26cb7db16a1ab417ef9847d5b39405be56d4e94e193ab5b1"}
Sep 14 10:42:44.196171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:44.195857    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:44.215335 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:44.215283    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4" podStartSLOduration=1.917745328 podStartE2EDuration="2.215269797s" totalImagesPullingTime="297.524469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:42:44.213011452 +0000 UTC m=+1061.754413281" watchObservedRunningTime="2026-09-14 10:42:44.215269797 +0000 UTC m=+1061.756671599"
Sep 14 10:42:50.206335 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:50.206306    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:42:54.082283 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.082173    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb" podUID="44957459-0986-4571-b77a-935ad81bd6c1" containerName="main" containerID="cri-o://7dfc113e8775717f17475ef95869c09a3465e7b9703f8ecaf4875cfd0a88f705" gracePeriod=45
Sep 14 10:42:54.254754 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.254724    2578 generic.go:356] "Generic (PLEG): container finished" podID="44957459-0986-4571-b77a-935ad81bd6c1" containerID="7dfc113e8775717f17475ef95869c09a3465e7b9703f8ecaf4875cfd0a88f705" exitCode=0
Sep 14 10:42:54.254904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.254783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb" event={"ID":"44957459-0986-4571-b77a-935ad81bd6c1","Type":"ContainerDied","Data":"7dfc113e8775717f17475ef95869c09a3465e7b9703f8ecaf4875cfd0a88f705"}
Sep 14 10:42:54.379874 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.379850    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:42:54.436022 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.435987    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-home\") pod \"44957459-0986-4571-b77a-935ad81bd6c1\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") "
Sep 14 10:42:54.436234 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.436218    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-tmp-dir\") pod \"44957459-0986-4571-b77a-935ad81bd6c1\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") "
Sep 14 10:42:54.436346 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.436333    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-model-cache\") pod \"44957459-0986-4571-b77a-935ad81bd6c1\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") "
Sep 14 10:42:54.436487 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.436475    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44957459-0986-4571-b77a-935ad81bd6c1-tls-certs\") pod \"44957459-0986-4571-b77a-935ad81bd6c1\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") "
Sep 14 10:42:54.436621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.436610    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-dshm\") pod \"44957459-0986-4571-b77a-935ad81bd6c1\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") "
Sep 14 10:42:54.436799 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.436784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m7bp\" (UniqueName: \"kubernetes.io/projected/44957459-0986-4571-b77a-935ad81bd6c1-kube-api-access-9m7bp\") pod \"44957459-0986-4571-b77a-935ad81bd6c1\" (UID: \"44957459-0986-4571-b77a-935ad81bd6c1\") "
Sep 14 10:42:54.438345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.437566    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "44957459-0986-4571-b77a-935ad81bd6c1" (UID: "44957459-0986-4571-b77a-935ad81bd6c1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:42:54.438345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.437770    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-home" (OuterVolumeSpecName: "home") pod "44957459-0986-4571-b77a-935ad81bd6c1" (UID: "44957459-0986-4571-b77a-935ad81bd6c1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:42:54.438345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.437935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-model-cache" (OuterVolumeSpecName: "model-cache") pod "44957459-0986-4571-b77a-935ad81bd6c1" (UID: "44957459-0986-4571-b77a-935ad81bd6c1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:42:54.438900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.438883    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-home\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.439110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.439097    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-tmp-dir\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.439209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.439198    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-model-cache\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.441924 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.441812    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44957459-0986-4571-b77a-935ad81bd6c1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "44957459-0986-4571-b77a-935ad81bd6c1" (UID: "44957459-0986-4571-b77a-935ad81bd6c1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:42:54.441924 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.441892    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44957459-0986-4571-b77a-935ad81bd6c1-kube-api-access-9m7bp" (OuterVolumeSpecName: "kube-api-access-9m7bp") pod "44957459-0986-4571-b77a-935ad81bd6c1" (UID: "44957459-0986-4571-b77a-935ad81bd6c1"). InnerVolumeSpecName "kube-api-access-9m7bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:42:54.442620 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.442600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-dshm" (OuterVolumeSpecName: "dshm") pod "44957459-0986-4571-b77a-935ad81bd6c1" (UID: "44957459-0986-4571-b77a-935ad81bd6c1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:42:54.540491 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.540440    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44957459-0986-4571-b77a-935ad81bd6c1-tls-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.540491 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.540464    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44957459-0986-4571-b77a-935ad81bd6c1-dshm\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.540491 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:54.540473    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m7bp\" (UniqueName: \"kubernetes.io/projected/44957459-0986-4571-b77a-935ad81bd6c1-kube-api-access-9m7bp\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:55.262165 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:55.262080    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"
Sep 14 10:42:55.262165 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:55.262096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb" event={"ID":"44957459-0986-4571-b77a-935ad81bd6c1","Type":"ContainerDied","Data":"cb72733145a51331ac3624abebe21d1ab998f5d780fb545777d363a9bf4347bc"}
Sep 14 10:42:55.262165 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:55.262152    2578 scope.go:117] "RemoveContainer" containerID="7dfc113e8775717f17475ef95869c09a3465e7b9703f8ecaf4875cfd0a88f705"
Sep 14 10:42:55.279458 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:55.279419    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"]
Sep 14 10:42:55.287954 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:55.287931    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb"]
Sep 14 10:42:56.978017 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:56.977988    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44957459-0986-4571-b77a-935ad81bd6c1" path="/var/lib/kubelet/pods/44957459-0986-4571-b77a-935ad81bd6c1/volumes"
Sep 14 10:42:59.296662 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.296616    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-b-e9cc98/test-model-e9cc98-kserve-5f4d4cc5bc-f56hb" podUID="44957459-0986-4571-b77a-935ad81bd6c1" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 14 10:42:59.609177 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.609131    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"]
Sep 14 10:42:59.609448 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.609397    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54" podUID="4ee59810-5227-42b6-8bd9-9149e6188d7b" containerName="maas-api" containerID="cri-o://9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655" gracePeriod=30
Sep 14 10:42:59.666715 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.666661    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"]
Sep 14 10:42:59.667016 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.666965    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj" podUID="1422ca0c-fc8f-4f27-8156-356725765ffd" containerName="payload-processing" containerID="cri-o://071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454" gracePeriod=30
Sep 14 10:42:59.670598 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.670565    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"]
Sep 14 10:42:59.670911 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.670845    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6" podUID="2c15e653-8cfe-47a8-80a0-69d9936bfdc3" containerName="payload-pre-processing" containerID="cri-o://f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e" gracePeriod=30
Sep 14 10:42:59.947173 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.947126    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:42:59.990426 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.990401    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:42:59.993237 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.993211    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:42:59.993564 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.993543    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vzfd\" (UniqueName: \"kubernetes.io/projected/4ee59810-5227-42b6-8bd9-9149e6188d7b-kube-api-access-6vzfd\") pod \"4ee59810-5227-42b6-8bd9-9149e6188d7b\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") "
Sep 14 10:42:59.993704 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.993624    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee59810-5227-42b6-8bd9-9149e6188d7b-openshift-service-ca\") pod \"4ee59810-5227-42b6-8bd9-9149e6188d7b\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") "
Sep 14 10:42:59.993704 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.993656    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-maas-api-tls\") pod \"4ee59810-5227-42b6-8bd9-9149e6188d7b\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") "
Sep 14 10:42:59.993839 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.993775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-metrics-certs\") pod \"4ee59810-5227-42b6-8bd9-9149e6188d7b\" (UID: \"4ee59810-5227-42b6-8bd9-9149e6188d7b\") "
Sep 14 10:42:59.994208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.994033    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee59810-5227-42b6-8bd9-9149e6188d7b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ee59810-5227-42b6-8bd9-9149e6188d7b" (UID: "4ee59810-5227-42b6-8bd9-9149e6188d7b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:42:59.994208 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.994158    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee59810-5227-42b6-8bd9-9149e6188d7b-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:42:59.995884 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.995855    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee59810-5227-42b6-8bd9-9149e6188d7b-kube-api-access-6vzfd" (OuterVolumeSpecName: "kube-api-access-6vzfd") pod "4ee59810-5227-42b6-8bd9-9149e6188d7b" (UID: "4ee59810-5227-42b6-8bd9-9149e6188d7b"). InnerVolumeSpecName "kube-api-access-6vzfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:42:59.996267 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.996247    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4ee59810-5227-42b6-8bd9-9149e6188d7b" (UID: "4ee59810-5227-42b6-8bd9-9149e6188d7b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:42:59.996490 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:42:59.996471    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ee59810-5227-42b6-8bd9-9149e6188d7b" (UID: "4ee59810-5227-42b6-8bd9-9149e6188d7b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:43:00.095506 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.095479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94cpw\" (UniqueName: \"kubernetes.io/projected/1422ca0c-fc8f-4f27-8156-356725765ffd-kube-api-access-94cpw\") pod \"1422ca0c-fc8f-4f27-8156-356725765ffd\" (UID: \"1422ca0c-fc8f-4f27-8156-356725765ffd\") "
Sep 14 10:43:00.095703 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.095514    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnrgc\" (UniqueName: \"kubernetes.io/projected/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-kube-api-access-vnrgc\") pod \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\" (UID: \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\") "
Sep 14 10:43:00.095703 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.095549    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-plugins-config-volume\") pod \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\" (UID: \"2c15e653-8cfe-47a8-80a0-69d9936bfdc3\") "
Sep 14 10:43:00.095703 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.095626    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1422ca0c-fc8f-4f27-8156-356725765ffd-plugins-config-volume\") pod \"1422ca0c-fc8f-4f27-8156-356725765ffd\" (UID: \"1422ca0c-fc8f-4f27-8156-356725765ffd\") "
Sep 14 10:43:00.095982 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.095955    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c15e653-8cfe-47a8-80a0-69d9936bfdc3" (UID: "2c15e653-8cfe-47a8-80a0-69d9936bfdc3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:43:00.096080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.096020    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1422ca0c-fc8f-4f27-8156-356725765ffd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1422ca0c-fc8f-4f27-8156-356725765ffd" (UID: "1422ca0c-fc8f-4f27-8156-356725765ffd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:43:00.096140 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.096108    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:43:00.096140 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.096129    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:43:00.096231 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.096145    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vzfd\" (UniqueName: \"kubernetes.io/projected/4ee59810-5227-42b6-8bd9-9149e6188d7b-kube-api-access-6vzfd\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:43:00.096231 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.096158    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee59810-5227-42b6-8bd9-9149e6188d7b-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:43:00.097664 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.097643    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1422ca0c-fc8f-4f27-8156-356725765ffd-kube-api-access-94cpw" (OuterVolumeSpecName: "kube-api-access-94cpw") pod "1422ca0c-fc8f-4f27-8156-356725765ffd" (UID: "1422ca0c-fc8f-4f27-8156-356725765ffd"). InnerVolumeSpecName "kube-api-access-94cpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:43:00.098210 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.098193    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-kube-api-access-vnrgc" (OuterVolumeSpecName: "kube-api-access-vnrgc") pod "2c15e653-8cfe-47a8-80a0-69d9936bfdc3" (UID: "2c15e653-8cfe-47a8-80a0-69d9936bfdc3"). InnerVolumeSpecName "kube-api-access-vnrgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:43:00.197426 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.197352    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1422ca0c-fc8f-4f27-8156-356725765ffd-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:43:00.197426 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.197382    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94cpw\" (UniqueName: \"kubernetes.io/projected/1422ca0c-fc8f-4f27-8156-356725765ffd-kube-api-access-94cpw\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:43:00.197426 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.197391    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnrgc\" (UniqueName: \"kubernetes.io/projected/2c15e653-8cfe-47a8-80a0-69d9936bfdc3-kube-api-access-vnrgc\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:43:00.292571 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.292540    2578 generic.go:356] "Generic (PLEG): container finished" podID="4ee59810-5227-42b6-8bd9-9149e6188d7b" containerID="9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655" exitCode=0
Sep 14 10:43:00.292776 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.292585    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"
Sep 14 10:43:00.292776 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.292630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54" event={"ID":"4ee59810-5227-42b6-8bd9-9149e6188d7b","Type":"ContainerDied","Data":"9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655"}
Sep 14 10:43:00.292776 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.292712    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54" event={"ID":"4ee59810-5227-42b6-8bd9-9149e6188d7b","Type":"ContainerDied","Data":"3aa0ca02159d3f9a002adce12a8b6b474b7ce5f9bf1e307f1297e9067484da41"}
Sep 14 10:43:00.292776 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.292739    2578 scope.go:117] "RemoveContainer" containerID="9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655"
Sep 14 10:43:00.294226 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.294205    2578 generic.go:356] "Generic (PLEG): container finished" podID="1422ca0c-fc8f-4f27-8156-356725765ffd" containerID="071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454" exitCode=0
Sep 14 10:43:00.294345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.294231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj" event={"ID":"1422ca0c-fc8f-4f27-8156-356725765ffd","Type":"ContainerDied","Data":"071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454"}
Sep 14 10:43:00.294345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.294252    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"
Sep 14 10:43:00.294345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.294281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj" event={"ID":"1422ca0c-fc8f-4f27-8156-356725765ffd","Type":"ContainerDied","Data":"b21f878c5366d6fc6c9a6734420a464c6a7bc00e7d46d60b1e73ab436e9b6405"}
Sep 14 10:43:00.295991 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.295970    2578 generic.go:356] "Generic (PLEG): container finished" podID="2c15e653-8cfe-47a8-80a0-69d9936bfdc3" containerID="f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e" exitCode=0
Sep 14 10:43:00.296095 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.296075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6" event={"ID":"2c15e653-8cfe-47a8-80a0-69d9936bfdc3","Type":"ContainerDied","Data":"f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e"}
Sep 14 10:43:00.296146 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.296110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6" event={"ID":"2c15e653-8cfe-47a8-80a0-69d9936bfdc3","Type":"ContainerDied","Data":"f8f3f112e3e9edb3fa89896de3f2a83d1db617be4c8e4581c774c018dd21b152"}
Sep 14 10:43:00.296188 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.296177    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"
Sep 14 10:43:00.304710 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.304656    2578 scope.go:117] "RemoveContainer" containerID="9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655"
Sep 14 10:43:00.305503 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:43:00.305334    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655\": container with ID starting with 9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655 not found: ID does not exist" containerID="9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655"
Sep 14 10:43:00.305503 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.305377    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655"} err="failed to get container status \"9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655\": rpc error: code = NotFound desc = could not find container \"9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655\": container with ID starting with 9e00cb1062156461b2da25c21a3f50edfb0508fc4826ddee718d96922a393655 not found: ID does not exist"
Sep 14 10:43:00.305503 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.305399    2578 scope.go:117] "RemoveContainer" containerID="071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454"
Sep 14 10:43:00.314015 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.314001    2578 scope.go:117] "RemoveContainer" containerID="071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454"
Sep 14 10:43:00.314252 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:43:00.314237    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454\": container with ID starting with 071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454 not found: ID does not exist" containerID="071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454"
Sep 14 10:43:00.314301 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.314258    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454"} err="failed to get container status \"071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454\": rpc error: code = NotFound desc = could not find container \"071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454\": container with ID starting with 071e3a8eede0e2535c5bc50f635e42498c6cfa66b87d7f623e5980a7dd9cd454 not found: ID does not exist"
Sep 14 10:43:00.314301 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.314272    2578 scope.go:117] "RemoveContainer" containerID="f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e"
Sep 14 10:43:00.321188 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.321169    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"]
Sep 14 10:43:00.322091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.322078    2578 scope.go:117] "RemoveContainer" containerID="f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e"
Sep 14 10:43:00.322387 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:43:00.322369    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e\": container with ID starting with f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e not found: ID does not exist" containerID="f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e"
Sep 14 10:43:00.322448 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.322396    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e"} err="failed to get container status \"f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e\": rpc error: code = NotFound desc = could not find container \"f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e\": container with ID starting with f941e4a31573cec3b038d61cbf5d535a61fd7dfc9a0805a92b21b3693cdf690e not found: ID does not exist"
Sep 14 10:43:00.327070 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.327050    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e9cc98-8648fcfb45-swk54"]
Sep 14 10:43:00.337168 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.337148    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"]
Sep 14 10:43:00.342285 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.342266    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e9cc98-dd8f46fcd-m2bd6"]
Sep 14 10:43:00.352792 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.352773    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"]
Sep 14 10:43:00.363440 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.363410    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e9cc98-5c6d7ccc65-njnvj"]
Sep 14 10:43:00.982102 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.982004    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1422ca0c-fc8f-4f27-8156-356725765ffd" path="/var/lib/kubelet/pods/1422ca0c-fc8f-4f27-8156-356725765ffd/volumes"
Sep 14 10:43:00.982394 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.982377    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c15e653-8cfe-47a8-80a0-69d9936bfdc3" path="/var/lib/kubelet/pods/2c15e653-8cfe-47a8-80a0-69d9936bfdc3/volumes"
Sep 14 10:43:00.982759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:00.982741    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee59810-5227-42b6-8bd9-9149e6188d7b" path="/var/lib/kubelet/pods/4ee59810-5227-42b6-8bd9-9149e6188d7b/volumes"
Sep 14 10:43:02.311699 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:02.311655    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerID="41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a" exitCode=0
Sep 14 10:43:02.312136 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:02.311731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" event={"ID":"d4dc0fb2-a477-4954-9105-b9f105254cf1","Type":"ContainerDied","Data":"41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a"}
Sep 14 10:43:02.312178 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:02.312138    2578 scope.go:117] "RemoveContainer" containerID="41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a"
Sep 14 10:43:02.313242 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:02.313216    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:02.313311 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:02.313299    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:02.313405 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:02.313386    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:03.322904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:03.322796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" event={"ID":"d4dc0fb2-a477-4954-9105-b9f105254cf1","Type":"ContainerStarted","Data":"0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f"}
Sep 14 10:43:03.876412 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:03.876379    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:43:03.877542 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:03.877516    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:43:03.877655 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:03.877585    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 14 10:43:04.876397 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:04.876362    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:43:04.876796 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:04.876414    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 14 10:43:05.876496 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:05.876455    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:43:05.876976 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:05.876516    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 14 10:43:06.876951 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:06.876921    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:43:06.877334 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:06.876976    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 14 10:43:07.455214 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455180    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"]
Sep 14 10:43:07.455565 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455544    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1422ca0c-fc8f-4f27-8156-356725765ffd" containerName="payload-processing"
Sep 14 10:43:07.455701 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455636    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1422ca0c-fc8f-4f27-8156-356725765ffd" containerName="payload-processing"
Sep 14 10:43:07.455786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455701    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee59810-5227-42b6-8bd9-9149e6188d7b" containerName="maas-api"
Sep 14 10:43:07.455786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455712    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee59810-5227-42b6-8bd9-9149e6188d7b" containerName="maas-api"
Sep 14 10:43:07.455786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455723    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44957459-0986-4571-b77a-935ad81bd6c1" containerName="main"
Sep 14 10:43:07.455786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455730    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="44957459-0986-4571-b77a-935ad81bd6c1" containerName="main"
Sep 14 10:43:07.455786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455742    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c15e653-8cfe-47a8-80a0-69d9936bfdc3" containerName="payload-pre-processing"
Sep 14 10:43:07.455786 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455749    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c15e653-8cfe-47a8-80a0-69d9936bfdc3" containerName="payload-pre-processing"
Sep 14 10:43:07.456055 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455881    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c15e653-8cfe-47a8-80a0-69d9936bfdc3" containerName="payload-pre-processing"
Sep 14 10:43:07.456055 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455897    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee59810-5227-42b6-8bd9-9149e6188d7b" containerName="maas-api"
Sep 14 10:43:07.456055 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455908    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="44957459-0986-4571-b77a-935ad81bd6c1" containerName="main"
Sep 14 10:43:07.456055 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.455917    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1422ca0c-fc8f-4f27-8156-356725765ffd" containerName="payload-processing"
Sep 14 10:43:07.458095 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.458071    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.461109 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.461044    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-1cbcd0-openshift-default-dockercfg-rl8z9\""
Sep 14 10:43:07.472145 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.472115    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"]
Sep 14 10:43:07.572760 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.572662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-istio-token\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.572917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.572799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98ec66c9-f524-4973-be75-5e1b6c711874-istio-podinfo\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.572917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.572863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-credential-socket\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.572917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.572886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98ec66c9-f524-4973-be75-5e1b6c711874-istiod-ca-cert\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.573029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.572942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljzrg\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-kube-api-access-ljzrg\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.573095 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.573081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-data\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.573142 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.573124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-socket\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.573376 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.573340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-certs\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.573438 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.573428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-envoy\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.674823 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.674787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-certs\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675018 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.674826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-envoy\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675018 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.674876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-istio-token\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675018 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.674916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98ec66c9-f524-4973-be75-5e1b6c711874-istio-podinfo\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.675043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-credential-socket\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.675078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98ec66c9-f524-4973-be75-5e1b6c711874-istiod-ca-cert\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.675105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljzrg\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-kube-api-access-ljzrg\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.675168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-data\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675203 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.675197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-socket\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675410 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.675234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-certs\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675515 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.675490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-socket\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675885 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.675567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-credential-socket\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.675964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.675740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-data\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.676123 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.676097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98ec66c9-f524-4973-be75-5e1b6c711874-istiod-ca-cert\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.677294 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.677272    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-envoy\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.677527 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.677507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98ec66c9-f524-4973-be75-5e1b6c711874-istio-podinfo\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.683953 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.683935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-istio-token\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.684089 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.684069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljzrg\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-kube-api-access-ljzrg\") pod \"e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") " pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.769516 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.769432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:07.877065 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.877031    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:43:07.877452 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:07.877095    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 14 10:43:08.061163 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.061135    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"]
Sep 14 10:43:08.063555 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:43:08.063522    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ec66c9_f524_4973_be75_5e1b6c711874.slice/crio-2da30e8aec0311a8522bec5d8592e1fc4930f69b93894a4445dab64941ef8426 WatchSource:0}: Error finding container 2da30e8aec0311a8522bec5d8592e1fc4930f69b93894a4445dab64941ef8426: Status 404 returned error can't find the container with id 2da30e8aec0311a8522bec5d8592e1fc4930f69b93894a4445dab64941ef8426
Sep 14 10:43:08.066443 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.066388    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:08.066554 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.066491    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:08.066655 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.066534    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:08.159313 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.159265    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:43:08.357887 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.357850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" event={"ID":"98ec66c9-f524-4973-be75-5e1b6c711874","Type":"ContainerStarted","Data":"6eeacbcad3c11f54d028d997ba7ad733fc07f6d8ebe4b1ad45b75e178351a0db"}
Sep 14 10:43:08.358036 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.357907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" event={"ID":"98ec66c9-f524-4973-be75-5e1b6c711874","Type":"ContainerStarted","Data":"2da30e8aec0311a8522bec5d8592e1fc4930f69b93894a4445dab64941ef8426"}
Sep 14 10:43:08.390868 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.390803    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" podStartSLOduration=1.390781836 podStartE2EDuration="1.390781836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:08.386146486 +0000 UTC m=+1085.927548288" watchObservedRunningTime="2026-09-14 10:43:08.390781836 +0000 UTC m=+1085.932183638"
Sep 14 10:43:08.769966 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.769890    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:08.880504 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.880480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:43:08.881491 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:08.881471    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:43:09.022342 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.022265    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"]
Sep 14 10:43:09.024781 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.024760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.029404 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.029387    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5bbd7765-openshift-default-dockercfg-x877w\""
Sep 14 10:43:09.055083 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.055056    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"]
Sep 14 10:43:09.188943 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.188909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcd76\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-kube-api-access-fcd76\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.189094 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.188955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-data\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.189094 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.188982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-podinfo\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.189094 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.189023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-credential-socket\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.189094 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.189038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-envoy\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.189094 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.189087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-token\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.189302 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.189134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istiod-ca-cert\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.189302 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.189191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-socket\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.189302 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.189216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-certs\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.290901 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.290806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-podinfo\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.290901 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.290871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-credential-socket\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.291135 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.291028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-envoy\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.291135 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.291089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-token\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.291249 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.291143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istiod-ca-cert\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.291249 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.291219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-socket\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.291350 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.291258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-credential-socket\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.291350 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.291261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-certs\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.291350 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.291322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcd76\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-kube-api-access-fcd76\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.291500 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.291375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-data\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.291558 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.291540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-certs\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.292473 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.292030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-socket\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.292473 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.292416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istiod-ca-cert\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.292661 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.292560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-data\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.296022 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.294237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-envoy\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.296022 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.294819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-podinfo\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.302128 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.302101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-token\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.302384 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.302360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcd76\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-kube-api-access-fcd76\") pod \"e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") " pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.336545 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.336516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:09.619398 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.619368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"]
Sep 14 10:43:09.620002 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:43:09.619972    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7b61d3_5f52_448f_8af0_e7223ec3ceb3.slice/crio-3e2058ea97a73ad86bcca4fc533b4d9ac0a466c38679e70937aaa3ba6dfd14bf WatchSource:0}: Error finding container 3e2058ea97a73ad86bcca4fc533b4d9ac0a466c38679e70937aaa3ba6dfd14bf: Status 404 returned error can't find the container with id 3e2058ea97a73ad86bcca4fc533b4d9ac0a466c38679e70937aaa3ba6dfd14bf
Sep 14 10:43:09.622964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.622923    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:09.623053 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.623011    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:09.623133 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.623056    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:09.774802 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:09.774774    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:10.378138 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:10.378095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" event={"ID":"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3","Type":"ContainerStarted","Data":"d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b"}
Sep 14 10:43:10.378567 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:10.378177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" event={"ID":"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3","Type":"ContainerStarted","Data":"3e2058ea97a73ad86bcca4fc533b4d9ac0a466c38679e70937aaa3ba6dfd14bf"}
Sep 14 10:43:10.378567 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:10.378204    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:10.379060 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:10.379042    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:10.404813 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:10.404763    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" podStartSLOduration=2.404750757 podStartE2EDuration="2.404750757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:10.402664203 +0000 UTC m=+1087.944066004" watchObservedRunningTime="2026-09-14 10:43:10.404750757 +0000 UTC m=+1087.946152557"
Sep 14 10:43:11.337400 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:11.337365    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:11.342301 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:11.342279    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:11.384793 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:11.384763    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:11.385368 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:11.385341    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:14.500950 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.500919    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"]
Sep 14 10:43:14.503406 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.503388    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:14.506073 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.506050    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-1cbcd0\""
Sep 14 10:43:14.506368 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.506353    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-1cbcd0-dockercfg-wdnmj\""
Sep 14 10:43:14.515727 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.515707    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"]
Sep 14 10:43:14.643868 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.643827    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms54s\" (UniqueName: \"kubernetes.io/projected/29fc2714-a48c-4b22-b793-6e0cc9e1f757-kube-api-access-ms54s\") pod \"payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt\" (UID: \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:14.644058 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.643889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fc2714-a48c-4b22-b793-6e0cc9e1f757-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt\" (UID: \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:14.745382 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.745331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fc2714-a48c-4b22-b793-6e0cc9e1f757-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt\" (UID: \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:14.745537 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.745458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms54s\" (UniqueName: \"kubernetes.io/projected/29fc2714-a48c-4b22-b793-6e0cc9e1f757-kube-api-access-ms54s\") pod \"payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt\" (UID: \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:14.746078 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.746060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fc2714-a48c-4b22-b793-6e0cc9e1f757-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt\" (UID: \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:14.758437 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.758356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms54s\" (UniqueName: \"kubernetes.io/projected/29fc2714-a48c-4b22-b793-6e0cc9e1f757-kube-api-access-ms54s\") pod \"payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt\" (UID: \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:14.764512 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.764484    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"]
Sep 14 10:43:14.767190 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.767155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:14.770199 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.770174    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5bbd7765-serving-cert\""
Sep 14 10:43:14.781593 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.781567    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"]
Sep 14 10:43:14.814375 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.814348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:14.948209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.948177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-metrics-certs\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:14.948377 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.948291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c0a06f-0ba7-4136-afd4-d83827340d57-openshift-service-ca\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:14.948377 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.948312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7ctc\" (UniqueName: \"kubernetes.io/projected/23c0a06f-0ba7-4136-afd4-d83827340d57-kube-api-access-k7ctc\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:14.948377 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:14.948348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-maas-api-tls\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.049832 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.049756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-metrics-certs\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.049977 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.049839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c0a06f-0ba7-4136-afd4-d83827340d57-openshift-service-ca\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.049977 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.049931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ctc\" (UniqueName: \"kubernetes.io/projected/23c0a06f-0ba7-4136-afd4-d83827340d57-kube-api-access-k7ctc\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.050086 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.049981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-maas-api-tls\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.050140 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:43:15.050105    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-serving-cert: secret "maas-api-e2e-mt-5bbd7765-serving-cert" not found
Sep 14 10:43:15.050189 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:43:15.050158    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-maas-api-tls podName:23c0a06f-0ba7-4136-afd4-d83827340d57 nodeName:}" failed. No retries permitted until 2026-09-14 10:43:15.550140795 +0000 UTC m=+1093.091542576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-maas-api-tls") pod "maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2" (UID: "23c0a06f-0ba7-4136-afd4-d83827340d57") : secret "maas-api-e2e-mt-5bbd7765-serving-cert" not found
Sep 14 10:43:15.050382 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.050366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c0a06f-0ba7-4136-afd4-d83827340d57-openshift-service-ca\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.052317 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.052302    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-metrics-certs\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.059069 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.059050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7ctc\" (UniqueName: \"kubernetes.io/projected/23c0a06f-0ba7-4136-afd4-d83827340d57-kube-api-access-k7ctc\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.088604 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.088585    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"]
Sep 14 10:43:15.090628 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:43:15.090595    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29fc2714_a48c_4b22_b793_6e0cc9e1f757.slice/crio-2441eb8c74c9a5843c456d41ac36b859d2dd4a19de6de3cda5adbd3b56d6a726 WatchSource:0}: Error finding container 2441eb8c74c9a5843c456d41ac36b859d2dd4a19de6de3cda5adbd3b56d6a726: Status 404 returned error can't find the container with id 2441eb8c74c9a5843c456d41ac36b859d2dd4a19de6de3cda5adbd3b56d6a726
Sep 14 10:43:15.405967 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.405934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt" event={"ID":"29fc2714-a48c-4b22-b793-6e0cc9e1f757","Type":"ContainerStarted","Data":"8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e"}
Sep 14 10:43:15.406153 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.405995    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt" event={"ID":"29fc2714-a48c-4b22-b793-6e0cc9e1f757","Type":"ContainerStarted","Data":"2441eb8c74c9a5843c456d41ac36b859d2dd4a19de6de3cda5adbd3b56d6a726"}
Sep 14 10:43:15.406153 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.406022    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:15.437768 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.436986    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt" podStartSLOduration=1.436968147 podStartE2EDuration="1.436968147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:15.436264942 +0000 UTC m=+1092.977666747" watchObservedRunningTime="2026-09-14 10:43:15.436968147 +0000 UTC m=+1092.978369950"
Sep 14 10:43:15.555111 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.555076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-maas-api-tls\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.557613 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.557592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-maas-api-tls\") pod \"maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.680029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.679943    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:15.955575 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:15.955525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"]
Sep 14 10:43:15.956998 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:43:15.956970    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c0a06f_0ba7_4136_afd4_d83827340d57.slice/crio-77b42f28e11e6928196f78d7582679c15a23b328b4f64dec292fef12b78b2148 WatchSource:0}: Error finding container 77b42f28e11e6928196f78d7582679c15a23b328b4f64dec292fef12b78b2148: Status 404 returned error can't find the container with id 77b42f28e11e6928196f78d7582679c15a23b328b4f64dec292fef12b78b2148
Sep 14 10:43:16.412394 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:16.412365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2" event={"ID":"23c0a06f-0ba7-4136-afd4-d83827340d57","Type":"ContainerStarted","Data":"b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b"}
Sep 14 10:43:16.412533 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:16.412431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2" event={"ID":"23c0a06f-0ba7-4136-afd4-d83827340d57","Type":"ContainerStarted","Data":"77b42f28e11e6928196f78d7582679c15a23b328b4f64dec292fef12b78b2148"}
Sep 14 10:43:16.412604 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:16.412583    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:16.432141 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:16.432090    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2" podStartSLOduration=2.056016344 podStartE2EDuration="2.432070108s" totalImagesPullingTime="376.053764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:16.429128438 +0000 UTC m=+1093.970530242" watchObservedRunningTime="2026-09-14 10:43:16.432070108 +0000 UTC m=+1093.973471911"
Sep 14 10:43:22.423205 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:22.423179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:43:26.414455 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:26.414428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:43:39.553157 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.553117    2578 generic.go:356] "Generic (PLEG): container finished" podID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerID="d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b" exitCode=0
Sep 14 10:43:39.553701 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.553194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" event={"ID":"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3","Type":"ContainerDied","Data":"d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b"}
Sep 14 10:43:39.553782 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.553744    2578 scope.go:117] "RemoveContainer" containerID="d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b"
Sep 14 10:43:39.554899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.554868    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:39.555025 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.554956    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:39.555025 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.555006    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:39.555150 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.555073    2578 generic.go:356] "Generic (PLEG): container finished" podID="98ec66c9-f524-4973-be75-5e1b6c711874" containerID="6eeacbcad3c11f54d028d997ba7ad733fc07f6d8ebe4b1ad45b75e178351a0db" exitCode=0
Sep 14 10:43:39.555206 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.555147    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" event={"ID":"98ec66c9-f524-4973-be75-5e1b6c711874","Type":"ContainerDied","Data":"6eeacbcad3c11f54d028d997ba7ad733fc07f6d8ebe4b1ad45b75e178351a0db"}
Sep 14 10:43:39.555501 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.555483    2578 scope.go:117] "RemoveContainer" containerID="6eeacbcad3c11f54d028d997ba7ad733fc07f6d8ebe4b1ad45b75e178351a0db"
Sep 14 10:43:39.556641 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.556615    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:39.556728 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.556711    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:39.556768 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:39.556756    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:43:40.379086 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:40.379051    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:40.566443 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:40.566396    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" event={"ID":"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3","Type":"ContainerStarted","Data":"b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70"}
Sep 14 10:43:40.570855 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:40.570649    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" event={"ID":"98ec66c9-f524-4973-be75-5e1b6c711874","Type":"ContainerStarted","Data":"807724c966f39e8485b822e68acb8fed802ff5110b0a55528f8673c3ec924bea"}
Sep 14 10:43:40.770292 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:40.770197    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:40.771233 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:40.771210    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 14 10:43:40.771357 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:40.771261    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 14 10:43:41.337498 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:41.337463    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:41.338721 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:41.338663    2578 patch_prober.go:28] interesting pod/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:43:41.338854 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:41.338749    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 14 10:43:41.384757 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:41.384726    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:41.770418 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:41.770330    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 14 10:43:41.770418 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:41.770393    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 14 10:43:42.338234 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:42.338197    2578 patch_prober.go:28] interesting pod/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:43:42.338550 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:42.338513    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 14 10:43:42.770320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:42.770238    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 14 10:43:42.770522 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:42.770503    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 14 10:43:43.338006 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:43.337963    2578 patch_prober.go:28] interesting pod/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:43:43.338224 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:43.338030    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 14 10:43:43.770851 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:43.770761    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 14 10:43:43.770851 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:43.770810    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 14 10:43:44.337626 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:44.337589    2578 patch_prober.go:28] interesting pod/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:43:44.337940 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:44.337913    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 14 10:43:44.769798 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:44.769715    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 14 10:43:44.769798 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:44.769769    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 14 10:43:45.337918 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:45.337878    2578 patch_prober.go:28] interesting pod/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:43:45.338505 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:45.338472    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 14 10:43:45.774770 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:45.774662    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:45.775022 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:45.775006    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:45.775601 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:45.775584    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:43:46.340792 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.340757    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:46.341780 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.341761    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:43:46.578231 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.578202    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"]
Sep 14 10:43:46.581333 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.581317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.584157 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.584136    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-7bdcda-serving-cert\""
Sep 14 10:43:46.597860 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.597796    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"]
Sep 14 10:43:46.692925 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.692898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.693070 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.692935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.693070 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.692956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lb2q\" (UniqueName: \"kubernetes.io/projected/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-kube-api-access-9lb2q\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.693070 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.693029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.793925 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.793891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.794155 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.794134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.794236 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.794193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.794292 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.794270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lb2q\" (UniqueName: \"kubernetes.io/projected/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-kube-api-access-9lb2q\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.794707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.794660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.796710 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.796693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.796781 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.796716    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.803104 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.803079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lb2q\" (UniqueName: \"kubernetes.io/projected/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-kube-api-access-9lb2q\") pod \"maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:46.891655 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:46.891590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:47.167341 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:47.167314    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"]
Sep 14 10:43:47.168861 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:43:47.168810    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb015d9cf_d1a7_4dc7_9508_2a77bda6daf4.slice/crio-9b6932bdf3d723ea55790db7060b56a400fc3ee155e4370f9a3b5f64a072a4ab WatchSource:0}: Error finding container 9b6932bdf3d723ea55790db7060b56a400fc3ee155e4370f9a3b5f64a072a4ab: Status 404 returned error can't find the container with id 9b6932bdf3d723ea55790db7060b56a400fc3ee155e4370f9a3b5f64a072a4ab
Sep 14 10:43:47.610905 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:47.610808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m" event={"ID":"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4","Type":"ContainerStarted","Data":"9b6932bdf3d723ea55790db7060b56a400fc3ee155e4370f9a3b5f64a072a4ab"}
Sep 14 10:43:48.618187 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:48.618155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m" event={"ID":"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4","Type":"ContainerStarted","Data":"d30eccf23634e58e8582a9a5de8b2e725e277ac5162d9efaaea3c8b148172870"}
Sep 14 10:43:48.618611 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:48.618270    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:43:48.641140 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:48.641090    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m" podStartSLOduration=2.252096103 podStartE2EDuration="2.641072823s" totalImagesPullingTime="388.97672ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:48.638795253 +0000 UTC m=+1126.180197054" watchObservedRunningTime="2026-09-14 10:43:48.641072823 +0000 UTC m=+1126.182474623"
Sep 14 10:43:54.629124 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:43:54.629096    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:45:12.587288 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.587253    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"]
Sep 14 10:45:12.589715 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.589699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.594894 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.594869    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1cbcd0\"/\"kube-root-ca.crt\""
Sep 14 10:45:12.595033 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.595000    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1cbcd0\"/\"openshift-service-ca.crt\""
Sep 14 10:45:12.595033 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.595018    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1cbcd0\"/\"auth-test-model-1cbcd0-kserve-self-signed-certs\""
Sep 14 10:45:12.595157 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.595025    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1cbcd0\"/\"default-dockercfg-f9jpl\""
Sep 14 10:45:12.602197 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.602175    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"]
Sep 14 10:45:12.666528 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.666497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-home\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.666686 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.666532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-tmp-dir\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.666686 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.666609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/086903ad-af5f-4edd-996c-61a0a53e6443-tls-certs\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.666686 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.666631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsgn9\" (UniqueName: \"kubernetes.io/projected/086903ad-af5f-4edd-996c-61a0a53e6443-kube-api-access-vsgn9\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.666804 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.666738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-dshm\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.666804 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.666767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-model-cache\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.767505 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.767476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-home\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.767625 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.767510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-tmp-dir\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.767625 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.767566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/086903ad-af5f-4edd-996c-61a0a53e6443-tls-certs\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.767625 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.767598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsgn9\" (UniqueName: \"kubernetes.io/projected/086903ad-af5f-4edd-996c-61a0a53e6443-kube-api-access-vsgn9\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.767771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.767666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-dshm\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.767771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.767712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-model-cache\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.767919 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.767900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-tmp-dir\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.767966 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.767949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-home\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.768063 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.768049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-model-cache\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.769909 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.769890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-dshm\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.770149 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.770134    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/086903ad-af5f-4edd-996c-61a0a53e6443-tls-certs\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.777006 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.776969    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsgn9\" (UniqueName: \"kubernetes.io/projected/086903ad-af5f-4edd-996c-61a0a53e6443-kube-api-access-vsgn9\") pod \"auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:12.899183 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:12.899097    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:13.174721 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:13.174692    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"]
Sep 14 10:45:13.176540 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:45:13.176513    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod086903ad_af5f_4edd_996c_61a0a53e6443.slice/crio-c7e8eb6a1a0fcc99bdd98f6d6ff34b22d79e9e23548e1e0221ab2e5fd4098415 WatchSource:0}: Error finding container c7e8eb6a1a0fcc99bdd98f6d6ff34b22d79e9e23548e1e0221ab2e5fd4098415: Status 404 returned error can't find the container with id c7e8eb6a1a0fcc99bdd98f6d6ff34b22d79e9e23548e1e0221ab2e5fd4098415
Sep 14 10:45:14.092608 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:14.092571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc" event={"ID":"086903ad-af5f-4edd-996c-61a0a53e6443","Type":"ContainerStarted","Data":"67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42"}
Sep 14 10:45:14.093027 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:14.092619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc" event={"ID":"086903ad-af5f-4edd-996c-61a0a53e6443","Type":"ContainerStarted","Data":"c7e8eb6a1a0fcc99bdd98f6d6ff34b22d79e9e23548e1e0221ab2e5fd4098415"}
Sep 14 10:45:14.112270 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:14.112215    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc" podStartSLOduration=2.112201604 podStartE2EDuration="2.112201604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:45:14.110704242 +0000 UTC m=+1211.652106035" watchObservedRunningTime="2026-09-14 10:45:14.112201604 +0000 UTC m=+1211.653603404"
Sep 14 10:45:22.899692 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:22.899646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:22.900135 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:22.899711    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:22.911740 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:22.911713    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:23.159299 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:23.159222    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:45:40.990119 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:40.990083    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"]
Sep 14 10:45:40.990916 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:40.990885    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk" podUID="d137b411-2aea-4083-b5c1-81a8d486a71d" containerName="maas-api" containerID="cri-o://9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef" gracePeriod=30
Sep 14 10:45:41.244697 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.244612    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:45:41.254508 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.254482    2578 generic.go:356] "Generic (PLEG): container finished" podID="d137b411-2aea-4083-b5c1-81a8d486a71d" containerID="9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef" exitCode=0
Sep 14 10:45:41.254633 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.254522    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"
Sep 14 10:45:41.254633 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.254559    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk" event={"ID":"d137b411-2aea-4083-b5c1-81a8d486a71d","Type":"ContainerDied","Data":"9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef"}
Sep 14 10:45:41.254759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.254641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk" event={"ID":"d137b411-2aea-4083-b5c1-81a8d486a71d","Type":"ContainerDied","Data":"3875c68231107005aad332fd785efb134a8ea524eabdf897f9b0df39fdb1b914"}
Sep 14 10:45:41.254759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.254667    2578 scope.go:117] "RemoveContainer" containerID="9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef"
Sep 14 10:45:41.265395 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.265365    2578 scope.go:117] "RemoveContainer" containerID="9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef"
Sep 14 10:45:41.265783 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:45:41.265752    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef\": container with ID starting with 9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef not found: ID does not exist" containerID="9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef"
Sep 14 10:45:41.265910 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.265800    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef"} err="failed to get container status \"9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef\": rpc error: code = NotFound desc = could not find container \"9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef\": container with ID starting with 9170c07367a55bebcc644c9486a75108af70da02c8a853d39b9d782155668eef not found: ID does not exist"
Sep 14 10:45:41.343431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.343398    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-metrics-certs\") pod \"d137b411-2aea-4083-b5c1-81a8d486a71d\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") "
Sep 14 10:45:41.343612 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.343491    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d137b411-2aea-4083-b5c1-81a8d486a71d-openshift-service-ca\") pod \"d137b411-2aea-4083-b5c1-81a8d486a71d\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") "
Sep 14 10:45:41.343612 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.343511    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-maas-api-tls\") pod \"d137b411-2aea-4083-b5c1-81a8d486a71d\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") "
Sep 14 10:45:41.343612 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.343582    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jft9j\" (UniqueName: \"kubernetes.io/projected/d137b411-2aea-4083-b5c1-81a8d486a71d-kube-api-access-jft9j\") pod \"d137b411-2aea-4083-b5c1-81a8d486a71d\" (UID: \"d137b411-2aea-4083-b5c1-81a8d486a71d\") "
Sep 14 10:45:41.343896 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.343862    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d137b411-2aea-4083-b5c1-81a8d486a71d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d137b411-2aea-4083-b5c1-81a8d486a71d" (UID: "d137b411-2aea-4083-b5c1-81a8d486a71d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:45:41.345634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.345607    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d137b411-2aea-4083-b5c1-81a8d486a71d" (UID: "d137b411-2aea-4083-b5c1-81a8d486a71d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:45:41.345752 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.345707    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d137b411-2aea-4083-b5c1-81a8d486a71d" (UID: "d137b411-2aea-4083-b5c1-81a8d486a71d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:45:41.345802 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.345770    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d137b411-2aea-4083-b5c1-81a8d486a71d-kube-api-access-jft9j" (OuterVolumeSpecName: "kube-api-access-jft9j") pod "d137b411-2aea-4083-b5c1-81a8d486a71d" (UID: "d137b411-2aea-4083-b5c1-81a8d486a71d"). InnerVolumeSpecName "kube-api-access-jft9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:45:41.444661 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.444624    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:45:41.444845 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.444653    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d137b411-2aea-4083-b5c1-81a8d486a71d-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:45:41.444845 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.444697    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d137b411-2aea-4083-b5c1-81a8d486a71d-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:45:41.444845 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.444710    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jft9j\" (UniqueName: \"kubernetes.io/projected/d137b411-2aea-4083-b5c1-81a8d486a71d-kube-api-access-jft9j\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:45:41.581804 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.581768    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"]
Sep 14 10:45:41.586090 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:41.586064    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-85d3ec-6d4977f65d-gjglk"]
Sep 14 10:45:42.978330 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:45:42.978301    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d137b411-2aea-4083-b5c1-81a8d486a71d" path="/var/lib/kubelet/pods/d137b411-2aea-4083-b5c1-81a8d486a71d/volumes"
Sep 14 10:46:46.083646 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.083614    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"]
Sep 14 10:46:46.084236 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.083943    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2" podUID="23c0a06f-0ba7-4136-afd4-d83827340d57" containerName="maas-api" containerID="cri-o://b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b" gracePeriod=30
Sep 14 10:46:46.329634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.329609    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:46:46.427260 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.427181    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-maas-api-tls\") pod \"23c0a06f-0ba7-4136-afd4-d83827340d57\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") "
Sep 14 10:46:46.427260 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.427236    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c0a06f-0ba7-4136-afd4-d83827340d57-openshift-service-ca\") pod \"23c0a06f-0ba7-4136-afd4-d83827340d57\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") "
Sep 14 10:46:46.427464 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.427278    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-metrics-certs\") pod \"23c0a06f-0ba7-4136-afd4-d83827340d57\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") "
Sep 14 10:46:46.427464 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.427312    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7ctc\" (UniqueName: \"kubernetes.io/projected/23c0a06f-0ba7-4136-afd4-d83827340d57-kube-api-access-k7ctc\") pod \"23c0a06f-0ba7-4136-afd4-d83827340d57\" (UID: \"23c0a06f-0ba7-4136-afd4-d83827340d57\") "
Sep 14 10:46:46.427668 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.427639    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c0a06f-0ba7-4136-afd4-d83827340d57-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "23c0a06f-0ba7-4136-afd4-d83827340d57" (UID: "23c0a06f-0ba7-4136-afd4-d83827340d57"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:46:46.429512 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.429478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "23c0a06f-0ba7-4136-afd4-d83827340d57" (UID: "23c0a06f-0ba7-4136-afd4-d83827340d57"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:46:46.429622 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.429522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "23c0a06f-0ba7-4136-afd4-d83827340d57" (UID: "23c0a06f-0ba7-4136-afd4-d83827340d57"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:46:46.429622 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.429600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c0a06f-0ba7-4136-afd4-d83827340d57-kube-api-access-k7ctc" (OuterVolumeSpecName: "kube-api-access-k7ctc") pod "23c0a06f-0ba7-4136-afd4-d83827340d57" (UID: "23c0a06f-0ba7-4136-afd4-d83827340d57"). InnerVolumeSpecName "kube-api-access-k7ctc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:46:46.528789 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.528757    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:46:46.528789 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.528786    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c0a06f-0ba7-4136-afd4-d83827340d57-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:46:46.528789 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.528795    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c0a06f-0ba7-4136-afd4-d83827340d57-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:46:46.529018 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.528803    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7ctc\" (UniqueName: \"kubernetes.io/projected/23c0a06f-0ba7-4136-afd4-d83827340d57-kube-api-access-k7ctc\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:46:46.608920 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.608886    2578 generic.go:356] "Generic (PLEG): container finished" podID="23c0a06f-0ba7-4136-afd4-d83827340d57" containerID="b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b" exitCode=0
Sep 14 10:46:46.609082 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.608937    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"
Sep 14 10:46:46.609082 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.608976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2" event={"ID":"23c0a06f-0ba7-4136-afd4-d83827340d57","Type":"ContainerDied","Data":"b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b"}
Sep 14 10:46:46.609082 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.609046    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2" event={"ID":"23c0a06f-0ba7-4136-afd4-d83827340d57","Type":"ContainerDied","Data":"77b42f28e11e6928196f78d7582679c15a23b328b4f64dec292fef12b78b2148"}
Sep 14 10:46:46.609082 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.609075    2578 scope.go:117] "RemoveContainer" containerID="b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b"
Sep 14 10:46:46.618538 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.618521    2578 scope.go:117] "RemoveContainer" containerID="b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b"
Sep 14 10:46:46.618827 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:46:46.618807    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b\": container with ID starting with b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b not found: ID does not exist" containerID="b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b"
Sep 14 10:46:46.618919 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.618833    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b"} err="failed to get container status \"b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b\": rpc error: code = NotFound desc = could not find container \"b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b\": container with ID starting with b3b1fcabe242a617af4267e79453aa9abcd93623338fb395c6478ddd83bbc69b not found: ID does not exist"
Sep 14 10:46:46.632937 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.632908    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"]
Sep 14 10:46:46.639413 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.639391    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5bbd7765-867f5d54ff-msth2"]
Sep 14 10:46:46.977705 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:46:46.977648    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23c0a06f-0ba7-4136-afd4-d83827340d57" path="/var/lib/kubelet/pods/23c0a06f-0ba7-4136-afd4-d83827340d57/volumes"
Sep 14 10:47:38.123318 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:38.123244    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"]
Sep 14 10:47:38.123904 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:38.123472    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy" containerID="cri-o://b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70" gracePeriod=30
Sep 14 10:47:43.375133 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.375107    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:47:43.529589 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529520    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-podinfo\") pod \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") "
Sep 14 10:47:43.529589 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529548    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-token\") pod \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") "
Sep 14 10:47:43.529834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529606    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-credential-socket\") pod \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") "
Sep 14 10:47:43.529834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529629    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-envoy\") pod \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") "
Sep 14 10:47:43.529834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-data\") pod \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") "
Sep 14 10:47:43.529834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529764    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcd76\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-kube-api-access-fcd76\") pod \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") "
Sep 14 10:47:43.529834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-socket\") pod \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") "
Sep 14 10:47:43.530091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529885    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istiod-ca-cert\") pod \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") "
Sep 14 10:47:43.530091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529911    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-certs\") pod \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\" (UID: \"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3\") "
Sep 14 10:47:43.530091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529941    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" (UID: "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:47:43.530091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.529951    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" (UID: "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:47:43.530402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.530158    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" (UID: "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:47:43.530402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.530269    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" (UID: "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:47:43.530402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.530315    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" (UID: "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:47:43.530621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.530365    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:47:43.530621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.530515    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istiod-ca-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:47:43.530621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.530555    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-credential-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:47:43.530621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.530568    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-data\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:47:43.531976 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.531946    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" (UID: "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:47:43.531976 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.531965    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" (UID: "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:47:43.532111 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.531996    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" (UID: "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:47:43.532111 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.532052    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-kube-api-access-fcd76" (OuterVolumeSpecName: "kube-api-access-fcd76") pod "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" (UID: "cd7b61d3-5f52-448f-8af0-e7223ec3ceb3"). InnerVolumeSpecName "kube-api-access-fcd76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:47:43.631006 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.630981    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-envoy\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:47:43.631006 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.631003    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcd76\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-kube-api-access-fcd76\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:47:43.631134 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.631013    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-workload-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:47:43.631134 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.631021    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-podinfo\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:47:43.631134 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.631028    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3-istio-token\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:47:43.919769 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.919744    2578 generic.go:356] "Generic (PLEG): container finished" podID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerID="b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70" exitCode=0
Sep 14 10:47:43.919930 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.919793    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"
Sep 14 10:47:43.919930 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.919830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" event={"ID":"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3","Type":"ContainerDied","Data":"b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70"}
Sep 14 10:47:43.919930 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.919886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt" event={"ID":"cd7b61d3-5f52-448f-8af0-e7223ec3ceb3","Type":"ContainerDied","Data":"3e2058ea97a73ad86bcca4fc533b4d9ac0a466c38679e70937aaa3ba6dfd14bf"}
Sep 14 10:47:43.919930 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.919909    2578 scope.go:117] "RemoveContainer" containerID="b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70"
Sep 14 10:47:43.929940 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.929923    2578 scope.go:117] "RemoveContainer" containerID="d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b"
Sep 14 10:47:43.938026 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.938010    2578 scope.go:117] "RemoveContainer" containerID="b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70"
Sep 14 10:47:43.938266 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:47:43.938249    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70\": container with ID starting with b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70 not found: ID does not exist" containerID="b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70"
Sep 14 10:47:43.938308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.938274    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70"} err="failed to get container status \"b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70\": rpc error: code = NotFound desc = could not find container \"b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70\": container with ID starting with b29c409e96869473dcd342644d05c3eecdf5fbbf80a673b370e28c25504f8e70 not found: ID does not exist"
Sep 14 10:47:43.938308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.938296    2578 scope.go:117] "RemoveContainer" containerID="d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b"
Sep 14 10:47:43.938563 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:47:43.938544    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b\": container with ID starting with d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b not found: ID does not exist" containerID="d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b"
Sep 14 10:47:43.938653 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.938569    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b"} err="failed to get container status \"d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b\": rpc error: code = NotFound desc = could not find container \"d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b\": container with ID starting with d3ec465214d3392b86023e6faa4858a60e4dada27c027e11f4d7ff1be759f96b not found: ID does not exist"
Sep 14 10:47:43.961830 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.961805    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"]
Sep 14 10:47:43.965400 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:43.965379    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5bbd7765-openshift-default-7b87658c64-l67kt"]
Sep 14 10:47:44.977475 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:47:44.977442    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" path="/var/lib/kubelet/pods/cd7b61d3-5f52-448f-8af0-e7223ec3ceb3/volumes"
Sep 14 10:49:07.779238 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.779203    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"]
Sep 14 10:49:07.779889 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.779868    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy"
Sep 14 10:49:07.779938 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.779893    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy"
Sep 14 10:49:07.779973 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.779942    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c0a06f-0ba7-4136-afd4-d83827340d57" containerName="maas-api"
Sep 14 10:49:07.779973 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.779950    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c0a06f-0ba7-4136-afd4-d83827340d57" containerName="maas-api"
Sep 14 10:49:07.779973 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.779967    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d137b411-2aea-4083-b5c1-81a8d486a71d" containerName="maas-api"
Sep 14 10:49:07.780067 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.779976    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d137b411-2aea-4083-b5c1-81a8d486a71d" containerName="maas-api"
Sep 14 10:49:07.780110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.780087    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy"
Sep 14 10:49:07.780110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.780098    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy"
Sep 14 10:49:07.780209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.780114    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c0a06f-0ba7-4136-afd4-d83827340d57" containerName="maas-api"
Sep 14 10:49:07.780209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.780124    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d137b411-2aea-4083-b5c1-81a8d486a71d" containerName="maas-api"
Sep 14 10:49:07.783424 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.783407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:07.786617 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.786597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ea2835-openshift-default-dockercfg-ws5kp\""
Sep 14 10:49:07.795461 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.795435    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"]
Sep 14 10:49:07.900347 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.900314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/409e494d-419c-415c-945d-04246586e7bd-istiod-ca-cert\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:07.900347 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.900350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-envoy\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:07.900605 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.900369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-socket\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:07.900605 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.900420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vc2z\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-kube-api-access-6vc2z\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:07.900605 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.900482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-certs\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:07.900605 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.900519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-credential-socket\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:07.900605 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.900550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-istio-token\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:07.900605 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.900588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-data\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:07.900877 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:07.900649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/409e494d-419c-415c-945d-04246586e7bd-istio-podinfo\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001237 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vc2z\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-kube-api-access-6vc2z\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001450 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-certs\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001450 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-credential-socket\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001450 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-istio-token\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001450 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-data\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/409e494d-419c-415c-945d-04246586e7bd-istio-podinfo\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/409e494d-419c-415c-945d-04246586e7bd-istiod-ca-cert\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-envoy\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001719 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-socket\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001933 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-credential-socket\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001933 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001774    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-certs\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.001933 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-data\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.002087 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.001975    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-socket\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.002192 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.002175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/409e494d-419c-415c-945d-04246586e7bd-istiod-ca-cert\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.003958 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.003937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-envoy\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.004268 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.004250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/409e494d-419c-415c-945d-04246586e7bd-istio-podinfo\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.011003 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.010977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-istio-token\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.011206 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.011186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vc2z\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-kube-api-access-6vc2z\") pod \"e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") " pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.094724 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.094699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:08.376180 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.376152    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"]
Sep 14 10:49:08.376565 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:49:08.376544    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409e494d_419c_415c_945d_04246586e7bd.slice/crio-a96e87605a42482fd12ec6e3d2b9c9c1c354194e69daa717ff2228458297f866 WatchSource:0}: Error finding container a96e87605a42482fd12ec6e3d2b9c9c1c354194e69daa717ff2228458297f866: Status 404 returned error can't find the container with id a96e87605a42482fd12ec6e3d2b9c9c1c354194e69daa717ff2228458297f866
Sep 14 10:49:08.378805 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.378770    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:49:08.378912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.378830    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:49:08.378912 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:08.378859    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:49:09.384733 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:09.384700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" event={"ID":"409e494d-419c-415c-945d-04246586e7bd","Type":"ContainerStarted","Data":"afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d"}
Sep 14 10:49:09.385106 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:09.384754    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" event={"ID":"409e494d-419c-415c-945d-04246586e7bd","Type":"ContainerStarted","Data":"a96e87605a42482fd12ec6e3d2b9c9c1c354194e69daa717ff2228458297f866"}
Sep 14 10:49:09.418658 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:09.418611    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" podStartSLOduration=2.418597774 podStartE2EDuration="2.418597774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:09.415426015 +0000 UTC m=+1446.956827816" watchObservedRunningTime="2026-09-14 10:49:09.418597774 +0000 UTC m=+1446.959999574"
Sep 14 10:49:10.095426 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:10.095382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:10.100986 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:10.100956    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:10.390731 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:10.390634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:10.391664 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:10.391647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:18.064472 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.064440    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"]
Sep 14 10:49:18.064863 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.064850    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy"
Sep 14 10:49:18.064863 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.064865    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd7b61d3-5f52-448f-8af0-e7223ec3ceb3" containerName="istio-proxy"
Sep 14 10:49:18.068122 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.068103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:18.071003 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.070986    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ea2835-dockercfg-t8c72\""
Sep 14 10:49:18.071345 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.071330    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ea2835\""
Sep 14 10:49:18.085829 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.085808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"]
Sep 14 10:49:18.199455 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.199081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krrkl\" (UniqueName: \"kubernetes.io/projected/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-kube-api-access-krrkl\") pod \"payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478\" (UID: \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\") " pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:18.199455 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.199174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478\" (UID: \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\") " pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:18.300734 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.300668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krrkl\" (UniqueName: \"kubernetes.io/projected/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-kube-api-access-krrkl\") pod \"payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478\" (UID: \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\") " pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:18.300925 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.300756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478\" (UID: \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\") " pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:18.301469 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.301444    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478\" (UID: \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\") " pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:18.310019 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.309992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krrkl\" (UniqueName: \"kubernetes.io/projected/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-kube-api-access-krrkl\") pod \"payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478\" (UID: \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\") " pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:18.378837 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.378810    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:18.657518 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:18.657494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"]
Sep 14 10:49:18.658397 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:49:18.658376    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39698b1_3d73_4260_82f5_f3a20d1ccbb7.slice/crio-ce8e50c86e40469029f1e5f85da053cd5c8d01fb86a0fe2c8dd821b58adc84b9 WatchSource:0}: Error finding container ce8e50c86e40469029f1e5f85da053cd5c8d01fb86a0fe2c8dd821b58adc84b9: Status 404 returned error can't find the container with id ce8e50c86e40469029f1e5f85da053cd5c8d01fb86a0fe2c8dd821b58adc84b9
Sep 14 10:49:19.446888 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:19.446844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478" event={"ID":"e39698b1-3d73-4260-82f5-f3a20d1ccbb7","Type":"ContainerStarted","Data":"0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097"}
Sep 14 10:49:19.447260 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:19.446915    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:19.447260 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:19.446938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478" event={"ID":"e39698b1-3d73-4260-82f5-f3a20d1ccbb7","Type":"ContainerStarted","Data":"ce8e50c86e40469029f1e5f85da053cd5c8d01fb86a0fe2c8dd821b58adc84b9"}
Sep 14 10:49:19.491631 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:19.491582    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478" podStartSLOduration=1.491567591 podStartE2EDuration="1.491567591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:19.49042706 +0000 UTC m=+1457.031828860" watchObservedRunningTime="2026-09-14 10:49:19.491567591 +0000 UTC m=+1457.032969436"
Sep 14 10:49:30.462220 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:30.462182    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:49:38.578871 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:38.578840    2578 generic.go:356] "Generic (PLEG): container finished" podID="409e494d-419c-415c-945d-04246586e7bd" containerID="afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d" exitCode=0
Sep 14 10:49:38.579292 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:38.578911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" event={"ID":"409e494d-419c-415c-945d-04246586e7bd","Type":"ContainerDied","Data":"afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d"}
Sep 14 10:49:38.579292 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:38.579276    2578 scope.go:117] "RemoveContainer" containerID="afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d"
Sep 14 10:49:38.580377 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:38.580344    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:49:38.580478 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:38.580414    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:49:38.580478 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:38.580447    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:49:39.587312 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:39.587278    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" event={"ID":"409e494d-419c-415c-945d-04246586e7bd","Type":"ContainerStarted","Data":"d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f"}
Sep 14 10:49:40.095108 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:40.095077    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:40.096155 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:40.096130    2578 patch_prober.go:28] interesting pod/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 14 10:49:40.096273 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:40.096186    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 14 10:49:40.390712 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:40.390585    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:41.095551 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:41.095516    2578 patch_prober.go:28] interesting pod/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 14 10:49:41.095967 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:41.095571    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 14 10:49:42.095433 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:42.095396    2578 patch_prober.go:28] interesting pod/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 14 10:49:42.095616 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:42.095447    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 14 10:49:43.095080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:43.095041    2578 patch_prober.go:28] interesting pod/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 14 10:49:43.095264 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:43.095110    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 14 10:49:44.095287 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:44.095253    2578 patch_prober.go:28] interesting pod/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 14 10:49:44.095700 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:44.095333    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 14 10:49:45.096024 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:45.095988    2578 patch_prober.go:28] interesting pod/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 14 10:49:45.096404 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:45.096082    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 14 10:49:46.100361 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:46.100319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:49:46.101421 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:49:46.101401    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:50:15.289792 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:15.289761    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"]
Sep 14 10:50:21.032867 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.032835    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"]
Sep 14 10:50:21.033299 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.033033    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb" podUID="c9535705-d1d0-4c5b-ad5f-6a089d1322d3" containerName="maas-api" containerID="cri-o://b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364" gracePeriod=30
Sep 14 10:50:21.106900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.106866    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"]
Sep 14 10:50:21.107090 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.107064    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw" podUID="f88332ab-3d7e-42d6-a814-7d5f4a61f8a4" containerName="payload-pre-processing" containerID="cri-o://f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c" gracePeriod=30
Sep 14 10:50:21.387908 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.387878    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:50:21.416029 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.416004    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:50:21.495408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.495377    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-maas-api-tls\") pod \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") "
Sep 14 10:50:21.495572 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.495416    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb9fh\" (UniqueName: \"kubernetes.io/projected/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-kube-api-access-mb9fh\") pod \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") "
Sep 14 10:50:21.495572 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.495463    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzx8v\" (UniqueName: \"kubernetes.io/projected/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-kube-api-access-mzx8v\") pod \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\" (UID: \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\") "
Sep 14 10:50:21.495572 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.495489    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-plugins-config-volume\") pod \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\" (UID: \"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4\") "
Sep 14 10:50:21.495572 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.495544    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-metrics-certs\") pod \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") "
Sep 14 10:50:21.495825 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.495657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-openshift-service-ca\") pod \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\" (UID: \"c9535705-d1d0-4c5b-ad5f-6a089d1322d3\") "
Sep 14 10:50:21.495959 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.495929    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f88332ab-3d7e-42d6-a814-7d5f4a61f8a4" (UID: "f88332ab-3d7e-42d6-a814-7d5f4a61f8a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:21.496072 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.496007    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9535705-d1d0-4c5b-ad5f-6a089d1322d3" (UID: "c9535705-d1d0-4c5b-ad5f-6a089d1322d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:21.496132 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.496111    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:21.496192 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.496131    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:21.497697 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.497658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-kube-api-access-mb9fh" (OuterVolumeSpecName: "kube-api-access-mb9fh") pod "c9535705-d1d0-4c5b-ad5f-6a089d1322d3" (UID: "c9535705-d1d0-4c5b-ad5f-6a089d1322d3"). InnerVolumeSpecName "kube-api-access-mb9fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:21.497784 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.497731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c9535705-d1d0-4c5b-ad5f-6a089d1322d3" (UID: "c9535705-d1d0-4c5b-ad5f-6a089d1322d3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:50:21.498171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.498151    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9535705-d1d0-4c5b-ad5f-6a089d1322d3" (UID: "c9535705-d1d0-4c5b-ad5f-6a089d1322d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:50:21.498231 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.498165    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-kube-api-access-mzx8v" (OuterVolumeSpecName: "kube-api-access-mzx8v") pod "f88332ab-3d7e-42d6-a814-7d5f4a61f8a4" (UID: "f88332ab-3d7e-42d6-a814-7d5f4a61f8a4"). InnerVolumeSpecName "kube-api-access-mzx8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:21.596994 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.596970    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:21.596994 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.596994    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb9fh\" (UniqueName: \"kubernetes.io/projected/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-kube-api-access-mb9fh\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:21.597163 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.597005    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzx8v\" (UniqueName: \"kubernetes.io/projected/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4-kube-api-access-mzx8v\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:21.597163 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.597015    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9535705-d1d0-4c5b-ad5f-6a089d1322d3-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:21.821699 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.821642    2578 generic.go:356] "Generic (PLEG): container finished" podID="f88332ab-3d7e-42d6-a814-7d5f4a61f8a4" containerID="f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c" exitCode=0
Sep 14 10:50:21.821883 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.821710    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"
Sep 14 10:50:21.821883 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.821736    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw" event={"ID":"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4","Type":"ContainerDied","Data":"f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c"}
Sep 14 10:50:21.821883 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.821845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw" event={"ID":"f88332ab-3d7e-42d6-a814-7d5f4a61f8a4","Type":"ContainerDied","Data":"396b83ecf2b6fba014b6f74c01378855bb6fff07136ce5c854c15b1a74c5923a"}
Sep 14 10:50:21.822054 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.821898    2578 scope.go:117] "RemoveContainer" containerID="f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c"
Sep 14 10:50:21.823338 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.823310    2578 generic.go:356] "Generic (PLEG): container finished" podID="c9535705-d1d0-4c5b-ad5f-6a089d1322d3" containerID="b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364" exitCode=0
Sep 14 10:50:21.823449 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.823364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb" event={"ID":"c9535705-d1d0-4c5b-ad5f-6a089d1322d3","Type":"ContainerDied","Data":"b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364"}
Sep 14 10:50:21.823449 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.823404    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb" event={"ID":"c9535705-d1d0-4c5b-ad5f-6a089d1322d3","Type":"ContainerDied","Data":"255a1ff62f5489fcafc21cddc45567ca52fe6c63dba83dcab22110ede4099fe9"}
Sep 14 10:50:21.823565 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.823467    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"
Sep 14 10:50:21.835592 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.835487    2578 scope.go:117] "RemoveContainer" containerID="f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c"
Sep 14 10:50:21.836155 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:21.836128    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c\": container with ID starting with f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c not found: ID does not exist" containerID="f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c"
Sep 14 10:50:21.836310 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.836286    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c"} err="failed to get container status \"f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c\": rpc error: code = NotFound desc = could not find container \"f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c\": container with ID starting with f6f10c34ca5a3c07e00692677215b3105dddf984a2c7031af9b76c41f035f01c not found: ID does not exist"
Sep 14 10:50:21.836406 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.836396    2578 scope.go:117] "RemoveContainer" containerID="b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364"
Sep 14 10:50:21.847482 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.847466    2578 scope.go:117] "RemoveContainer" containerID="b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364"
Sep 14 10:50:21.847785 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:21.847764    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364\": container with ID starting with b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364 not found: ID does not exist" containerID="b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364"
Sep 14 10:50:21.847881 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.847790    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364"} err="failed to get container status \"b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364\": rpc error: code = NotFound desc = could not find container \"b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364\": container with ID starting with b5bbd4fadbf4f3925bf2a7b8c172a1307b5caab77c1c4c1d433c18e3b844c364 not found: ID does not exist"
Sep 14 10:50:21.854266 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.854239    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"]
Sep 14 10:50:21.862358 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.862334    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-1910e9-7f75599d-2klsw"]
Sep 14 10:50:21.874332 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.874312    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"]
Sep 14 10:50:21.878051 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:21.878030    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1910e9-677c95b799-tfqwb"]
Sep 14 10:50:22.977541 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:22.977512    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9535705-d1d0-4c5b-ad5f-6a089d1322d3" path="/var/lib/kubelet/pods/c9535705-d1d0-4c5b-ad5f-6a089d1322d3/volumes"
Sep 14 10:50:22.977919 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:22.977901    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f88332ab-3d7e-42d6-a814-7d5f4a61f8a4" path="/var/lib/kubelet/pods/f88332ab-3d7e-42d6-a814-7d5f4a61f8a4/volumes"
Sep 14 10:50:25.958754 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:25.958600    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"]
Sep 14 10:50:25.959254 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:25.958851    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478" podUID="e39698b1-3d73-4260-82f5-f3a20d1ccbb7" containerName="payload-processing" containerID="cri-o://0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097" gracePeriod=30
Sep 14 10:50:26.240009 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.239983    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:50:26.361933 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.361895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krrkl\" (UniqueName: \"kubernetes.io/projected/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-kube-api-access-krrkl\") pod \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\" (UID: \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\") "
Sep 14 10:50:26.361933 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.361933    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-plugins-config-volume\") pod \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\" (UID: \"e39698b1-3d73-4260-82f5-f3a20d1ccbb7\") "
Sep 14 10:50:26.362317 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.362294    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e39698b1-3d73-4260-82f5-f3a20d1ccbb7" (UID: "e39698b1-3d73-4260-82f5-f3a20d1ccbb7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:26.364113 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.364089    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-kube-api-access-krrkl" (OuterVolumeSpecName: "kube-api-access-krrkl") pod "e39698b1-3d73-4260-82f5-f3a20d1ccbb7" (UID: "e39698b1-3d73-4260-82f5-f3a20d1ccbb7"). InnerVolumeSpecName "kube-api-access-krrkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:26.462969 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.462927    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krrkl\" (UniqueName: \"kubernetes.io/projected/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-kube-api-access-krrkl\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:26.462969 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.462958    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e39698b1-3d73-4260-82f5-f3a20d1ccbb7-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:26.858514 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.858480    2578 generic.go:356] "Generic (PLEG): container finished" podID="e39698b1-3d73-4260-82f5-f3a20d1ccbb7" containerID="0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097" exitCode=0
Sep 14 10:50:26.858707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.858535    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"
Sep 14 10:50:26.858707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.858565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478" event={"ID":"e39698b1-3d73-4260-82f5-f3a20d1ccbb7","Type":"ContainerDied","Data":"0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097"}
Sep 14 10:50:26.858707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.858637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478" event={"ID":"e39698b1-3d73-4260-82f5-f3a20d1ccbb7","Type":"ContainerDied","Data":"ce8e50c86e40469029f1e5f85da053cd5c8d01fb86a0fe2c8dd821b58adc84b9"}
Sep 14 10:50:26.858707 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.858659    2578 scope.go:117] "RemoveContainer" containerID="0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097"
Sep 14 10:50:26.869999 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.869979    2578 scope.go:117] "RemoveContainer" containerID="0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097"
Sep 14 10:50:26.870413 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:26.870394    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097\": container with ID starting with 0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097 not found: ID does not exist" containerID="0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097"
Sep 14 10:50:26.870480 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.870424    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097"} err="failed to get container status \"0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097\": rpc error: code = NotFound desc = could not find container \"0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097\": container with ID starting with 0c364531fb93d6c091b1d555840aff61f9c5593b5a9cc3e43c3405dc2dee8097 not found: ID does not exist"
Sep 14 10:50:26.895876 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.895855    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"]
Sep 14 10:50:26.907165 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.907144    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ea2835-59746c6f6f-zh478"]
Sep 14 10:50:26.976795 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:26.976772    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e39698b1-3d73-4260-82f5-f3a20d1ccbb7" path="/var/lib/kubelet/pods/e39698b1-3d73-4260-82f5-f3a20d1ccbb7/volumes"
Sep 14 10:50:29.509327 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:29.509295    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"]
Sep 14 10:50:29.509739 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:29.509523    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy" containerID="cri-o://5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5" gracePeriod=30
Sep 14 10:50:30.311198 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.311139    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc" podUID="086903ad-af5f-4edd-996c-61a0a53e6443" containerName="main" containerID="cri-o://67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42" gracePeriod=45
Sep 14 10:50:30.549037 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.549017    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:50:30.703943 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.703914    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-home\") pod \"086903ad-af5f-4edd-996c-61a0a53e6443\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") "
Sep 14 10:50:30.704105 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.703981    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/086903ad-af5f-4edd-996c-61a0a53e6443-tls-certs\") pod \"086903ad-af5f-4edd-996c-61a0a53e6443\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") "
Sep 14 10:50:30.704105 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.704011    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-dshm\") pod \"086903ad-af5f-4edd-996c-61a0a53e6443\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") "
Sep 14 10:50:30.704105 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.704066    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsgn9\" (UniqueName: \"kubernetes.io/projected/086903ad-af5f-4edd-996c-61a0a53e6443-kube-api-access-vsgn9\") pod \"086903ad-af5f-4edd-996c-61a0a53e6443\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") "
Sep 14 10:50:30.704269 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.704116    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-tmp-dir\") pod \"086903ad-af5f-4edd-996c-61a0a53e6443\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") "
Sep 14 10:50:30.704269 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.704144    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-model-cache\") pod \"086903ad-af5f-4edd-996c-61a0a53e6443\" (UID: \"086903ad-af5f-4edd-996c-61a0a53e6443\") "
Sep 14 10:50:30.704269 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.704202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-home" (OuterVolumeSpecName: "home") pod "086903ad-af5f-4edd-996c-61a0a53e6443" (UID: "086903ad-af5f-4edd-996c-61a0a53e6443"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:30.704431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.704376    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "086903ad-af5f-4edd-996c-61a0a53e6443" (UID: "086903ad-af5f-4edd-996c-61a0a53e6443"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:30.704561 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.704537    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-tmp-dir\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:30.704561 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.704543    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-model-cache" (OuterVolumeSpecName: "model-cache") pod "086903ad-af5f-4edd-996c-61a0a53e6443" (UID: "086903ad-af5f-4edd-996c-61a0a53e6443"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:30.704739 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.704563    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-home\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:30.706373 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.706347    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-dshm" (OuterVolumeSpecName: "dshm") pod "086903ad-af5f-4edd-996c-61a0a53e6443" (UID: "086903ad-af5f-4edd-996c-61a0a53e6443"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:30.706460 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.706386    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/086903ad-af5f-4edd-996c-61a0a53e6443-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "086903ad-af5f-4edd-996c-61a0a53e6443" (UID: "086903ad-af5f-4edd-996c-61a0a53e6443"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:50:30.706515 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.706499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/086903ad-af5f-4edd-996c-61a0a53e6443-kube-api-access-vsgn9" (OuterVolumeSpecName: "kube-api-access-vsgn9") pod "086903ad-af5f-4edd-996c-61a0a53e6443" (UID: "086903ad-af5f-4edd-996c-61a0a53e6443"). InnerVolumeSpecName "kube-api-access-vsgn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:30.805853 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.805829    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsgn9\" (UniqueName: \"kubernetes.io/projected/086903ad-af5f-4edd-996c-61a0a53e6443-kube-api-access-vsgn9\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:30.805853 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.805850    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-model-cache\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:30.805983 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.805859    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/086903ad-af5f-4edd-996c-61a0a53e6443-tls-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:30.805983 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.805867    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/086903ad-af5f-4edd-996c-61a0a53e6443-dshm\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:30.882360 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.882337    2578 generic.go:356] "Generic (PLEG): container finished" podID="086903ad-af5f-4edd-996c-61a0a53e6443" containerID="67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42" exitCode=0
Sep 14 10:50:30.882463 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.882378    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"
Sep 14 10:50:30.882463 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.882398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc" event={"ID":"086903ad-af5f-4edd-996c-61a0a53e6443","Type":"ContainerDied","Data":"67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42"}
Sep 14 10:50:30.882463 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.882429    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc" event={"ID":"086903ad-af5f-4edd-996c-61a0a53e6443","Type":"ContainerDied","Data":"c7e8eb6a1a0fcc99bdd98f6d6ff34b22d79e9e23548e1e0221ab2e5fd4098415"}
Sep 14 10:50:30.882463 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.882445    2578 scope.go:117] "RemoveContainer" containerID="67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42"
Sep 14 10:50:30.891172 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.891158    2578 scope.go:117] "RemoveContainer" containerID="67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42"
Sep 14 10:50:30.891414 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:30.891397    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42\": container with ID starting with 67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42 not found: ID does not exist" containerID="67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42"
Sep 14 10:50:30.891513 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.891426    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42"} err="failed to get container status \"67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42\": rpc error: code = NotFound desc = could not find container \"67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42\": container with ID starting with 67cbca46e6c49d9aa4bf349214e470b398482809a0548ab590d6b580af430d42 not found: ID does not exist"
Sep 14 10:50:30.905223 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.905201    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"]
Sep 14 10:50:30.909041 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.909019    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/auth-test-model-1cbcd0-kserve-7cd74c56ff-cbsgc"]
Sep 14 10:50:30.977147 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:30.977086    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="086903ad-af5f-4edd-996c-61a0a53e6443" path="/var/lib/kubelet/pods/086903ad-af5f-4edd-996c-61a0a53e6443/volumes"
Sep 14 10:50:33.578721 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:33.578688    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"]
Sep 14 10:50:33.579185 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:33.578886    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy" containerID="cri-o://d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f" gracePeriod=30
Sep 14 10:50:34.754979 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.754957    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:50:34.905738 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.905708    2578 generic.go:356] "Generic (PLEG): container finished" podID="8337f636-aaa5-445b-a337-4bbca91667e8" containerID="5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5" exitCode=0
Sep 14 10:50:34.905883 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.905753    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"
Sep 14 10:50:34.905883 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.905792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" event={"ID":"8337f636-aaa5-445b-a337-4bbca91667e8","Type":"ContainerDied","Data":"5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5"}
Sep 14 10:50:34.905883 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.905846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th" event={"ID":"8337f636-aaa5-445b-a337-4bbca91667e8","Type":"ContainerDied","Data":"b07986736736fa5aaf17810d89eeaceef73420cbd3238de67bede886b5827823"}
Sep 14 10:50:34.905883 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.905868    2578 scope.go:117] "RemoveContainer" containerID="5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5"
Sep 14 10:50:34.914404 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.914378    2578 scope.go:117] "RemoveContainer" containerID="1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979"
Sep 14 10:50:34.922128 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.922112    2578 scope.go:117] "RemoveContainer" containerID="5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5"
Sep 14 10:50:34.922358 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:34.922343    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5\": container with ID starting with 5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5 not found: ID does not exist" containerID="5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5"
Sep 14 10:50:34.922408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.922366    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5"} err="failed to get container status \"5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5\": rpc error: code = NotFound desc = could not find container \"5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5\": container with ID starting with 5ddb66ecfc49a43b871069c652bd50fa490d52e77d2aecdaf0796338bb8a42d5 not found: ID does not exist"
Sep 14 10:50:34.922408 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.922380    2578 scope.go:117] "RemoveContainer" containerID="1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979"
Sep 14 10:50:34.922636 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:34.922624    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979\": container with ID starting with 1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979 not found: ID does not exist" containerID="1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979"
Sep 14 10:50:34.922700 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.922639    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979"} err="failed to get container status \"1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979\": rpc error: code = NotFound desc = could not find container \"1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979\": container with ID starting with 1294f11afb4aaec11d0afe3e0a01838da74d6e5b1690eb1057400c5002f21979 not found: ID does not exist"
Sep 14 10:50:34.941403 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941375    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5zn8\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-kube-api-access-r5zn8\") pod \"8337f636-aaa5-445b-a337-4bbca91667e8\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") "
Sep 14 10:50:34.941476 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941412    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8337f636-aaa5-445b-a337-4bbca91667e8-istio-podinfo\") pod \"8337f636-aaa5-445b-a337-4bbca91667e8\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") "
Sep 14 10:50:34.941476 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-certs\") pod \"8337f636-aaa5-445b-a337-4bbca91667e8\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") "
Sep 14 10:50:34.941552 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-credential-socket\") pod \"8337f636-aaa5-445b-a337-4bbca91667e8\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") "
Sep 14 10:50:34.941552 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941528    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8337f636-aaa5-445b-a337-4bbca91667e8-istiod-ca-cert\") pod \"8337f636-aaa5-445b-a337-4bbca91667e8\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") "
Sep 14 10:50:34.941654 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941585    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-envoy\") pod \"8337f636-aaa5-445b-a337-4bbca91667e8\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") "
Sep 14 10:50:34.941654 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941636    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-socket\") pod \"8337f636-aaa5-445b-a337-4bbca91667e8\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") "
Sep 14 10:50:34.941792 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941702    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-istio-token\") pod \"8337f636-aaa5-445b-a337-4bbca91667e8\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") "
Sep 14 10:50:34.941792 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941751    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-data\") pod \"8337f636-aaa5-445b-a337-4bbca91667e8\" (UID: \"8337f636-aaa5-445b-a337-4bbca91667e8\") "
Sep 14 10:50:34.941792 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941769    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8337f636-aaa5-445b-a337-4bbca91667e8" (UID: "8337f636-aaa5-445b-a337-4bbca91667e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:34.942110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941983    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8337f636-aaa5-445b-a337-4bbca91667e8" (UID: "8337f636-aaa5-445b-a337-4bbca91667e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:34.942110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.942035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8337f636-aaa5-445b-a337-4bbca91667e8" (UID: "8337f636-aaa5-445b-a337-4bbca91667e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:34.942110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.941994    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8337f636-aaa5-445b-a337-4bbca91667e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8337f636-aaa5-445b-a337-4bbca91667e8" (UID: "8337f636-aaa5-445b-a337-4bbca91667e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:34.942284 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.942150    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:34.942284 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.942159    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "8337f636-aaa5-445b-a337-4bbca91667e8" (UID: "8337f636-aaa5-445b-a337-4bbca91667e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:34.942284 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.942170    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-workload-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:34.942284 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.942184    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-credential-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:34.943583 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.943563    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8337f636-aaa5-445b-a337-4bbca91667e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8337f636-aaa5-445b-a337-4bbca91667e8" (UID: "8337f636-aaa5-445b-a337-4bbca91667e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:50:34.943698 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.943605    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-kube-api-access-r5zn8" (OuterVolumeSpecName: "kube-api-access-r5zn8") pod "8337f636-aaa5-445b-a337-4bbca91667e8" (UID: "8337f636-aaa5-445b-a337-4bbca91667e8"). InnerVolumeSpecName "kube-api-access-r5zn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:34.943884 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.943870    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "8337f636-aaa5-445b-a337-4bbca91667e8" (UID: "8337f636-aaa5-445b-a337-4bbca91667e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:34.944042 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:34.944025    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8337f636-aaa5-445b-a337-4bbca91667e8" (UID: "8337f636-aaa5-445b-a337-4bbca91667e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:35.042954 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:35.042933    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8337f636-aaa5-445b-a337-4bbca91667e8-istiod-ca-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:35.042954 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:35.042952    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-envoy\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:35.043070 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:35.042960    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-istio-token\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:35.043070 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:35.042968    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8337f636-aaa5-445b-a337-4bbca91667e8-istio-data\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:35.043070 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:35.042976    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5zn8\" (UniqueName: \"kubernetes.io/projected/8337f636-aaa5-445b-a337-4bbca91667e8-kube-api-access-r5zn8\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:35.043070 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:35.042984    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8337f636-aaa5-445b-a337-4bbca91667e8-istio-podinfo\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:35.224431 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:35.224369    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"]
Sep 14 10:50:35.231646 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:35.231615    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1910e9-openshift-default-68f655766-s56th"]
Sep 14 10:50:36.977081 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:36.977049    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" path="/var/lib/kubelet/pods/8337f636-aaa5-445b-a337-4bbca91667e8/volumes"
Sep 14 10:50:38.822578 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.822555    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:50:38.870791 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.870722    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/409e494d-419c-415c-945d-04246586e7bd-istio-podinfo\") pod \"409e494d-419c-415c-945d-04246586e7bd\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") "
Sep 14 10:50:38.870791 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.870767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-envoy\") pod \"409e494d-419c-415c-945d-04246586e7bd\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") "
Sep 14 10:50:38.870944 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.870809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-certs\") pod \"409e494d-419c-415c-945d-04246586e7bd\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") "
Sep 14 10:50:38.870944 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.870860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-istio-token\") pod \"409e494d-419c-415c-945d-04246586e7bd\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") "
Sep 14 10:50:38.870944 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.870902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-data\") pod \"409e494d-419c-415c-945d-04246586e7bd\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") "
Sep 14 10:50:38.871110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.870963    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-socket\") pod \"409e494d-419c-415c-945d-04246586e7bd\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") "
Sep 14 10:50:38.871110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871018    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vc2z\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-kube-api-access-6vc2z\") pod \"409e494d-419c-415c-945d-04246586e7bd\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") "
Sep 14 10:50:38.871110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871050    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-credential-socket\") pod \"409e494d-419c-415c-945d-04246586e7bd\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") "
Sep 14 10:50:38.871110 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871098    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/409e494d-419c-415c-945d-04246586e7bd-istiod-ca-cert\") pod \"409e494d-419c-415c-945d-04246586e7bd\" (UID: \"409e494d-419c-415c-945d-04246586e7bd\") "
Sep 14 10:50:38.871308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871113    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "409e494d-419c-415c-945d-04246586e7bd" (UID: "409e494d-419c-415c-945d-04246586e7bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:38.871308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871158    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "409e494d-419c-415c-945d-04246586e7bd" (UID: "409e494d-419c-415c-945d-04246586e7bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:38.871308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871275    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "409e494d-419c-415c-945d-04246586e7bd" (UID: "409e494d-419c-415c-945d-04246586e7bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:38.871706 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871622    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.871706 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871649    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-data\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.871706 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871662    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-workload-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.871949 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871605    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "409e494d-419c-415c-945d-04246586e7bd" (UID: "409e494d-419c-415c-945d-04246586e7bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:38.871949 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.871772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/409e494d-419c-415c-945d-04246586e7bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "409e494d-419c-415c-945d-04246586e7bd" (UID: "409e494d-419c-415c-945d-04246586e7bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:38.873157 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.873128    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "409e494d-419c-415c-945d-04246586e7bd" (UID: "409e494d-419c-415c-945d-04246586e7bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:38.873269 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.873247    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-kube-api-access-6vc2z" (OuterVolumeSpecName: "kube-api-access-6vc2z") pod "409e494d-419c-415c-945d-04246586e7bd" (UID: "409e494d-419c-415c-945d-04246586e7bd"). InnerVolumeSpecName "kube-api-access-6vc2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:38.873342 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.873307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "409e494d-419c-415c-945d-04246586e7bd" (UID: "409e494d-419c-415c-945d-04246586e7bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:38.873738 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.873722    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/409e494d-419c-415c-945d-04246586e7bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "409e494d-419c-415c-945d-04246586e7bd" (UID: "409e494d-419c-415c-945d-04246586e7bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:50:38.930456 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.930434    2578 generic.go:356] "Generic (PLEG): container finished" podID="409e494d-419c-415c-945d-04246586e7bd" containerID="d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f" exitCode=0
Sep 14 10:50:38.930555 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.930486    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"
Sep 14 10:50:38.930555 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.930518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" event={"ID":"409e494d-419c-415c-945d-04246586e7bd","Type":"ContainerDied","Data":"d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f"}
Sep 14 10:50:38.930628 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.930571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z" event={"ID":"409e494d-419c-415c-945d-04246586e7bd","Type":"ContainerDied","Data":"a96e87605a42482fd12ec6e3d2b9c9c1c354194e69daa717ff2228458297f866"}
Sep 14 10:50:38.930628 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.930591    2578 scope.go:117] "RemoveContainer" containerID="d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f"
Sep 14 10:50:38.940005 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.939991    2578 scope.go:117] "RemoveContainer" containerID="afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d"
Sep 14 10:50:38.948024 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.948010    2578 scope.go:117] "RemoveContainer" containerID="d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f"
Sep 14 10:50:38.948278 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:38.948261    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f\": container with ID starting with d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f not found: ID does not exist" containerID="d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f"
Sep 14 10:50:38.948325 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.948286    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f"} err="failed to get container status \"d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f\": rpc error: code = NotFound desc = could not find container \"d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f\": container with ID starting with d493caf3fec2eeacbb7e44b46044f30c961d08011ecdd285d832084b8c0db57f not found: ID does not exist"
Sep 14 10:50:38.948325 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.948302    2578 scope.go:117] "RemoveContainer" containerID="afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d"
Sep 14 10:50:38.948543 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:38.948527    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d\": container with ID starting with afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d not found: ID does not exist" containerID="afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d"
Sep 14 10:50:38.948586 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.948549    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d"} err="failed to get container status \"afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d\": rpc error: code = NotFound desc = could not find container \"afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d\": container with ID starting with afaf66d354d6324b61dd7c4932da2a1bedf860c42c6aba8768965b1e9ee10e0d not found: ID does not exist"
Sep 14 10:50:38.954735 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.954694    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"]
Sep 14 10:50:38.957154 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.957134    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ea2835-openshift-default-6d5787d89d-zhn5z"]
Sep 14 10:50:38.972540 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.972522    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-istio-token\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.972640 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.972543    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vc2z\" (UniqueName: \"kubernetes.io/projected/409e494d-419c-415c-945d-04246586e7bd-kube-api-access-6vc2z\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.972640 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.972556    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-credential-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.972640 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.972567    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/409e494d-419c-415c-945d-04246586e7bd-istiod-ca-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.972640 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.972580    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/409e494d-419c-415c-945d-04246586e7bd-istio-podinfo\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.972640 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.972590    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/409e494d-419c-415c-945d-04246586e7bd-istio-envoy\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.976249 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:38.976229    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="409e494d-419c-415c-945d-04246586e7bd" path="/var/lib/kubelet/pods/409e494d-419c-415c-945d-04246586e7bd/volumes"
Sep 14 10:50:44.496169 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.496132    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"]
Sep 14 10:50:44.496604 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.496380    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5" podUID="6e54a454-396b-4fae-b739-dad6462e51a1" containerName="payload-processing" containerID="cri-o://6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375" gracePeriod=30
Sep 14 10:50:44.505368 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.505334    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"]
Sep 14 10:50:44.505633 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.505578    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl" podUID="7b09935f-0b31-43ec-ac8e-6d40494b1920" containerName="payload-pre-processing" containerID="cri-o://7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100" gracePeriod=30
Sep 14 10:50:44.773758 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.773737    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:50:44.776584 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.776566    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:50:44.823436 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.821062    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw957\" (UniqueName: \"kubernetes.io/projected/7b09935f-0b31-43ec-ac8e-6d40494b1920-kube-api-access-zw957\") pod \"7b09935f-0b31-43ec-ac8e-6d40494b1920\" (UID: \"7b09935f-0b31-43ec-ac8e-6d40494b1920\") "
Sep 14 10:50:44.823436 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.821168    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e54a454-396b-4fae-b739-dad6462e51a1-plugins-config-volume\") pod \"6e54a454-396b-4fae-b739-dad6462e51a1\" (UID: \"6e54a454-396b-4fae-b739-dad6462e51a1\") "
Sep 14 10:50:44.823436 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.821195    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9kl6\" (UniqueName: \"kubernetes.io/projected/6e54a454-396b-4fae-b739-dad6462e51a1-kube-api-access-s9kl6\") pod \"6e54a454-396b-4fae-b739-dad6462e51a1\" (UID: \"6e54a454-396b-4fae-b739-dad6462e51a1\") "
Sep 14 10:50:44.823436 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.821229    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b09935f-0b31-43ec-ac8e-6d40494b1920-plugins-config-volume\") pod \"7b09935f-0b31-43ec-ac8e-6d40494b1920\" (UID: \"7b09935f-0b31-43ec-ac8e-6d40494b1920\") "
Sep 14 10:50:44.827473 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.826729    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e54a454-396b-4fae-b739-dad6462e51a1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e54a454-396b-4fae-b739-dad6462e51a1" (UID: "6e54a454-396b-4fae-b739-dad6462e51a1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:44.827949 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.827901    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b09935f-0b31-43ec-ac8e-6d40494b1920-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b09935f-0b31-43ec-ac8e-6d40494b1920" (UID: "7b09935f-0b31-43ec-ac8e-6d40494b1920"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:44.831694 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.829974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b09935f-0b31-43ec-ac8e-6d40494b1920-kube-api-access-zw957" (OuterVolumeSpecName: "kube-api-access-zw957") pod "7b09935f-0b31-43ec-ac8e-6d40494b1920" (UID: "7b09935f-0b31-43ec-ac8e-6d40494b1920"). InnerVolumeSpecName "kube-api-access-zw957". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:44.834039 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.832819    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e54a454-396b-4fae-b739-dad6462e51a1-kube-api-access-s9kl6" (OuterVolumeSpecName: "kube-api-access-s9kl6") pod "6e54a454-396b-4fae-b739-dad6462e51a1" (UID: "6e54a454-396b-4fae-b739-dad6462e51a1"). InnerVolumeSpecName "kube-api-access-s9kl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:44.924725 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.924663    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw957\" (UniqueName: \"kubernetes.io/projected/7b09935f-0b31-43ec-ac8e-6d40494b1920-kube-api-access-zw957\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:44.924725 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.924720    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e54a454-396b-4fae-b739-dad6462e51a1-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:44.924725 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.924733    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9kl6\" (UniqueName: \"kubernetes.io/projected/6e54a454-396b-4fae-b739-dad6462e51a1-kube-api-access-s9kl6\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:44.924964 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.924744    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b09935f-0b31-43ec-ac8e-6d40494b1920-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:44.966033 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.965989    2578 generic.go:356] "Generic (PLEG): container finished" podID="7b09935f-0b31-43ec-ac8e-6d40494b1920" containerID="7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100" exitCode=0
Sep 14 10:50:44.966234 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.966039    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"
Sep 14 10:50:44.966234 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.966067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl" event={"ID":"7b09935f-0b31-43ec-ac8e-6d40494b1920","Type":"ContainerDied","Data":"7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100"}
Sep 14 10:50:44.966234 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.966124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl" event={"ID":"7b09935f-0b31-43ec-ac8e-6d40494b1920","Type":"ContainerDied","Data":"2121ca3a788b73e31bdafcb5a251521a78a872b02ecb2e9db148cfd1bb129563"}
Sep 14 10:50:44.966234 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.966149    2578 scope.go:117] "RemoveContainer" containerID="7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100"
Sep 14 10:50:44.967599 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.967576    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e54a454-396b-4fae-b739-dad6462e51a1" containerID="6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375" exitCode=0
Sep 14 10:50:44.967989 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.967625    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"
Sep 14 10:50:44.967989 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.967641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5" event={"ID":"6e54a454-396b-4fae-b739-dad6462e51a1","Type":"ContainerDied","Data":"6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375"}
Sep 14 10:50:44.967989 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.967711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5" event={"ID":"6e54a454-396b-4fae-b739-dad6462e51a1","Type":"ContainerDied","Data":"7c0aac6bdc04fc097abf556c37c61b542e684612f7de8c5458419577a6a298f8"}
Sep 14 10:50:44.977113 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.977090    2578 scope.go:117] "RemoveContainer" containerID="7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100"
Sep 14 10:50:44.977503 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:44.977479    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100\": container with ID starting with 7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100 not found: ID does not exist" containerID="7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100"
Sep 14 10:50:44.977578 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.977514    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100"} err="failed to get container status \"7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100\": rpc error: code = NotFound desc = could not find container \"7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100\": container with ID starting with 7267acebc9151148072a8b32176fb903e059d8c14d759e2e6dffc1c2d2a5d100 not found: ID does not exist"
Sep 14 10:50:44.977578 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.977535    2578 scope.go:117] "RemoveContainer" containerID="6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375"
Sep 14 10:50:44.988955 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.988939    2578 scope.go:117] "RemoveContainer" containerID="6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375"
Sep 14 10:50:44.989213 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:44.989198    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375\": container with ID starting with 6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375 not found: ID does not exist" containerID="6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375"
Sep 14 10:50:44.989255 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:44.989217    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375"} err="failed to get container status \"6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375\": rpc error: code = NotFound desc = could not find container \"6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375\": container with ID starting with 6131e47e61a8e83d995568d7ef575cfe500fbc5c43b8d4ef14cf39c7749e8375 not found: ID does not exist"
Sep 14 10:50:45.051555 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:45.051501    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"]
Sep 14 10:50:45.063250 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:45.063226    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3503d7-74ccdc868f-gtds5"]
Sep 14 10:50:45.074376 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:45.074353    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"]
Sep 14 10:50:45.084800 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:45.084775    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3503d7-7855d9574b-pq4cl"]
Sep 14 10:50:46.977256 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:46.977223    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e54a454-396b-4fae-b739-dad6462e51a1" path="/var/lib/kubelet/pods/6e54a454-396b-4fae-b739-dad6462e51a1/volumes"
Sep 14 10:50:46.977772 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:46.977747    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b09935f-0b31-43ec-ac8e-6d40494b1920" path="/var/lib/kubelet/pods/7b09935f-0b31-43ec-ac8e-6d40494b1920/volumes"
Sep 14 10:50:51.449860 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:51.449828    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"]
Sep 14 10:50:51.450293 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:51.450037    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy" containerID="cri-o://299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a" gracePeriod=30
Sep 14 10:50:53.057572 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:53.057539    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:50:53.057962 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:53.057609    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:50:56.707215 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.707189    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:50:56.827622 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827554    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-certs\") pod \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") "
Sep 14 10:50:56.827622 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827595    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-token\") pod \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") "
Sep 14 10:50:56.827849 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827628    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-podinfo\") pod \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") "
Sep 14 10:50:56.827849 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827658    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istiod-ca-cert\") pod \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") "
Sep 14 10:50:56.827849 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827725    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-envoy\") pod \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") "
Sep 14 10:50:56.827849 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827748    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-socket\") pod \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") "
Sep 14 10:50:56.827849 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-credential-socket\") pod \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") "
Sep 14 10:50:56.827849 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s5nv\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-kube-api-access-7s5nv\") pod \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") "
Sep 14 10:50:56.828149 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827851    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e3e6f5c-b9be-4aa7-b9c1-a96246737695" (UID: "3e3e6f5c-b9be-4aa7-b9c1-a96246737695"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:56.828149 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827896    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-data\") pod \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\" (UID: \"3e3e6f5c-b9be-4aa7-b9c1-a96246737695\") "
Sep 14 10:50:56.828149 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.827998    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e3e6f5c-b9be-4aa7-b9c1-a96246737695" (UID: "3e3e6f5c-b9be-4aa7-b9c1-a96246737695"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:56.828149 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.828016    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e3e6f5c-b9be-4aa7-b9c1-a96246737695" (UID: "3e3e6f5c-b9be-4aa7-b9c1-a96246737695"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:56.828320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.828216    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e3e6f5c-b9be-4aa7-b9c1-a96246737695" (UID: "3e3e6f5c-b9be-4aa7-b9c1-a96246737695"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:56.828320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.828244    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:56.828320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.828264    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-workload-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:56.828320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.828278    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-credential-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:56.828443 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.828316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e3e6f5c-b9be-4aa7-b9c1-a96246737695" (UID: "3e3e6f5c-b9be-4aa7-b9c1-a96246737695"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:56.829965 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.829935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e3e6f5c-b9be-4aa7-b9c1-a96246737695" (UID: "3e3e6f5c-b9be-4aa7-b9c1-a96246737695"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:50:56.830079 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.829964    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e3e6f5c-b9be-4aa7-b9c1-a96246737695" (UID: "3e3e6f5c-b9be-4aa7-b9c1-a96246737695"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:56.830079 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.830033    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e3e6f5c-b9be-4aa7-b9c1-a96246737695" (UID: "3e3e6f5c-b9be-4aa7-b9c1-a96246737695"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:56.830079 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.830048    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-kube-api-access-7s5nv" (OuterVolumeSpecName: "kube-api-access-7s5nv") pod "3e3e6f5c-b9be-4aa7-b9c1-a96246737695" (UID: "3e3e6f5c-b9be-4aa7-b9c1-a96246737695"). InnerVolumeSpecName "kube-api-access-7s5nv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:56.929001 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.928971    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-envoy\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:56.929001 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.928996    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s5nv\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-kube-api-access-7s5nv\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:56.929001 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.929004    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-data\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:56.929213 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.929013    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-token\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:56.929213 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.929021    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istio-podinfo\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:56.929213 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:56.929028    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3e6f5c-b9be-4aa7-b9c1-a96246737695-istiod-ca-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:50:57.032658 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.032629    2578 generic.go:356] "Generic (PLEG): container finished" podID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerID="299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a" exitCode=0
Sep 14 10:50:57.032814 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.032688    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"
Sep 14 10:50:57.032814 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.032708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" event={"ID":"3e3e6f5c-b9be-4aa7-b9c1-a96246737695","Type":"ContainerDied","Data":"299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a"}
Sep 14 10:50:57.032814 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.032758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8" event={"ID":"3e3e6f5c-b9be-4aa7-b9c1-a96246737695","Type":"ContainerDied","Data":"75b7de3ee48feac747b2524c80f38c743c15a61be694a454f1a6c3b54b8d09be"}
Sep 14 10:50:57.032814 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.032778    2578 scope.go:117] "RemoveContainer" containerID="299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a"
Sep 14 10:50:57.041531 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.041516    2578 scope.go:117] "RemoveContainer" containerID="bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7"
Sep 14 10:50:57.049635 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.049618    2578 scope.go:117] "RemoveContainer" containerID="299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a"
Sep 14 10:50:57.049950 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:57.049932    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a\": container with ID starting with 299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a not found: ID does not exist" containerID="299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a"
Sep 14 10:50:57.050016 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.049957    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a"} err="failed to get container status \"299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a\": rpc error: code = NotFound desc = could not find container \"299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a\": container with ID starting with 299c3e0e93bf679bfa20d216b56f8171524fc67daf819aa07b0e4b81bae68a7a not found: ID does not exist"
Sep 14 10:50:57.050016 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.049972    2578 scope.go:117] "RemoveContainer" containerID="bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7"
Sep 14 10:50:57.050214 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:50:57.050198    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7\": container with ID starting with bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7 not found: ID does not exist" containerID="bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7"
Sep 14 10:50:57.050254 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.050218    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7"} err="failed to get container status \"bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7\": rpc error: code = NotFound desc = could not find container \"bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7\": container with ID starting with bb84730a9f964003b127a9ff915c8e0e5bfff602399ef664d8be1c58bab039c7 not found: ID does not exist"
Sep 14 10:50:57.051644 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.051625    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"]
Sep 14 10:50:57.055325 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:57.055306    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3503d7-openshift-default-5f79cd469d-5hfx8"]
Sep 14 10:50:58.981325 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:50:58.981293    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" path="/var/lib/kubelet/pods/3e3e6f5c-b9be-4aa7-b9c1-a96246737695/volumes"
Sep 14 10:51:02.348296 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.348263    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"]
Sep 14 10:51:02.348806 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.348502    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4" podUID="8a5119d9-9b64-48ea-b450-ee3151ca38f7" containerName="maas-api" containerID="cri-o://12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0" gracePeriod=30
Sep 14 10:51:02.597899 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.597877    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:51:02.674453 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.674382    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-maas-api-tls\") pod \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") "
Sep 14 10:51:02.674453 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.674450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5119d9-9b64-48ea-b450-ee3151ca38f7-openshift-service-ca\") pod \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") "
Sep 14 10:51:02.674625 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.674480    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkd9n\" (UniqueName: \"kubernetes.io/projected/8a5119d9-9b64-48ea-b450-ee3151ca38f7-kube-api-access-bkd9n\") pod \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") "
Sep 14 10:51:02.674625 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.674512    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-metrics-certs\") pod \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\" (UID: \"8a5119d9-9b64-48ea-b450-ee3151ca38f7\") "
Sep 14 10:51:02.674876 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.674847    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a5119d9-9b64-48ea-b450-ee3151ca38f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a5119d9-9b64-48ea-b450-ee3151ca38f7" (UID: "8a5119d9-9b64-48ea-b450-ee3151ca38f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:51:02.676712 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.676654    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5119d9-9b64-48ea-b450-ee3151ca38f7-kube-api-access-bkd9n" (OuterVolumeSpecName: "kube-api-access-bkd9n") pod "8a5119d9-9b64-48ea-b450-ee3151ca38f7" (UID: "8a5119d9-9b64-48ea-b450-ee3151ca38f7"). InnerVolumeSpecName "kube-api-access-bkd9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:51:02.676712 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.676668    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8a5119d9-9b64-48ea-b450-ee3151ca38f7" (UID: "8a5119d9-9b64-48ea-b450-ee3151ca38f7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:51:02.676833 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.676725    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a5119d9-9b64-48ea-b450-ee3151ca38f7" (UID: "8a5119d9-9b64-48ea-b450-ee3151ca38f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:51:02.775913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.775880    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5119d9-9b64-48ea-b450-ee3151ca38f7-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:02.775913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.775912    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkd9n\" (UniqueName: \"kubernetes.io/projected/8a5119d9-9b64-48ea-b450-ee3151ca38f7-kube-api-access-bkd9n\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:02.776097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.775925    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:02.776097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:02.775936    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5119d9-9b64-48ea-b450-ee3151ca38f7-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:03.064293 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:03.064259    2578 generic.go:356] "Generic (PLEG): container finished" podID="8a5119d9-9b64-48ea-b450-ee3151ca38f7" containerID="12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0" exitCode=0
Sep 14 10:51:03.064293 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:03.064294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4" event={"ID":"8a5119d9-9b64-48ea-b450-ee3151ca38f7","Type":"ContainerDied","Data":"12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0"}
Sep 14 10:51:03.064517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:03.064297    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"
Sep 14 10:51:03.064517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:03.064340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4" event={"ID":"8a5119d9-9b64-48ea-b450-ee3151ca38f7","Type":"ContainerDied","Data":"b449965d56a330ca26cb7db16a1ab417ef9847d5b39405be56d4e94e193ab5b1"}
Sep 14 10:51:03.064517 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:03.064363    2578 scope.go:117] "RemoveContainer" containerID="12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0"
Sep 14 10:51:03.073127 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:03.073110    2578 scope.go:117] "RemoveContainer" containerID="12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0"
Sep 14 10:51:03.073390 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:51:03.073351    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0\": container with ID starting with 12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0 not found: ID does not exist" containerID="12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0"
Sep 14 10:51:03.073482 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:03.073387    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0"} err="failed to get container status \"12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0\": rpc error: code = NotFound desc = could not find container \"12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0\": container with ID starting with 12772f0ca4a176f062052d152b6204a9117ae75440a22d12c822139015cebda0 not found: ID does not exist"
Sep 14 10:51:03.095828 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:03.095802    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"]
Sep 14 10:51:03.102398 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:03.102374    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-558928-55b4845559-rs5v4"]
Sep 14 10:51:04.976633 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:04.976601    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a5119d9-9b64-48ea-b450-ee3151ca38f7" path="/var/lib/kubelet/pods/8a5119d9-9b64-48ea-b450-ee3151ca38f7/volumes"
Sep 14 10:51:09.735483 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:09.735452    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"]
Sep 14 10:51:09.735955 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:09.735693    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy" containerID="cri-o://0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f" gracePeriod=30
Sep 14 10:51:14.968434 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:14.968411    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:51:15.072756 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.072663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-socket\") pod \"d4dc0fb2-a477-4954-9105-b9f105254cf1\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") "
Sep 14 10:51:15.072756 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.072729    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-envoy\") pod \"d4dc0fb2-a477-4954-9105-b9f105254cf1\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") "
Sep 14 10:51:15.072756 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.072746    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-credential-socket\") pod \"d4dc0fb2-a477-4954-9105-b9f105254cf1\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") "
Sep 14 10:51:15.073025 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.072777    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4dc0fb2-a477-4954-9105-b9f105254cf1-istiod-ca-cert\") pod \"d4dc0fb2-a477-4954-9105-b9f105254cf1\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") "
Sep 14 10:51:15.073025 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.072797    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-podinfo\") pod \"d4dc0fb2-a477-4954-9105-b9f105254cf1\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") "
Sep 14 10:51:15.073025 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.072812    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-data\") pod \"d4dc0fb2-a477-4954-9105-b9f105254cf1\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") "
Sep 14 10:51:15.073025 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.072828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-token\") pod \"d4dc0fb2-a477-4954-9105-b9f105254cf1\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") "
Sep 14 10:51:15.073025 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.072844    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85br6\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-kube-api-access-85br6\") pod \"d4dc0fb2-a477-4954-9105-b9f105254cf1\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") "
Sep 14 10:51:15.073025 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.072902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-certs\") pod \"d4dc0fb2-a477-4954-9105-b9f105254cf1\" (UID: \"d4dc0fb2-a477-4954-9105-b9f105254cf1\") "
Sep 14 10:51:15.073320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073094    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4dc0fb2-a477-4954-9105-b9f105254cf1" (UID: "d4dc0fb2-a477-4954-9105-b9f105254cf1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:51:15.073320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073082    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4dc0fb2-a477-4954-9105-b9f105254cf1" (UID: "d4dc0fb2-a477-4954-9105-b9f105254cf1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:51:15.073320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073123    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4dc0fb2-a477-4954-9105-b9f105254cf1" (UID: "d4dc0fb2-a477-4954-9105-b9f105254cf1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:51:15.073320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073160    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4dc0fb2-a477-4954-9105-b9f105254cf1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4dc0fb2-a477-4954-9105-b9f105254cf1" (UID: "d4dc0fb2-a477-4954-9105-b9f105254cf1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:51:15.073320 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073298    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4dc0fb2-a477-4954-9105-b9f105254cf1" (UID: "d4dc0fb2-a477-4954-9105-b9f105254cf1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:51:15.073588 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073402    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-credential-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:15.073588 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073432    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4dc0fb2-a477-4954-9105-b9f105254cf1-istiod-ca-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:15.073588 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073461    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-data\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:15.073588 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073475    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:15.073588 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.073487    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-workload-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:15.075069 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.075042    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4dc0fb2-a477-4954-9105-b9f105254cf1" (UID: "d4dc0fb2-a477-4954-9105-b9f105254cf1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:51:15.075235 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.075218    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4dc0fb2-a477-4954-9105-b9f105254cf1" (UID: "d4dc0fb2-a477-4954-9105-b9f105254cf1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:51:15.075860 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.075834    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4dc0fb2-a477-4954-9105-b9f105254cf1" (UID: "d4dc0fb2-a477-4954-9105-b9f105254cf1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:51:15.075860 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.075842    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-kube-api-access-85br6" (OuterVolumeSpecName: "kube-api-access-85br6") pod "d4dc0fb2-a477-4954-9105-b9f105254cf1" (UID: "d4dc0fb2-a477-4954-9105-b9f105254cf1"). InnerVolumeSpecName "kube-api-access-85br6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:51:15.121555 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.121533    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerID="0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f" exitCode=0
Sep 14 10:51:15.121668 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.121581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" event={"ID":"d4dc0fb2-a477-4954-9105-b9f105254cf1","Type":"ContainerDied","Data":"0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f"}
Sep 14 10:51:15.121668 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.121589    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"
Sep 14 10:51:15.121668 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.121620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8" event={"ID":"d4dc0fb2-a477-4954-9105-b9f105254cf1","Type":"ContainerDied","Data":"9241610266e466a5e20051d04c0031ddea21ac58446d8447210e666ade11effc"}
Sep 14 10:51:15.121668 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.121640    2578 scope.go:117] "RemoveContainer" containerID="0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f"
Sep 14 10:51:15.130079 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.130065    2578 scope.go:117] "RemoveContainer" containerID="41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a"
Sep 14 10:51:15.137333 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.137318    2578 scope.go:117] "RemoveContainer" containerID="0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f"
Sep 14 10:51:15.137573 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:51:15.137554    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f\": container with ID starting with 0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f not found: ID does not exist" containerID="0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f"
Sep 14 10:51:15.137638 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.137580    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f"} err="failed to get container status \"0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f\": rpc error: code = NotFound desc = could not find container \"0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f\": container with ID starting with 0025e8fd29d60aaab63d1dd2e8532a98e324c200834a3a24f0eeb45eaf91945f not found: ID does not exist"
Sep 14 10:51:15.137638 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.137596    2578 scope.go:117] "RemoveContainer" containerID="41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a"
Sep 14 10:51:15.137875 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:51:15.137859    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a\": container with ID starting with 41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a not found: ID does not exist" containerID="41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a"
Sep 14 10:51:15.137913 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.137882    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a"} err="failed to get container status \"41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a\": rpc error: code = NotFound desc = could not find container \"41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a\": container with ID starting with 41246b76376ecee27ee889666622fc4ce3dd1657e497cff3c34f3999c8e2334a not found: ID does not exist"
Sep 14 10:51:15.143567 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.143549    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"]
Sep 14 10:51:15.151871 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.151849    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-558928-openshift-default-6b7b75cffd-dspv8"]
Sep 14 10:51:15.173866 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.173844    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-token\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:15.173866 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.173862    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85br6\" (UniqueName: \"kubernetes.io/projected/d4dc0fb2-a477-4954-9105-b9f105254cf1-kube-api-access-85br6\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:15.173982 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.173873    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-envoy\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:15.173982 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:15.173883    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4dc0fb2-a477-4954-9105-b9f105254cf1-istio-podinfo\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:51:16.976495 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:51:16.976467    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" path="/var/lib/kubelet/pods/d4dc0fb2-a477-4954-9105-b9f105254cf1/volumes"
Sep 14 10:52:03.738887 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.738857    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"]
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739154    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739165    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739174    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739180    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739189    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739195    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739203    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88332ab-3d7e-42d6-a814-7d5f4a61f8a4" containerName="payload-pre-processing"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739208    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88332ab-3d7e-42d6-a814-7d5f4a61f8a4" containerName="payload-pre-processing"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739221    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739226    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739232    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739237    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739243    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e39698b1-3d73-4260-82f5-f3a20d1ccbb7" containerName="payload-processing"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739248    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e39698b1-3d73-4260-82f5-f3a20d1ccbb7" containerName="payload-processing"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739255    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739260    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739267    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9535705-d1d0-4c5b-ad5f-6a089d1322d3" containerName="maas-api"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739272    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9535705-d1d0-4c5b-ad5f-6a089d1322d3" containerName="maas-api"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739278    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b09935f-0b31-43ec-ac8e-6d40494b1920" containerName="payload-pre-processing"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739284    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b09935f-0b31-43ec-ac8e-6d40494b1920" containerName="payload-pre-processing"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739289    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e54a454-396b-4fae-b739-dad6462e51a1" containerName="payload-processing"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739294    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e54a454-396b-4fae-b739-dad6462e51a1" containerName="payload-processing"
Sep 14 10:52:03.739290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739300    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739306    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739313    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5119d9-9b64-48ea-b450-ee3151ca38f7" containerName="maas-api"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739318    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5119d9-9b64-48ea-b450-ee3151ca38f7" containerName="maas-api"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739324    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086903ad-af5f-4edd-996c-61a0a53e6443" containerName="main"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739329    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="086903ad-af5f-4edd-996c-61a0a53e6443" containerName="main"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739373    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9535705-d1d0-4c5b-ad5f-6a089d1322d3" containerName="maas-api"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739382    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="086903ad-af5f-4edd-996c-61a0a53e6443" containerName="main"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739387    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5119d9-9b64-48ea-b450-ee3151ca38f7" containerName="maas-api"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739392    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e39698b1-3d73-4260-82f5-f3a20d1ccbb7" containerName="payload-processing"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739398    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e54a454-396b-4fae-b739-dad6462e51a1" containerName="payload-processing"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739404    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f88332ab-3d7e-42d6-a814-7d5f4a61f8a4" containerName="payload-pre-processing"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739408    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739412    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="409e494d-419c-415c-945d-04246586e7bd" containerName="istio-proxy"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739417    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739422    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b09935f-0b31-43ec-ac8e-6d40494b1920" containerName="payload-pre-processing"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739427    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739431    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739436    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4dc0fb2-a477-4954-9105-b9f105254cf1" containerName="istio-proxy"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739440    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy"
Sep 14 10:52:03.740064 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.739445    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e3e6f5c-b9be-4aa7-b9c1-a96246737695" containerName="istio-proxy"
Sep 14 10:52:03.742564 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.742544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.748938 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.748652    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1cbcd0\"/\"kube-root-ca.crt\""
Sep 14 10:52:03.749889 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.749866    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1cbcd0\"/\"default-dockercfg-f9jpl\""
Sep 14 10:52:03.749992 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.749892    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1cbcd0\"/\"openshift-service-ca.crt\""
Sep 14 10:52:03.749992 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.749983    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1cbcd0\"/\"rate-test-model-1cbcd0-kserve-self-signed-certs\""
Sep 14 10:52:03.769907 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.769884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"]
Sep 14 10:52:03.843095 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.843067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-dshm\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.843095 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.843097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-model-cache\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.843341 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.843133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-tmp-dir\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.843341 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.843232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-home\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.843341 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.843266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml5sp\" (UniqueName: \"kubernetes.io/projected/e4690809-1d46-488f-9da4-0eee27b3639b-kube-api-access-ml5sp\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.843341 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.843321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4690809-1d46-488f-9da4-0eee27b3639b-tls-certs\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.944559 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.944524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-home\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.944559 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.944562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml5sp\" (UniqueName: \"kubernetes.io/projected/e4690809-1d46-488f-9da4-0eee27b3639b-kube-api-access-ml5sp\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.944854 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.944588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4690809-1d46-488f-9da4-0eee27b3639b-tls-certs\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.944854 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.944614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-dshm\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.944854 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.944632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-model-cache\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.944854 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.944705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-tmp-dir\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.945084 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.944994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-home\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.945084 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.945043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-model-cache\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.945180 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.945103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-tmp-dir\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.947015 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.946996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-dshm\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.947370 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.947347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4690809-1d46-488f-9da4-0eee27b3639b-tls-certs\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:03.953848 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:03.953827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml5sp\" (UniqueName: \"kubernetes.io/projected/e4690809-1d46-488f-9da4-0eee27b3639b-kube-api-access-ml5sp\") pod \"rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") " pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:04.051572 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:04.051519    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:04.322713 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:04.322687    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"]
Sep 14 10:52:04.324531 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:52:04.324502    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4690809_1d46_488f_9da4_0eee27b3639b.slice/crio-b3de7d4d06c6fdf0c45279678a17ea0bfbb427d4d95eccf2cede97698427d6b6 WatchSource:0}: Error finding container b3de7d4d06c6fdf0c45279678a17ea0bfbb427d4d95eccf2cede97698427d6b6: Status 404 returned error can't find the container with id b3de7d4d06c6fdf0c45279678a17ea0bfbb427d4d95eccf2cede97698427d6b6
Sep 14 10:52:04.368544 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:04.368519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4" event={"ID":"e4690809-1d46-488f-9da4-0eee27b3639b","Type":"ContainerStarted","Data":"b3de7d4d06c6fdf0c45279678a17ea0bfbb427d4d95eccf2cede97698427d6b6"}
Sep 14 10:52:05.374979 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:05.374942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4" event={"ID":"e4690809-1d46-488f-9da4-0eee27b3639b","Type":"ContainerStarted","Data":"07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24"}
Sep 14 10:52:05.394790 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:05.394743    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4" podStartSLOduration=2.394730189 podStartE2EDuration="2.394730189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:52:05.394097644 +0000 UTC m=+1622.935499445" watchObservedRunningTime="2026-09-14 10:52:05.394730189 +0000 UTC m=+1622.936131991"
Sep 14 10:52:14.052730 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:14.052696    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:14.053154 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:14.052739    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:14.064914 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:14.064889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:52:14.434245 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:52:14.434215    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:53:08.101646 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:08.101612    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"]
Sep 14 10:53:09.823341 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.823311    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"]
Sep 14 10:53:09.823727 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.823631    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy"
Sep 14 10:53:09.823727 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.823641    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8337f636-aaa5-445b-a337-4bbca91667e8" containerName="istio-proxy"
Sep 14 10:53:09.826595 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.826565    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.829503 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.829480    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-689fac-openshift-default-dockercfg-fzzvj\""
Sep 14 10:53:09.843146 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.843125    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"]
Sep 14 10:53:09.869956 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.869934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwddf\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-kube-api-access-jwddf\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.870080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.869964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-envoy\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.870080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.869992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-podinfo\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.870080 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.870065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-token\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.870189 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.870081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11dc6c1-081b-497f-9225-d97b4f9212d3-istiod-ca-cert\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.870189 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.870136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-certs\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.870252 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.870195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-socket\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.870252 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.870214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-data\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.870252 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.870240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-credential-socket\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-socket\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971354 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-data\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971590 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-credential-socket\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971590 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwddf\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-kube-api-access-jwddf\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971590 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-envoy\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971590 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-podinfo\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971843 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-token\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11dc6c1-081b-497f-9225-d97b4f9212d3-istiod-ca-cert\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-data\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-certs\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.971900 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-credential-socket\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.972099 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.971923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-socket\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.972209 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.972187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-certs\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.972467 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.972450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11dc6c1-081b-497f-9225-d97b4f9212d3-istiod-ca-cert\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.973869 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.973842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-envoy\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.974185 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.974164    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-podinfo\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.980995 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.980976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-token\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:09.981578 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:09.981561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwddf\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-kube-api-access-jwddf\") pod \"e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") " pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:10.136402 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:10.136369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:10.414921 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:10.414900    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"]
Sep 14 10:53:10.415664 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:53:10.415637    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11dc6c1_081b_497f_9225_d97b4f9212d3.slice/crio-1e942b23d9d57906b78b3fc75b7e376bdcdf8b507650318a2bb34524270f6953 WatchSource:0}: Error finding container 1e942b23d9d57906b78b3fc75b7e376bdcdf8b507650318a2bb34524270f6953: Status 404 returned error can't find the container with id 1e942b23d9d57906b78b3fc75b7e376bdcdf8b507650318a2bb34524270f6953
Sep 14 10:53:10.417821 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:10.417789    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:53:10.417894 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:10.417858    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:53:10.417894 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:10.417887    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:53:10.703224 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:10.703127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" event={"ID":"f11dc6c1-081b-497f-9225-d97b4f9212d3","Type":"ContainerStarted","Data":"ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d"}
Sep 14 10:53:10.703224 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:10.703181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" event={"ID":"f11dc6c1-081b-497f-9225-d97b4f9212d3","Type":"ContainerStarted","Data":"1e942b23d9d57906b78b3fc75b7e376bdcdf8b507650318a2bb34524270f6953"}
Sep 14 10:53:10.728125 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:10.728080    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" podStartSLOduration=1.7280646480000001 podStartE2EDuration="1.728064648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:53:10.725913043 +0000 UTC m=+1688.267314841" watchObservedRunningTime="2026-09-14 10:53:10.728064648 +0000 UTC m=+1688.269466447"
Sep 14 10:53:11.137557 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:11.137528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:11.142174 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:11.142154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:11.707714 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:11.707665    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:11.708654 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:11.708634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:15.363946 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.363915    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"]
Sep 14 10:53:15.367182 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.367165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:15.371366 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.371344    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-689fac-dockercfg-sgnmn\""
Sep 14 10:53:15.371650 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.371634    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-689fac\""
Sep 14 10:53:15.381792 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.381771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"]
Sep 14 10:53:15.419283 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.419260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znw26\" (UniqueName: \"kubernetes.io/projected/8fb8e15b-4fc3-478e-8e69-de82fd778237-kube-api-access-znw26\") pod \"payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96\" (UID: \"8fb8e15b-4fc3-478e-8e69-de82fd778237\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:15.419398 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.419298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb8e15b-4fc3-478e-8e69-de82fd778237-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96\" (UID: \"8fb8e15b-4fc3-478e-8e69-de82fd778237\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:15.445816 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.445772    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"]
Sep 14 10:53:15.451848 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.451816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:15.458946 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.458913    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"]
Sep 14 10:53:15.520188 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.520158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znw26\" (UniqueName: \"kubernetes.io/projected/8fb8e15b-4fc3-478e-8e69-de82fd778237-kube-api-access-znw26\") pod \"payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96\" (UID: \"8fb8e15b-4fc3-478e-8e69-de82fd778237\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:15.520358 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.520200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb8e15b-4fc3-478e-8e69-de82fd778237-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96\" (UID: \"8fb8e15b-4fc3-478e-8e69-de82fd778237\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:15.520358 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.520227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eec55f8-e86e-499c-a172-7ef57f1111f9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b\" (UID: \"4eec55f8-e86e-499c-a172-7ef57f1111f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:15.520358 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.520275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgjk8\" (UniqueName: \"kubernetes.io/projected/4eec55f8-e86e-499c-a172-7ef57f1111f9-kube-api-access-mgjk8\") pod \"payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b\" (UID: \"4eec55f8-e86e-499c-a172-7ef57f1111f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:15.520836 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.520817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb8e15b-4fc3-478e-8e69-de82fd778237-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96\" (UID: \"8fb8e15b-4fc3-478e-8e69-de82fd778237\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:15.530621 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.530593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znw26\" (UniqueName: \"kubernetes.io/projected/8fb8e15b-4fc3-478e-8e69-de82fd778237-kube-api-access-znw26\") pod \"payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96\" (UID: \"8fb8e15b-4fc3-478e-8e69-de82fd778237\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:15.621083 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.621005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eec55f8-e86e-499c-a172-7ef57f1111f9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b\" (UID: \"4eec55f8-e86e-499c-a172-7ef57f1111f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:15.621083 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.621053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgjk8\" (UniqueName: \"kubernetes.io/projected/4eec55f8-e86e-499c-a172-7ef57f1111f9-kube-api-access-mgjk8\") pod \"payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b\" (UID: \"4eec55f8-e86e-499c-a172-7ef57f1111f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:15.621713 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.621691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eec55f8-e86e-499c-a172-7ef57f1111f9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b\" (UID: \"4eec55f8-e86e-499c-a172-7ef57f1111f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:15.630981 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.630958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgjk8\" (UniqueName: \"kubernetes.io/projected/4eec55f8-e86e-499c-a172-7ef57f1111f9-kube-api-access-mgjk8\") pod \"payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b\" (UID: \"4eec55f8-e86e-499c-a172-7ef57f1111f9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:15.676873 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.676845    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:15.768812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.768778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:15.955842 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:15.955821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"]
Sep 14 10:53:15.957508 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:53:15.957482    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb8e15b_4fc3_478e_8e69_de82fd778237.slice/crio-97a330b71dc13b457d4aeaa9b6ccc83fb36c9ce0fbdea74bce05e21938d0e052 WatchSource:0}: Error finding container 97a330b71dc13b457d4aeaa9b6ccc83fb36c9ce0fbdea74bce05e21938d0e052: Status 404 returned error can't find the container with id 97a330b71dc13b457d4aeaa9b6ccc83fb36c9ce0fbdea74bce05e21938d0e052
Sep 14 10:53:16.046657 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:16.046636    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"]
Sep 14 10:53:16.047636 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:53:16.047615    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eec55f8_e86e_499c_a172_7ef57f1111f9.slice/crio-dd8335bcda55f5fde81048e575c5e682e7b245cb02cbebba57e4eb94716a577c WatchSource:0}: Error finding container dd8335bcda55f5fde81048e575c5e682e7b245cb02cbebba57e4eb94716a577c: Status 404 returned error can't find the container with id dd8335bcda55f5fde81048e575c5e682e7b245cb02cbebba57e4eb94716a577c
Sep 14 10:53:16.736174 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:16.736135    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96" event={"ID":"8fb8e15b-4fc3-478e-8e69-de82fd778237","Type":"ContainerStarted","Data":"2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368"}
Sep 14 10:53:16.736636 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:16.736311    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:16.736636 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:16.736347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96" event={"ID":"8fb8e15b-4fc3-478e-8e69-de82fd778237","Type":"ContainerStarted","Data":"97a330b71dc13b457d4aeaa9b6ccc83fb36c9ce0fbdea74bce05e21938d0e052"}
Sep 14 10:53:16.737831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:16.737805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b" event={"ID":"4eec55f8-e86e-499c-a172-7ef57f1111f9","Type":"ContainerStarted","Data":"8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2"}
Sep 14 10:53:16.737946 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:16.737853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:16.737946 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:16.737869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b" event={"ID":"4eec55f8-e86e-499c-a172-7ef57f1111f9","Type":"ContainerStarted","Data":"dd8335bcda55f5fde81048e575c5e682e7b245cb02cbebba57e4eb94716a577c"}
Sep 14 10:53:16.757461 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:16.757416    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96" podStartSLOduration=1.7574035879999998 podStartE2EDuration="1.757403588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:53:16.755162589 +0000 UTC m=+1694.296564390" watchObservedRunningTime="2026-09-14 10:53:16.757403588 +0000 UTC m=+1694.298805389"
Sep 14 10:53:16.774710 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:16.774653    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b" podStartSLOduration=1.77463964 podStartE2EDuration="1.77463964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:53:16.773020047 +0000 UTC m=+1694.314421848" watchObservedRunningTime="2026-09-14 10:53:16.77463964 +0000 UTC m=+1694.316041488"
Sep 14 10:53:23.138355 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.138300    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4" podUID="e4690809-1d46-488f-9da4-0eee27b3639b" containerName="main" containerID="cri-o://07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24" gracePeriod=45
Sep 14 10:53:23.403943 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.403919    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:53:23.489768 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.489736    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml5sp\" (UniqueName: \"kubernetes.io/projected/e4690809-1d46-488f-9da4-0eee27b3639b-kube-api-access-ml5sp\") pod \"e4690809-1d46-488f-9da4-0eee27b3639b\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") "
Sep 14 10:53:23.489939 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.489791    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-model-cache\") pod \"e4690809-1d46-488f-9da4-0eee27b3639b\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") "
Sep 14 10:53:23.489939 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.489837    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4690809-1d46-488f-9da4-0eee27b3639b-tls-certs\") pod \"e4690809-1d46-488f-9da4-0eee27b3639b\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") "
Sep 14 10:53:23.489939 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.489866    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-home\") pod \"e4690809-1d46-488f-9da4-0eee27b3639b\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") "
Sep 14 10:53:23.489939 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.489912    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-tmp-dir\") pod \"e4690809-1d46-488f-9da4-0eee27b3639b\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") "
Sep 14 10:53:23.489939 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.489936    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-dshm\") pod \"e4690809-1d46-488f-9da4-0eee27b3639b\" (UID: \"e4690809-1d46-488f-9da4-0eee27b3639b\") "
Sep 14 10:53:23.490194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.490056    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4690809-1d46-488f-9da4-0eee27b3639b" (UID: "e4690809-1d46-488f-9da4-0eee27b3639b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:53:23.490194 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.490145    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-home" (OuterVolumeSpecName: "home") pod "e4690809-1d46-488f-9da4-0eee27b3639b" (UID: "e4690809-1d46-488f-9da4-0eee27b3639b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:53:23.490290 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.490236    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4690809-1d46-488f-9da4-0eee27b3639b" (UID: "e4690809-1d46-488f-9da4-0eee27b3639b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:53:23.490327 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.490295    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-model-cache\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:53:23.490327 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.490311    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-home\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:53:23.491978 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.491955    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4690809-1d46-488f-9da4-0eee27b3639b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4690809-1d46-488f-9da4-0eee27b3639b" (UID: "e4690809-1d46-488f-9da4-0eee27b3639b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:53:23.492097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.492013    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4690809-1d46-488f-9da4-0eee27b3639b-kube-api-access-ml5sp" (OuterVolumeSpecName: "kube-api-access-ml5sp") pod "e4690809-1d46-488f-9da4-0eee27b3639b" (UID: "e4690809-1d46-488f-9da4-0eee27b3639b"). InnerVolumeSpecName "kube-api-access-ml5sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:53:23.492097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.492079    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-dshm" (OuterVolumeSpecName: "dshm") pod "e4690809-1d46-488f-9da4-0eee27b3639b" (UID: "e4690809-1d46-488f-9da4-0eee27b3639b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:53:23.590867 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.590840    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4690809-1d46-488f-9da4-0eee27b3639b-tls-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:53:23.590867 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.590864    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-tmp-dir\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:53:23.590867 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.590872    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4690809-1d46-488f-9da4-0eee27b3639b-dshm\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:53:23.591084 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.590879    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml5sp\" (UniqueName: \"kubernetes.io/projected/e4690809-1d46-488f-9da4-0eee27b3639b-kube-api-access-ml5sp\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:53:23.777053 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.776961    2578 generic.go:356] "Generic (PLEG): container finished" podID="e4690809-1d46-488f-9da4-0eee27b3639b" containerID="07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24" exitCode=0
Sep 14 10:53:23.777053 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.777010    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"
Sep 14 10:53:23.777251 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.777054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4" event={"ID":"e4690809-1d46-488f-9da4-0eee27b3639b","Type":"ContainerDied","Data":"07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24"}
Sep 14 10:53:23.777251 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.777099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4" event={"ID":"e4690809-1d46-488f-9da4-0eee27b3639b","Type":"ContainerDied","Data":"b3de7d4d06c6fdf0c45279678a17ea0bfbb427d4d95eccf2cede97698427d6b6"}
Sep 14 10:53:23.777251 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.777120    2578 scope.go:117] "RemoveContainer" containerID="07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24"
Sep 14 10:53:23.786652 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.786633    2578 scope.go:117] "RemoveContainer" containerID="07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24"
Sep 14 10:53:23.786976 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:53:23.786956    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24\": container with ID starting with 07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24 not found: ID does not exist" containerID="07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24"
Sep 14 10:53:23.787037 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.786985    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24"} err="failed to get container status \"07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24\": rpc error: code = NotFound desc = could not find container \"07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24\": container with ID starting with 07355b450e3101d67bab655c16b50a3faecc91c48d9641e045e20989805b4c24 not found: ID does not exist"
Sep 14 10:53:23.827333 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.827274    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"]
Sep 14 10:53:23.838781 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:23.838744    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1cbcd0/rate-test-model-1cbcd0-kserve-586bb5d579-6hfv4"]
Sep 14 10:53:24.977174 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:24.977141    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4690809-1d46-488f-9da4-0eee27b3639b" path="/var/lib/kubelet/pods/e4690809-1d46-488f-9da4-0eee27b3639b/volumes"
Sep 14 10:53:27.747053 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:27.747023    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:53:27.747436 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:27.747093    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:53:30.820190 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:30.820161    2578 generic.go:356] "Generic (PLEG): container finished" podID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerID="ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d" exitCode=0
Sep 14 10:53:30.820587 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:30.820235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" event={"ID":"f11dc6c1-081b-497f-9225-d97b4f9212d3","Type":"ContainerDied","Data":"ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d"}
Sep 14 10:53:30.820587 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:30.820584    2578 scope.go:117] "RemoveContainer" containerID="ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d"
Sep 14 10:53:30.821602 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:30.821579    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:53:30.821699 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:30.821642    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:53:30.821750 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:30.821695    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 14 10:53:31.845697 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:31.845579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" event={"ID":"f11dc6c1-081b-497f-9225-d97b4f9212d3","Type":"ContainerStarted","Data":"18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29"}
Sep 14 10:53:32.136903 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:32.136803    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:32.137267 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:32.137244    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 14 10:53:32.137466 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:32.137442    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 14 10:53:33.137176 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:33.137131    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 14 10:53:33.137704 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:33.137202    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 14 10:53:34.137722 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:34.137656    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 14 10:53:34.138224 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:34.137762    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 14 10:53:35.137870 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:35.137825    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 14 10:53:35.138357 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:35.137892    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 14 10:53:36.137331 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:36.137294    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 14 10:53:36.137657 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:36.137624    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 14 10:53:37.140991 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:37.140956    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:37.141415 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:37.141216    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:37.141924 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:37.141905    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:53:44.320364 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.320332    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"]
Sep 14 10:53:44.320744 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.320658    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4690809-1d46-488f-9da4-0eee27b3639b" containerName="main"
Sep 14 10:53:44.320744 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.320685    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4690809-1d46-488f-9da4-0eee27b3639b" containerName="main"
Sep 14 10:53:44.320834 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.320751    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4690809-1d46-488f-9da4-0eee27b3639b" containerName="main"
Sep 14 10:53:44.323809 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.323793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.327200 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.327173    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-7406d4-serving-cert\""
Sep 14 10:53:44.341082 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.341056    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"]
Sep 14 10:53:44.476201 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.476161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-metrics-certs\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.476201 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.476201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.476417 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.476225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcmmq\" (UniqueName: \"kubernetes.io/projected/cd6928ab-9598-4430-a088-c8ed03dfa2b5-kube-api-access-xcmmq\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.476417 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.476300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd6928ab-9598-4430-a088-c8ed03dfa2b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.577066 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.576987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-metrics-certs\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.577066 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.577023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.577066 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.577052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcmmq\" (UniqueName: \"kubernetes.io/projected/cd6928ab-9598-4430-a088-c8ed03dfa2b5-kube-api-access-xcmmq\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.577307 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.577085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd6928ab-9598-4430-a088-c8ed03dfa2b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.577307 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:53:44.577134    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-serving-cert: secret "maas-api-e2e-ipp-b-7406d4-serving-cert" not found
Sep 14 10:53:44.577307 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:53:44.577194    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-maas-api-tls podName:cd6928ab-9598-4430-a088-c8ed03dfa2b5 nodeName:}" failed. No retries permitted until 2026-09-14 10:53:45.07718032 +0000 UTC m=+1722.618582099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-maas-api-tls") pod "maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz" (UID: "cd6928ab-9598-4430-a088-c8ed03dfa2b5") : secret "maas-api-e2e-ipp-b-7406d4-serving-cert" not found
Sep 14 10:53:44.577859 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.577841    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd6928ab-9598-4430-a088-c8ed03dfa2b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.579565 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.579548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-metrics-certs\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:44.588053 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:44.588031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcmmq\" (UniqueName: \"kubernetes.io/projected/cd6928ab-9598-4430-a088-c8ed03dfa2b5-kube-api-access-xcmmq\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:45.080876 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.080846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:45.083280 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.083257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:45.236334 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.236298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:45.360874 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.360841    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"]
Sep 14 10:53:45.364567 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.364548    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:53:45.367388 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.367365    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-7406d4\""
Sep 14 10:53:45.367513 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.367463    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-7406d4-dockercfg-spz9p\""
Sep 14 10:53:45.378010 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.377989    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"]
Sep 14 10:53:45.485547 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.485517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d3b1ea8-e79d-45d2-9191-6a3888511630-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d\" (UID: \"7d3b1ea8-e79d-45d2-9191-6a3888511630\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:53:45.485715 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.485577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68nsn\" (UniqueName: \"kubernetes.io/projected/7d3b1ea8-e79d-45d2-9191-6a3888511630-kube-api-access-68nsn\") pod \"payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d\" (UID: \"7d3b1ea8-e79d-45d2-9191-6a3888511630\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:53:45.511197 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.511177    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"]
Sep 14 10:53:45.513144 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:53:45.513120    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6928ab_9598_4430_a088_c8ed03dfa2b5.slice/crio-d1cfb50414706ae89a2474a54194cfb3ea31e3d7e31a0a9537b0db9979967114 WatchSource:0}: Error finding container d1cfb50414706ae89a2474a54194cfb3ea31e3d7e31a0a9537b0db9979967114: Status 404 returned error can't find the container with id d1cfb50414706ae89a2474a54194cfb3ea31e3d7e31a0a9537b0db9979967114
Sep 14 10:53:45.514416 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.514400    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:53:45.586509 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.586483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d3b1ea8-e79d-45d2-9191-6a3888511630-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d\" (UID: \"7d3b1ea8-e79d-45d2-9191-6a3888511630\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:53:45.586609 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.586539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68nsn\" (UniqueName: \"kubernetes.io/projected/7d3b1ea8-e79d-45d2-9191-6a3888511630-kube-api-access-68nsn\") pod \"payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d\" (UID: \"7d3b1ea8-e79d-45d2-9191-6a3888511630\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:53:45.587156 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.587134    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d3b1ea8-e79d-45d2-9191-6a3888511630-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d\" (UID: \"7d3b1ea8-e79d-45d2-9191-6a3888511630\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:53:45.596515 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.596497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68nsn\" (UniqueName: \"kubernetes.io/projected/7d3b1ea8-e79d-45d2-9191-6a3888511630-kube-api-access-68nsn\") pod \"payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d\" (UID: \"7d3b1ea8-e79d-45d2-9191-6a3888511630\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:53:45.677612 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.677517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:53:45.921033 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.921009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz" event={"ID":"cd6928ab-9598-4430-a088-c8ed03dfa2b5","Type":"ContainerStarted","Data":"d1cfb50414706ae89a2474a54194cfb3ea31e3d7e31a0a9537b0db9979967114"}
Sep 14 10:53:45.953285 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:45.953263    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"]
Sep 14 10:53:45.954961 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:53:45.954933    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3b1ea8_e79d_45d2_9191_6a3888511630.slice/crio-60be8c6cee18512798880a100a958808445ef0b64f8472084247506609549b10 WatchSource:0}: Error finding container 60be8c6cee18512798880a100a958808445ef0b64f8472084247506609549b10: Status 404 returned error can't find the container with id 60be8c6cee18512798880a100a958808445ef0b64f8472084247506609549b10
Sep 14 10:53:46.927529 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:46.927496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz" event={"ID":"cd6928ab-9598-4430-a088-c8ed03dfa2b5","Type":"ContainerStarted","Data":"b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b"}
Sep 14 10:53:46.927969 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:46.927600    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:46.929031 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:46.929005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d" event={"ID":"7d3b1ea8-e79d-45d2-9191-6a3888511630","Type":"ContainerStarted","Data":"54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940"}
Sep 14 10:53:46.929123 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:46.929047    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d" event={"ID":"7d3b1ea8-e79d-45d2-9191-6a3888511630","Type":"ContainerStarted","Data":"60be8c6cee18512798880a100a958808445ef0b64f8472084247506609549b10"}
Sep 14 10:53:46.929123 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:46.929074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:53:46.948734 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:46.948697    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz" podStartSLOduration=2.603240296 podStartE2EDuration="2.948667533s" totalImagesPullingTime="345.427237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:53:46.946552468 +0000 UTC m=+1724.487954267" watchObservedRunningTime="2026-09-14 10:53:46.948667533 +0000 UTC m=+1724.490069333"
Sep 14 10:53:46.967746 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:46.967706    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d" podStartSLOduration=1.96769296 podStartE2EDuration="1.96769296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:53:46.964808635 +0000 UTC m=+1724.506210438" watchObservedRunningTime="2026-09-14 10:53:46.96769296 +0000 UTC m=+1724.509094761"
Sep 14 10:53:52.938831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:52.938803    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:53:57.936058 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:53:57.936028    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:54:16.776437 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:16.776411    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d_7d3b1ea8-e79d-45d2-9191-6a3888511630/payload-processing/0.log"
Sep 14 10:54:47.461218 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:47.461184    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b_4eec55f8-e86e-499c-a172-7ef57f1111f9/payload-processing/0.log"
Sep 14 10:54:47.700247 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:47.700225    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d_7d3b1ea8-e79d-45d2-9191-6a3888511630/payload-processing/0.log"
Sep 14 10:54:55.703967 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.703881    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"]
Sep 14 10:54:55.707477 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.707456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.710097 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.710073    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-7599d7-serving-cert\""
Sep 14 10:54:55.723942 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.723917    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"]
Sep 14 10:54:55.856868 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.856832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9568c431-9366-4607-9ba6-a2bd778f373c-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.857026 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.856892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.857026 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.856940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd5t4\" (UniqueName: \"kubernetes.io/projected/9568c431-9366-4607-9ba6-a2bd778f373c-kube-api-access-qd5t4\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.857026 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.856960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.958293 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.958218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.958441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.958295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9568c431-9366-4607-9ba6-a2bd778f373c-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.958441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.958350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.958441 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:54:55.958357    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-serving-cert: secret "maas-api-e2e-ipp-cleanup-7599d7-serving-cert" not found
Sep 14 10:54:55.958441 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.958387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd5t4\" (UniqueName: \"kubernetes.io/projected/9568c431-9366-4607-9ba6-a2bd778f373c-kube-api-access-qd5t4\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.958441 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:54:55.958420    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-maas-api-tls podName:9568c431-9366-4607-9ba6-a2bd778f373c nodeName:}" failed. No retries permitted until 2026-09-14 10:54:56.458406284 +0000 UTC m=+1793.999808063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2" (UID: "9568c431-9366-4607-9ba6-a2bd778f373c") : secret "maas-api-e2e-ipp-cleanup-7599d7-serving-cert" not found
Sep 14 10:54:55.958892 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.958875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9568c431-9366-4607-9ba6-a2bd778f373c-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.960817 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.960800    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:55.967804 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:55.967781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd5t4\" (UniqueName: \"kubernetes.io/projected/9568c431-9366-4607-9ba6-a2bd778f373c-kube-api-access-qd5t4\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:56.463868 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:56.463833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:56.466812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:56.466781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:56.618005 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:56.617968    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:56.909436 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:56.909413    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"]
Sep 14 10:54:56.910934 ip-10-0-135-139 kubenswrapper[2578]: W0914 10:54:56.910906    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9568c431_9366_4607_9ba6_a2bd778f373c.slice/crio-89b2530787ee658ae35ebfd9d65047f4db32bc22b4bfd7a6179d09b65cf283aa WatchSource:0}: Error finding container 89b2530787ee658ae35ebfd9d65047f4db32bc22b4bfd7a6179d09b65cf283aa: Status 404 returned error can't find the container with id 89b2530787ee658ae35ebfd9d65047f4db32bc22b4bfd7a6179d09b65cf283aa
Sep 14 10:54:57.294090 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:57.294009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2" event={"ID":"9568c431-9366-4607-9ba6-a2bd778f373c","Type":"ContainerStarted","Data":"89b2530787ee658ae35ebfd9d65047f4db32bc22b4bfd7a6179d09b65cf283aa"}
Sep 14 10:54:58.300757 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:58.300718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2" event={"ID":"9568c431-9366-4607-9ba6-a2bd778f373c","Type":"ContainerStarted","Data":"78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64"}
Sep 14 10:54:58.301171 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:58.300835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:54:58.325798 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:54:58.325755    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2" podStartSLOduration=2.866044306 podStartE2EDuration="3.32574294s" totalImagesPullingTime="459.698634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:54:58.324049656 +0000 UTC m=+1795.865451459" watchObservedRunningTime="2026-09-14 10:54:58.32574294 +0000 UTC m=+1795.867144741"
Sep 14 10:55:04.311226 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:04.311198    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:55:34.018925 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.018894    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"]
Sep 14 10:55:34.019477 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.019125    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2" podUID="9568c431-9366-4607-9ba6-a2bd778f373c" containerName="maas-api" containerID="cri-o://78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64" gracePeriod=30
Sep 14 10:55:34.273322 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.273261    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:55:34.401617 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.401586    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-metrics-certs\") pod \"9568c431-9366-4607-9ba6-a2bd778f373c\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") "
Sep 14 10:55:34.401812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.401702    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9568c431-9366-4607-9ba6-a2bd778f373c-openshift-service-ca\") pod \"9568c431-9366-4607-9ba6-a2bd778f373c\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") "
Sep 14 10:55:34.401812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.401730    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-maas-api-tls\") pod \"9568c431-9366-4607-9ba6-a2bd778f373c\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") "
Sep 14 10:55:34.401812 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.401766    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd5t4\" (UniqueName: \"kubernetes.io/projected/9568c431-9366-4607-9ba6-a2bd778f373c-kube-api-access-qd5t4\") pod \"9568c431-9366-4607-9ba6-a2bd778f373c\" (UID: \"9568c431-9366-4607-9ba6-a2bd778f373c\") "
Sep 14 10:55:34.402145 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.402116    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9568c431-9366-4607-9ba6-a2bd778f373c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9568c431-9366-4607-9ba6-a2bd778f373c" (UID: "9568c431-9366-4607-9ba6-a2bd778f373c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:55:34.403936 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.403906    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9568c431-9366-4607-9ba6-a2bd778f373c" (UID: "9568c431-9366-4607-9ba6-a2bd778f373c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:55:34.403936 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.403931    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9568c431-9366-4607-9ba6-a2bd778f373c-kube-api-access-qd5t4" (OuterVolumeSpecName: "kube-api-access-qd5t4") pod "9568c431-9366-4607-9ba6-a2bd778f373c" (UID: "9568c431-9366-4607-9ba6-a2bd778f373c"). InnerVolumeSpecName "kube-api-access-qd5t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:55:34.404094 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.404017    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9568c431-9366-4607-9ba6-a2bd778f373c" (UID: "9568c431-9366-4607-9ba6-a2bd778f373c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:55:34.482298 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.482268    2578 generic.go:356] "Generic (PLEG): container finished" podID="9568c431-9366-4607-9ba6-a2bd778f373c" containerID="78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64" exitCode=0
Sep 14 10:55:34.482469 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.482324    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"
Sep 14 10:55:34.482469 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.482356    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2" event={"ID":"9568c431-9366-4607-9ba6-a2bd778f373c","Type":"ContainerDied","Data":"78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64"}
Sep 14 10:55:34.482469 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.482448    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2" event={"ID":"9568c431-9366-4607-9ba6-a2bd778f373c","Type":"ContainerDied","Data":"89b2530787ee658ae35ebfd9d65047f4db32bc22b4bfd7a6179d09b65cf283aa"}
Sep 14 10:55:34.482644 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.482478    2578 scope.go:117] "RemoveContainer" containerID="78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64"
Sep 14 10:55:34.493243 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.493224    2578 scope.go:117] "RemoveContainer" containerID="78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64"
Sep 14 10:55:34.493589 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:55:34.493571    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64\": container with ID starting with 78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64 not found: ID does not exist" containerID="78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64"
Sep 14 10:55:34.493687 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.493600    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64"} err="failed to get container status \"78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64\": rpc error: code = NotFound desc = could not find container \"78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64\": container with ID starting with 78d18548ce68945d2d6d85bce5f20fcfe9a09d47682792bfe9dcb3d5227abc64 not found: ID does not exist"
Sep 14 10:55:34.502545 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.502525    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9568c431-9366-4607-9ba6-a2bd778f373c-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:55:34.502545 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.502546    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:55:34.502702 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.502556    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd5t4\" (UniqueName: \"kubernetes.io/projected/9568c431-9366-4607-9ba6-a2bd778f373c-kube-api-access-qd5t4\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:55:34.502702 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.502564    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9568c431-9366-4607-9ba6-a2bd778f373c-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:55:34.517778 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.517750    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"]
Sep 14 10:55:34.524096 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.524044    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7599d7-657b77965c-nqdm2"]
Sep 14 10:55:34.978233 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:55:34.978201    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9568c431-9366-4607-9ba6-a2bd778f373c" path="/var/lib/kubelet/pods/9568c431-9366-4607-9ba6-a2bd778f373c/volumes"
Sep 14 10:56:00.658480 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:00.658445    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"]
Sep 14 10:56:00.658960 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:00.658788    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b" podUID="4eec55f8-e86e-499c-a172-7ef57f1111f9" containerName="payload-processing" containerID="cri-o://8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2" gracePeriod=30
Sep 14 10:56:00.670030 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:00.669998    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"]
Sep 14 10:56:00.670257 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:00.670233    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96" podUID="8fb8e15b-4fc3-478e-8e69-de82fd778237" containerName="payload-pre-processing" containerID="cri-o://2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368" gracePeriod=30
Sep 14 10:56:00.936258 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:00.936233    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:56:00.938972 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:00.938948    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:56:01.020410 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.020383    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znw26\" (UniqueName: \"kubernetes.io/projected/8fb8e15b-4fc3-478e-8e69-de82fd778237-kube-api-access-znw26\") pod \"8fb8e15b-4fc3-478e-8e69-de82fd778237\" (UID: \"8fb8e15b-4fc3-478e-8e69-de82fd778237\") "
Sep 14 10:56:01.020562 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.020476    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb8e15b-4fc3-478e-8e69-de82fd778237-plugins-config-volume\") pod \"8fb8e15b-4fc3-478e-8e69-de82fd778237\" (UID: \"8fb8e15b-4fc3-478e-8e69-de82fd778237\") "
Sep 14 10:56:01.020562 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.020491    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eec55f8-e86e-499c-a172-7ef57f1111f9-plugins-config-volume\") pod \"4eec55f8-e86e-499c-a172-7ef57f1111f9\" (UID: \"4eec55f8-e86e-499c-a172-7ef57f1111f9\") "
Sep 14 10:56:01.020562 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.020519    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgjk8\" (UniqueName: \"kubernetes.io/projected/4eec55f8-e86e-499c-a172-7ef57f1111f9-kube-api-access-mgjk8\") pod \"4eec55f8-e86e-499c-a172-7ef57f1111f9\" (UID: \"4eec55f8-e86e-499c-a172-7ef57f1111f9\") "
Sep 14 10:56:01.021024 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.020915    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fb8e15b-4fc3-478e-8e69-de82fd778237-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8fb8e15b-4fc3-478e-8e69-de82fd778237" (UID: "8fb8e15b-4fc3-478e-8e69-de82fd778237"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:56:01.021024 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.020922    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eec55f8-e86e-499c-a172-7ef57f1111f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4eec55f8-e86e-499c-a172-7ef57f1111f9" (UID: "4eec55f8-e86e-499c-a172-7ef57f1111f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:56:01.022728 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.022658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eec55f8-e86e-499c-a172-7ef57f1111f9-kube-api-access-mgjk8" (OuterVolumeSpecName: "kube-api-access-mgjk8") pod "4eec55f8-e86e-499c-a172-7ef57f1111f9" (UID: "4eec55f8-e86e-499c-a172-7ef57f1111f9"). InnerVolumeSpecName "kube-api-access-mgjk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:56:01.022831 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.022712    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fb8e15b-4fc3-478e-8e69-de82fd778237-kube-api-access-znw26" (OuterVolumeSpecName: "kube-api-access-znw26") pod "8fb8e15b-4fc3-478e-8e69-de82fd778237" (UID: "8fb8e15b-4fc3-478e-8e69-de82fd778237"). InnerVolumeSpecName "kube-api-access-znw26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:56:01.121891 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.121862    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgjk8\" (UniqueName: \"kubernetes.io/projected/4eec55f8-e86e-499c-a172-7ef57f1111f9-kube-api-access-mgjk8\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:01.121891 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.121889    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znw26\" (UniqueName: \"kubernetes.io/projected/8fb8e15b-4fc3-478e-8e69-de82fd778237-kube-api-access-znw26\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:01.121891 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.121898    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fb8e15b-4fc3-478e-8e69-de82fd778237-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:01.122043 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.121907    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4eec55f8-e86e-499c-a172-7ef57f1111f9-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:01.620958 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.620928    2578 generic.go:356] "Generic (PLEG): container finished" podID="8fb8e15b-4fc3-478e-8e69-de82fd778237" containerID="2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368" exitCode=0
Sep 14 10:56:01.621115 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.620969    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"
Sep 14 10:56:01.621115 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.621012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96" event={"ID":"8fb8e15b-4fc3-478e-8e69-de82fd778237","Type":"ContainerDied","Data":"2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368"}
Sep 14 10:56:01.621115 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.621061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96" event={"ID":"8fb8e15b-4fc3-478e-8e69-de82fd778237","Type":"ContainerDied","Data":"97a330b71dc13b457d4aeaa9b6ccc83fb36c9ce0fbdea74bce05e21938d0e052"}
Sep 14 10:56:01.621115 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.621086    2578 scope.go:117] "RemoveContainer" containerID="2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368"
Sep 14 10:56:01.622501 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.622476    2578 generic.go:356] "Generic (PLEG): container finished" podID="4eec55f8-e86e-499c-a172-7ef57f1111f9" containerID="8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2" exitCode=0
Sep 14 10:56:01.622783 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.622514    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"
Sep 14 10:56:01.622783 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.622540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b" event={"ID":"4eec55f8-e86e-499c-a172-7ef57f1111f9","Type":"ContainerDied","Data":"8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2"}
Sep 14 10:56:01.622783 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.622585    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b" event={"ID":"4eec55f8-e86e-499c-a172-7ef57f1111f9","Type":"ContainerDied","Data":"dd8335bcda55f5fde81048e575c5e682e7b245cb02cbebba57e4eb94716a577c"}
Sep 14 10:56:01.630076 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.629986    2578 scope.go:117] "RemoveContainer" containerID="2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368"
Sep 14 10:56:01.630350 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:56:01.630328    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368\": container with ID starting with 2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368 not found: ID does not exist" containerID="2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368"
Sep 14 10:56:01.630435 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.630358    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368"} err="failed to get container status \"2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368\": rpc error: code = NotFound desc = could not find container \"2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368\": container with ID starting with 2062d81d82198efdfccdd4c802505c5715c4ead264bc62f4dbd932b8fbaf1368 not found: ID does not exist"
Sep 14 10:56:01.630435 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.630374    2578 scope.go:117] "RemoveContainer" containerID="8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2"
Sep 14 10:56:01.638372 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.638359    2578 scope.go:117] "RemoveContainer" containerID="8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2"
Sep 14 10:56:01.638616 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:56:01.638602    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2\": container with ID starting with 8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2 not found: ID does not exist" containerID="8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2"
Sep 14 10:56:01.638661 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.638624    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2"} err="failed to get container status \"8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2\": rpc error: code = NotFound desc = could not find container \"8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2\": container with ID starting with 8d39cdeaac189cbc575539b6fb23440e0c6f4921d72afc729f401de22ec5fbc2 not found: ID does not exist"
Sep 14 10:56:01.663567 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.663542    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"]
Sep 14 10:56:01.670422 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.670402    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-689fac-79754fc76c-p4r4b"]
Sep 14 10:56:01.707154 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.707132    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"]
Sep 14 10:56:01.718299 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:01.718276    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-689fac-557f44bdfd-vsm96"]
Sep 14 10:56:02.977211 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:02.977182    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eec55f8-e86e-499c-a172-7ef57f1111f9" path="/var/lib/kubelet/pods/4eec55f8-e86e-499c-a172-7ef57f1111f9/volumes"
Sep 14 10:56:02.977564 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:02.977508    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fb8e15b-4fc3-478e-8e69-de82fd778237" path="/var/lib/kubelet/pods/8fb8e15b-4fc3-478e-8e69-de82fd778237/volumes"
Sep 14 10:56:49.447810 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:49.447729    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"]
Sep 14 10:56:49.448436 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:49.447979    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy" containerID="cri-o://18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29" gracePeriod=30
Sep 14 10:56:52.143771 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:52.143736    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:56:52.144161 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:52.143808    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:56:54.695107 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.695082    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:56:54.767091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767023    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11dc6c1-081b-497f-9225-d97b4f9212d3-istiod-ca-cert\") pod \"f11dc6c1-081b-497f-9225-d97b4f9212d3\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") "
Sep 14 10:56:54.767091 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767062    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-certs\") pod \"f11dc6c1-081b-497f-9225-d97b4f9212d3\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") "
Sep 14 10:56:54.767251 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767204    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-data\") pod \"f11dc6c1-081b-497f-9225-d97b4f9212d3\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") "
Sep 14 10:56:54.767301 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767248    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-podinfo\") pod \"f11dc6c1-081b-497f-9225-d97b4f9212d3\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") "
Sep 14 10:56:54.767301 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767291    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-token\") pod \"f11dc6c1-081b-497f-9225-d97b4f9212d3\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") "
Sep 14 10:56:54.767398 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767320    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-socket\") pod \"f11dc6c1-081b-497f-9225-d97b4f9212d3\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") "
Sep 14 10:56:54.767398 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767349    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f11dc6c1-081b-497f-9225-d97b4f9212d3" (UID: "f11dc6c1-081b-497f-9225-d97b4f9212d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:56:54.767398 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767352    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwddf\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-kube-api-access-jwddf\") pod \"f11dc6c1-081b-497f-9225-d97b4f9212d3\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") "
Sep 14 10:56:54.767552 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767426    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-credential-socket\") pod \"f11dc6c1-081b-497f-9225-d97b4f9212d3\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") "
Sep 14 10:56:54.767552 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767443    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f11dc6c1-081b-497f-9225-d97b4f9212d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f11dc6c1-081b-497f-9225-d97b4f9212d3" (UID: "f11dc6c1-081b-497f-9225-d97b4f9212d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:56:54.767552 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-envoy\") pod \"f11dc6c1-081b-497f-9225-d97b4f9212d3\" (UID: \"f11dc6c1-081b-497f-9225-d97b4f9212d3\") "
Sep 14 10:56:54.767552 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767462    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "f11dc6c1-081b-497f-9225-d97b4f9212d3" (UID: "f11dc6c1-081b-497f-9225-d97b4f9212d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:56:54.767787 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767723    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f11dc6c1-081b-497f-9225-d97b4f9212d3" (UID: "f11dc6c1-081b-497f-9225-d97b4f9212d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:56:54.767846 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767811    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-data\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:54.767846 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767828    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-credential-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:54.767959 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767845    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11dc6c1-081b-497f-9225-d97b4f9212d3-istiod-ca-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:54.767959 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767862    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:54.767959 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.767855    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f11dc6c1-081b-497f-9225-d97b4f9212d3" (UID: "f11dc6c1-081b-497f-9225-d97b4f9212d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:56:54.769815 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.769782    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f11dc6c1-081b-497f-9225-d97b4f9212d3" (UID: "f11dc6c1-081b-497f-9225-d97b4f9212d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:56:54.769941 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.769845    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f11dc6c1-081b-497f-9225-d97b4f9212d3" (UID: "f11dc6c1-081b-497f-9225-d97b4f9212d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:56:54.769941 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.769894    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-kube-api-access-jwddf" (OuterVolumeSpecName: "kube-api-access-jwddf") pod "f11dc6c1-081b-497f-9225-d97b4f9212d3" (UID: "f11dc6c1-081b-497f-9225-d97b4f9212d3"). InnerVolumeSpecName "kube-api-access-jwddf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:56:54.770022 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.769991    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "f11dc6c1-081b-497f-9225-d97b4f9212d3" (UID: "f11dc6c1-081b-497f-9225-d97b4f9212d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:56:54.868524 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.868501    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-podinfo\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:54.868524 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.868520    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-token\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:54.868658 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.868530    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-workload-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:54.868658 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.868539    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwddf\" (UniqueName: \"kubernetes.io/projected/f11dc6c1-081b-497f-9225-d97b4f9212d3-kube-api-access-jwddf\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:54.868658 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.868548    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11dc6c1-081b-497f-9225-d97b4f9212d3-istio-envoy\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:56:54.900881 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.900858    2578 generic.go:356] "Generic (PLEG): container finished" podID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerID="18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29" exitCode=0
Sep 14 10:56:54.900990 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.900918    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"
Sep 14 10:56:54.900990 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.900949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" event={"ID":"f11dc6c1-081b-497f-9225-d97b4f9212d3","Type":"ContainerDied","Data":"18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29"}
Sep 14 10:56:54.901112 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.901014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss" event={"ID":"f11dc6c1-081b-497f-9225-d97b4f9212d3","Type":"ContainerDied","Data":"1e942b23d9d57906b78b3fc75b7e376bdcdf8b507650318a2bb34524270f6953"}
Sep 14 10:56:54.901112 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.901048    2578 scope.go:117] "RemoveContainer" containerID="18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29"
Sep 14 10:56:54.909657 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.909640    2578 scope.go:117] "RemoveContainer" containerID="ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d"
Sep 14 10:56:54.917522 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.917497    2578 scope.go:117] "RemoveContainer" containerID="18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29"
Sep 14 10:56:54.917770 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:56:54.917753    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29\": container with ID starting with 18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29 not found: ID does not exist" containerID="18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29"
Sep 14 10:56:54.917824 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.917779    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29"} err="failed to get container status \"18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29\": rpc error: code = NotFound desc = could not find container \"18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29\": container with ID starting with 18012b69e4d5ef18960d8d1301fbeb8cd4e3b1bbd9ada734fa325c7d3fd35c29 not found: ID does not exist"
Sep 14 10:56:54.917824 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.917795    2578 scope.go:117] "RemoveContainer" containerID="ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d"
Sep 14 10:56:54.918056 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:56:54.918041    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d\": container with ID starting with ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d not found: ID does not exist" containerID="ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d"
Sep 14 10:56:54.918109 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.918058    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d"} err="failed to get container status \"ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d\": rpc error: code = NotFound desc = could not find container \"ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d\": container with ID starting with ddad8ab5eb1bfeb485e4f4e35e9b0c2766630d610e163222657a8d9cec3cbf9d not found: ID does not exist"
Sep 14 10:56:54.923206 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.923186    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"]
Sep 14 10:56:54.927006 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.926985    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-689fac-openshift-default-d8d45697b-hfcss"]
Sep 14 10:56:54.976958 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:56:54.976940    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" path="/var/lib/kubelet/pods/f11dc6c1-081b-497f-9225-d97b4f9212d3/volumes"
Sep 14 10:57:00.323206 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.323125    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"]
Sep 14 10:57:00.323614 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.323397    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz" podUID="cd6928ab-9598-4430-a088-c8ed03dfa2b5" containerName="maas-api" containerID="cri-o://b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b" gracePeriod=30
Sep 14 10:57:00.384396 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.384359    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"]
Sep 14 10:57:00.384631 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.384606    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d" podUID="7d3b1ea8-e79d-45d2-9191-6a3888511630" containerName="payload-processing" containerID="cri-o://54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940" gracePeriod=30
Sep 14 10:57:00.640033 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.640002    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:57:00.665894 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.665656    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:57:00.716050 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.716014    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd6928ab-9598-4430-a088-c8ed03dfa2b5-openshift-service-ca\") pod \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") "
Sep 14 10:57:00.716212 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.716069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcmmq\" (UniqueName: \"kubernetes.io/projected/cd6928ab-9598-4430-a088-c8ed03dfa2b5-kube-api-access-xcmmq\") pod \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") "
Sep 14 10:57:00.716212 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.716087    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-maas-api-tls\") pod \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") "
Sep 14 10:57:00.716212 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.716185    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68nsn\" (UniqueName: \"kubernetes.io/projected/7d3b1ea8-e79d-45d2-9191-6a3888511630-kube-api-access-68nsn\") pod \"7d3b1ea8-e79d-45d2-9191-6a3888511630\" (UID: \"7d3b1ea8-e79d-45d2-9191-6a3888511630\") "
Sep 14 10:57:00.716347 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.716246    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-metrics-certs\") pod \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\" (UID: \"cd6928ab-9598-4430-a088-c8ed03dfa2b5\") "
Sep 14 10:57:00.716347 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.716295    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d3b1ea8-e79d-45d2-9191-6a3888511630-plugins-config-volume\") pod \"7d3b1ea8-e79d-45d2-9191-6a3888511630\" (UID: \"7d3b1ea8-e79d-45d2-9191-6a3888511630\") "
Sep 14 10:57:00.716457 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.716414    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd6928ab-9598-4430-a088-c8ed03dfa2b5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd6928ab-9598-4430-a088-c8ed03dfa2b5" (UID: "cd6928ab-9598-4430-a088-c8ed03dfa2b5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:57:00.717021 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.716905    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd6928ab-9598-4430-a088-c8ed03dfa2b5-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:00.717021 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.716920    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d3b1ea8-e79d-45d2-9191-6a3888511630-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d3b1ea8-e79d-45d2-9191-6a3888511630" (UID: "7d3b1ea8-e79d-45d2-9191-6a3888511630"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:57:00.718391 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.718364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd6928ab-9598-4430-a088-c8ed03dfa2b5" (UID: "cd6928ab-9598-4430-a088-c8ed03dfa2b5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:57:00.718459 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.718384    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3b1ea8-e79d-45d2-9191-6a3888511630-kube-api-access-68nsn" (OuterVolumeSpecName: "kube-api-access-68nsn") pod "7d3b1ea8-e79d-45d2-9191-6a3888511630" (UID: "7d3b1ea8-e79d-45d2-9191-6a3888511630"). InnerVolumeSpecName "kube-api-access-68nsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:57:00.718459 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.718384    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd6928ab-9598-4430-a088-c8ed03dfa2b5-kube-api-access-xcmmq" (OuterVolumeSpecName: "kube-api-access-xcmmq") pod "cd6928ab-9598-4430-a088-c8ed03dfa2b5" (UID: "cd6928ab-9598-4430-a088-c8ed03dfa2b5"). InnerVolumeSpecName "kube-api-access-xcmmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:57:00.718459 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.718411    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cd6928ab-9598-4430-a088-c8ed03dfa2b5" (UID: "cd6928ab-9598-4430-a088-c8ed03dfa2b5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:57:00.817646 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.817625    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcmmq\" (UniqueName: \"kubernetes.io/projected/cd6928ab-9598-4430-a088-c8ed03dfa2b5-kube-api-access-xcmmq\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:00.817646 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.817647    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:00.817806 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.817657    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68nsn\" (UniqueName: \"kubernetes.io/projected/7d3b1ea8-e79d-45d2-9191-6a3888511630-kube-api-access-68nsn\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:00.817806 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.817665    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd6928ab-9598-4430-a088-c8ed03dfa2b5-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:00.817806 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.817691    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d3b1ea8-e79d-45d2-9191-6a3888511630-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:00.933040 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.933012    2578 generic.go:356] "Generic (PLEG): container finished" podID="cd6928ab-9598-4430-a088-c8ed03dfa2b5" containerID="b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b" exitCode=0
Sep 14 10:57:00.933160 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.933058    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"
Sep 14 10:57:00.933160 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.933095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz" event={"ID":"cd6928ab-9598-4430-a088-c8ed03dfa2b5","Type":"ContainerDied","Data":"b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b"}
Sep 14 10:57:00.933160 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.933154    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz" event={"ID":"cd6928ab-9598-4430-a088-c8ed03dfa2b5","Type":"ContainerDied","Data":"d1cfb50414706ae89a2474a54194cfb3ea31e3d7e31a0a9537b0db9979967114"}
Sep 14 10:57:00.933308 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.933185    2578 scope.go:117] "RemoveContainer" containerID="b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b"
Sep 14 10:57:00.934560 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.934466    2578 generic.go:356] "Generic (PLEG): container finished" podID="7d3b1ea8-e79d-45d2-9191-6a3888511630" containerID="54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940" exitCode=0
Sep 14 10:57:00.934634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.934544    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"
Sep 14 10:57:00.934699 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.934560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d" event={"ID":"7d3b1ea8-e79d-45d2-9191-6a3888511630","Type":"ContainerDied","Data":"54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940"}
Sep 14 10:57:00.934759 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.934705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d" event={"ID":"7d3b1ea8-e79d-45d2-9191-6a3888511630","Type":"ContainerDied","Data":"60be8c6cee18512798880a100a958808445ef0b64f8472084247506609549b10"}
Sep 14 10:57:00.944128 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.944053    2578 scope.go:117] "RemoveContainer" containerID="b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b"
Sep 14 10:57:00.944402 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:57:00.944379    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b\": container with ID starting with b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b not found: ID does not exist" containerID="b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b"
Sep 14 10:57:00.944491 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.944407    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b"} err="failed to get container status \"b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b\": rpc error: code = NotFound desc = could not find container \"b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b\": container with ID starting with b6ce6650df4ff1e4eb9588036d78590a2d662ef411be17c69c640e6693132d3b not found: ID does not exist"
Sep 14 10:57:00.944491 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.944428    2578 scope.go:117] "RemoveContainer" containerID="54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940"
Sep 14 10:57:00.952172 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.952157    2578 scope.go:117] "RemoveContainer" containerID="54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940"
Sep 14 10:57:00.952436 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:57:00.952419    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940\": container with ID starting with 54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940 not found: ID does not exist" containerID="54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940"
Sep 14 10:57:00.952479 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.952444    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940"} err="failed to get container status \"54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940\": rpc error: code = NotFound desc = could not find container \"54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940\": container with ID starting with 54f27993c917db73c031010e2d769b5030a236df88bfa647e0567053c1f27940 not found: ID does not exist"
Sep 14 10:57:00.956350 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.956328    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"]
Sep 14 10:57:00.961742 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.961723    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-7406d4-6c9555f5b5-vbksz"]
Sep 14 10:57:00.977754 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.977735    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd6928ab-9598-4430-a088-c8ed03dfa2b5" path="/var/lib/kubelet/pods/cd6928ab-9598-4430-a088-c8ed03dfa2b5/volumes"
Sep 14 10:57:00.977977 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.977965    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"]
Sep 14 10:57:00.978020 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:00.977988    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-7406d4-859f7cf49-mxr5d"]
Sep 14 10:57:02.978713 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:02.978661    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d3b1ea8-e79d-45d2-9191-6a3888511630" path="/var/lib/kubelet/pods/7d3b1ea8-e79d-45d2-9191-6a3888511630/volumes"
Sep 14 10:57:18.038417 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:18.038381    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"]
Sep 14 10:57:18.038861 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:18.038632    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt" podUID="29fc2714-a48c-4b22-b793-6e0cc9e1f757" containerName="payload-pre-processing" containerID="cri-o://8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e" gracePeriod=30
Sep 14 10:57:18.287829 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:18.287799    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:57:18.357039 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:18.357011    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms54s\" (UniqueName: \"kubernetes.io/projected/29fc2714-a48c-4b22-b793-6e0cc9e1f757-kube-api-access-ms54s\") pod \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\" (UID: \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\") "
Sep 14 10:57:18.357238 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:18.357089    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fc2714-a48c-4b22-b793-6e0cc9e1f757-plugins-config-volume\") pod \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\" (UID: \"29fc2714-a48c-4b22-b793-6e0cc9e1f757\") "
Sep 14 10:57:18.357503 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:18.357462    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29fc2714-a48c-4b22-b793-6e0cc9e1f757-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29fc2714-a48c-4b22-b793-6e0cc9e1f757" (UID: "29fc2714-a48c-4b22-b793-6e0cc9e1f757"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:57:18.359915 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:18.359864    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29fc2714-a48c-4b22-b793-6e0cc9e1f757-kube-api-access-ms54s" (OuterVolumeSpecName: "kube-api-access-ms54s") pod "29fc2714-a48c-4b22-b793-6e0cc9e1f757" (UID: "29fc2714-a48c-4b22-b793-6e0cc9e1f757"). InnerVolumeSpecName "kube-api-access-ms54s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:57:18.458126 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:18.458098    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fc2714-a48c-4b22-b793-6e0cc9e1f757-plugins-config-volume\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:18.458126 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:18.458120    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms54s\" (UniqueName: \"kubernetes.io/projected/29fc2714-a48c-4b22-b793-6e0cc9e1f757-kube-api-access-ms54s\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:19.028943 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:19.028910    2578 generic.go:356] "Generic (PLEG): container finished" podID="29fc2714-a48c-4b22-b793-6e0cc9e1f757" containerID="8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e" exitCode=0
Sep 14 10:57:19.029088 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:19.028954    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"
Sep 14 10:57:19.029088 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:19.028993    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt" event={"ID":"29fc2714-a48c-4b22-b793-6e0cc9e1f757","Type":"ContainerDied","Data":"8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e"}
Sep 14 10:57:19.029088 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:19.029059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt" event={"ID":"29fc2714-a48c-4b22-b793-6e0cc9e1f757","Type":"ContainerDied","Data":"2441eb8c74c9a5843c456d41ac36b859d2dd4a19de6de3cda5adbd3b56d6a726"}
Sep 14 10:57:19.029088 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:19.029083    2578 scope.go:117] "RemoveContainer" containerID="8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e"
Sep 14 10:57:19.037535 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:19.037521    2578 scope.go:117] "RemoveContainer" containerID="8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e"
Sep 14 10:57:19.037809 ip-10-0-135-139 kubenswrapper[2578]: E0914 10:57:19.037791    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e\": container with ID starting with 8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e not found: ID does not exist" containerID="8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e"
Sep 14 10:57:19.037871 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:19.037815    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e"} err="failed to get container status \"8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e\": rpc error: code = NotFound desc = could not find container \"8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e\": container with ID starting with 8b33495bfaa76b1661ed4e0c8c25c366b7c4a1259a5faca938aced9094c19a0e not found: ID does not exist"
Sep 14 10:57:19.056237 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:19.056216    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"]
Sep 14 10:57:19.062597 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:19.062576    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1cbcd0-6755ccc4db-sh2xt"]
Sep 14 10:57:20.976589 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:20.976556    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29fc2714-a48c-4b22-b793-6e0cc9e1f757" path="/var/lib/kubelet/pods/29fc2714-a48c-4b22-b793-6e0cc9e1f757/volumes"
Sep 14 10:57:24.879721 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:24.879690    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"]
Sep 14 10:57:24.880184 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:24.879960    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy" containerID="cri-o://807724c966f39e8485b822e68acb8fed802ff5110b0a55528f8673c3ec924bea" gracePeriod=30
Sep 14 10:57:30.084730 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.084698    2578 generic.go:356] "Generic (PLEG): container finished" podID="98ec66c9-f524-4973-be75-5e1b6c711874" containerID="807724c966f39e8485b822e68acb8fed802ff5110b0a55528f8673c3ec924bea" exitCode=0
Sep 14 10:57:30.085133 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.084765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" event={"ID":"98ec66c9-f524-4973-be75-5e1b6c711874","Type":"ContainerDied","Data":"807724c966f39e8485b822e68acb8fed802ff5110b0a55528f8673c3ec924bea"}
Sep 14 10:57:30.085133 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.084828    2578 scope.go:117] "RemoveContainer" containerID="6eeacbcad3c11f54d028d997ba7ad733fc07f6d8ebe4b1ad45b75e178351a0db"
Sep 14 10:57:30.124270 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.124251    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:57:30.249634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249551    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-envoy\") pod \"98ec66c9-f524-4973-be75-5e1b6c711874\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") "
Sep 14 10:57:30.249634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249610    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98ec66c9-f524-4973-be75-5e1b6c711874-istio-podinfo\") pod \"98ec66c9-f524-4973-be75-5e1b6c711874\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") "
Sep 14 10:57:30.249634 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249642    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-socket\") pod \"98ec66c9-f524-4973-be75-5e1b6c711874\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") "
Sep 14 10:57:30.249917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249707    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-data\") pod \"98ec66c9-f524-4973-be75-5e1b6c711874\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") "
Sep 14 10:57:30.249917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249731    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-credential-socket\") pod \"98ec66c9-f524-4973-be75-5e1b6c711874\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") "
Sep 14 10:57:30.249917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249776    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljzrg\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-kube-api-access-ljzrg\") pod \"98ec66c9-f524-4973-be75-5e1b6c711874\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") "
Sep 14 10:57:30.249917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249806    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-certs\") pod \"98ec66c9-f524-4973-be75-5e1b6c711874\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") "
Sep 14 10:57:30.249917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249835    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-istio-token\") pod \"98ec66c9-f524-4973-be75-5e1b6c711874\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") "
Sep 14 10:57:30.249917 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249880    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98ec66c9-f524-4973-be75-5e1b6c711874-istiod-ca-cert\") pod \"98ec66c9-f524-4973-be75-5e1b6c711874\" (UID: \"98ec66c9-f524-4973-be75-5e1b6c711874\") "
Sep 14 10:57:30.250195 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249914    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-data" (OuterVolumeSpecName: "istio-data") pod "98ec66c9-f524-4973-be75-5e1b6c711874" (UID: "98ec66c9-f524-4973-be75-5e1b6c711874"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:57:30.250195 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.249993    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98ec66c9-f524-4973-be75-5e1b6c711874" (UID: "98ec66c9-f524-4973-be75-5e1b6c711874"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:57:30.250195 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.250065    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98ec66c9-f524-4973-be75-5e1b6c711874" (UID: "98ec66c9-f524-4973-be75-5e1b6c711874"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:57:30.250195 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.250080    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98ec66c9-f524-4973-be75-5e1b6c711874" (UID: "98ec66c9-f524-4973-be75-5e1b6c711874"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:57:30.250461 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.250246    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:30.250461 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.250260    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-data\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:30.250461 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.250269    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-credential-socket\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:30.250461 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.250281    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-workload-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:30.250461 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.250282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98ec66c9-f524-4973-be75-5e1b6c711874-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98ec66c9-f524-4973-be75-5e1b6c711874" (UID: "98ec66c9-f524-4973-be75-5e1b6c711874"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:57:30.251952 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.251928    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-istio-token" (OuterVolumeSpecName: "istio-token") pod "98ec66c9-f524-4973-be75-5e1b6c711874" (UID: "98ec66c9-f524-4973-be75-5e1b6c711874"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:57:30.252060 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.251999    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-kube-api-access-ljzrg" (OuterVolumeSpecName: "kube-api-access-ljzrg") pod "98ec66c9-f524-4973-be75-5e1b6c711874" (UID: "98ec66c9-f524-4973-be75-5e1b6c711874"). InnerVolumeSpecName "kube-api-access-ljzrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:57:30.252060 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.252002    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98ec66c9-f524-4973-be75-5e1b6c711874-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98ec66c9-f524-4973-be75-5e1b6c711874" (UID: "98ec66c9-f524-4973-be75-5e1b6c711874"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:57:30.252134 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.252086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98ec66c9-f524-4973-be75-5e1b6c711874" (UID: "98ec66c9-f524-4973-be75-5e1b6c711874"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:57:30.350892 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.350871    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljzrg\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-kube-api-access-ljzrg\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:30.350892 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.350889    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98ec66c9-f524-4973-be75-5e1b6c711874-istio-token\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:30.351027 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.350898    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98ec66c9-f524-4973-be75-5e1b6c711874-istiod-ca-cert\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:30.351027 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.350907    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98ec66c9-f524-4973-be75-5e1b6c711874-istio-envoy\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:30.351027 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:30.350914    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98ec66c9-f524-4973-be75-5e1b6c711874-istio-podinfo\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:31.090219 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:31.090197    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"
Sep 14 10:57:31.090568 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:31.090197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9" event={"ID":"98ec66c9-f524-4973-be75-5e1b6c711874","Type":"ContainerDied","Data":"2da30e8aec0311a8522bec5d8592e1fc4930f69b93894a4445dab64941ef8426"}
Sep 14 10:57:31.090568 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:31.090319    2578 scope.go:117] "RemoveContainer" containerID="807724c966f39e8485b822e68acb8fed802ff5110b0a55528f8673c3ec924bea"
Sep 14 10:57:31.109139 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:31.109120    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"]
Sep 14 10:57:31.114002 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:31.113974    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1cbcd0-openshift-default-5f656d4c9d-hptg9"]
Sep 14 10:57:32.976863 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:32.976827    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" path="/var/lib/kubelet/pods/98ec66c9-f524-4973-be75-5e1b6c711874/volumes"
Sep 14 10:57:35.885120 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:35.885084    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"]
Sep 14 10:57:35.885593 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:35.885286    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m" podUID="b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" containerName="maas-api" containerID="cri-o://d30eccf23634e58e8582a9a5de8b2e725e277ac5162d9efaaea3c8b148172870" gracePeriod=30
Sep 14 10:57:36.122134 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.122108    2578 generic.go:356] "Generic (PLEG): container finished" podID="b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" containerID="d30eccf23634e58e8582a9a5de8b2e725e277ac5162d9efaaea3c8b148172870" exitCode=0
Sep 14 10:57:36.122255 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.122177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m" event={"ID":"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4","Type":"ContainerDied","Data":"d30eccf23634e58e8582a9a5de8b2e725e277ac5162d9efaaea3c8b148172870"}
Sep 14 10:57:36.122255 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.122226    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m" event={"ID":"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4","Type":"ContainerDied","Data":"9b6932bdf3d723ea55790db7060b56a400fc3ee155e4370f9a3b5f64a072a4ab"}
Sep 14 10:57:36.122255 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.122242    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b6932bdf3d723ea55790db7060b56a400fc3ee155e4370f9a3b5f64a072a4ab"
Sep 14 10:57:36.134445 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.134422    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:57:36.290987 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.290905    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-metrics-certs\") pod \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") "
Sep 14 10:57:36.290987 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.290942    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-maas-api-tls\") pod \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") "
Sep 14 10:57:36.290987 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.290985    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-openshift-service-ca\") pod \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") "
Sep 14 10:57:36.291201 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.291077    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lb2q\" (UniqueName: \"kubernetes.io/projected/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-kube-api-access-9lb2q\") pod \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\" (UID: \"b015d9cf-d1a7-4dc7-9508-2a77bda6daf4\") "
Sep 14 10:57:36.291371 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.291348    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" (UID: "b015d9cf-d1a7-4dc7-9508-2a77bda6daf4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:57:36.293238 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.293209    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-kube-api-access-9lb2q" (OuterVolumeSpecName: "kube-api-access-9lb2q") pod "b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" (UID: "b015d9cf-d1a7-4dc7-9508-2a77bda6daf4"). InnerVolumeSpecName "kube-api-access-9lb2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:57:36.293325 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.293234    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" (UID: "b015d9cf-d1a7-4dc7-9508-2a77bda6daf4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:57:36.293325 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.293269    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" (UID: "b015d9cf-d1a7-4dc7-9508-2a77bda6daf4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:57:36.392139 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.392101    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:36.392139 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.392135    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:36.392139 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.392144    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:36.392328 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:36.392154    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lb2q\" (UniqueName: \"kubernetes.io/projected/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4-kube-api-access-9lb2q\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 10:57:37.126439 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:37.126410    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"
Sep 14 10:57:37.142134 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:37.142105    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"]
Sep 14 10:57:37.147055 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:37.147033    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7bdcda-55b4d699b-ztn4m"]
Sep 14 10:57:38.976702 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:57:38.976657    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" path="/var/lib/kubelet/pods/b015d9cf-d1a7-4dc7-9508-2a77bda6daf4/volumes"
Sep 14 10:58:03.209928 ip-10-0-135-139 kubenswrapper[2578]: I0914 10:58:03.209898    2578 scope.go:117] "RemoveContainer" containerID="d30eccf23634e58e8582a9a5de8b2e725e277ac5162d9efaaea3c8b148172870"
Sep 14 11:02:46.699891 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.699808    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"]
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700229    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700244    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700260    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9568c431-9366-4607-9ba6-a2bd778f373c" containerName="maas-api"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700269    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9568c431-9366-4607-9ba6-a2bd778f373c" containerName="maas-api"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700282    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29fc2714-a48c-4b22-b793-6e0cc9e1f757" containerName="payload-pre-processing"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700290    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="29fc2714-a48c-4b22-b793-6e0cc9e1f757" containerName="payload-pre-processing"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700300    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" containerName="maas-api"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700309    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" containerName="maas-api"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700320    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd6928ab-9598-4430-a088-c8ed03dfa2b5" containerName="maas-api"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700328    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd6928ab-9598-4430-a088-c8ed03dfa2b5" containerName="maas-api"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700341    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb8e15b-4fc3-478e-8e69-de82fd778237" containerName="payload-pre-processing"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700349    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb8e15b-4fc3-478e-8e69-de82fd778237" containerName="payload-pre-processing"
Sep 14 11:02:46.700351 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700358    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eec55f8-e86e-499c-a172-7ef57f1111f9" containerName="payload-processing"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700367    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eec55f8-e86e-499c-a172-7ef57f1111f9" containerName="payload-processing"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700376    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700384    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700401    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d3b1ea8-e79d-45d2-9191-6a3888511630" containerName="payload-processing"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700410    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d3b1ea8-e79d-45d2-9191-6a3888511630" containerName="payload-processing"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700477    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700488    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700496    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eec55f8-e86e-499c-a172-7ef57f1111f9" containerName="payload-processing"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700505    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9568c431-9366-4607-9ba6-a2bd778f373c" containerName="maas-api"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700514    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd6928ab-9598-4430-a088-c8ed03dfa2b5" containerName="maas-api"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700521    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d3b1ea8-e79d-45d2-9191-6a3888511630" containerName="payload-processing"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700529    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b015d9cf-d1a7-4dc7-9508-2a77bda6daf4" containerName="maas-api"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700537    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="29fc2714-a48c-4b22-b793-6e0cc9e1f757" containerName="payload-pre-processing"
Sep 14 11:02:46.700805 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.700546    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb8e15b-4fc3-478e-8e69-de82fd778237" containerName="payload-pre-processing"
Sep 14 11:02:46.703583 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.703567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.712195 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.712164    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"]
Sep 14 11:02:46.745517 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.745483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f1d6b79-609e-4297-97f3-1684d8c37204-maas-api-tls\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.745665 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.745586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcsq6\" (UniqueName: \"kubernetes.io/projected/2f1d6b79-609e-4297-97f3-1684d8c37204-kube-api-access-xcsq6\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.745728 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.745661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1d6b79-609e-4297-97f3-1684d8c37204-openshift-service-ca\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.745764 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.745728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1d6b79-609e-4297-97f3-1684d8c37204-metrics-certs\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.846262 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.846230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcsq6\" (UniqueName: \"kubernetes.io/projected/2f1d6b79-609e-4297-97f3-1684d8c37204-kube-api-access-xcsq6\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.846383 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.846285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1d6b79-609e-4297-97f3-1684d8c37204-openshift-service-ca\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.846383 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.846314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1d6b79-609e-4297-97f3-1684d8c37204-metrics-certs\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.846383 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.846354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f1d6b79-609e-4297-97f3-1684d8c37204-maas-api-tls\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.847120 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.847038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1d6b79-609e-4297-97f3-1684d8c37204-openshift-service-ca\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.848906 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.848879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f1d6b79-609e-4297-97f3-1684d8c37204-maas-api-tls\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.849005 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.848914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f1d6b79-609e-4297-97f3-1684d8c37204-metrics-certs\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:46.854009 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:46.853990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcsq6\" (UniqueName: \"kubernetes.io/projected/2f1d6b79-609e-4297-97f3-1684d8c37204-kube-api-access-xcsq6\") pod \"maas-api-7964b8c79c-z2plg\" (UID: \"2f1d6b79-609e-4297-97f3-1684d8c37204\") " pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:47.015606 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:47.015528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:47.290935 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:47.290792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"]
Sep 14 11:02:47.293412 ip-10-0-135-139 kubenswrapper[2578]: W0914 11:02:47.293385    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1d6b79_609e_4297_97f3_1684d8c37204.slice/crio-c342e3554485cd2392a3867ef010e464a0ef17573b54347e5d27805ff5327f4d WatchSource:0}: Error finding container c342e3554485cd2392a3867ef010e464a0ef17573b54347e5d27805ff5327f4d: Status 404 returned error can't find the container with id c342e3554485cd2392a3867ef010e464a0ef17573b54347e5d27805ff5327f4d
Sep 14 11:02:47.294684 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:47.294654    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 11:02:47.553797 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:47.553711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg" event={"ID":"2f1d6b79-609e-4297-97f3-1684d8c37204","Type":"ContainerStarted","Data":"c342e3554485cd2392a3867ef010e464a0ef17573b54347e5d27805ff5327f4d"}
Sep 14 11:02:49.567629 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:49.567590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg" event={"ID":"2f1d6b79-609e-4297-97f3-1684d8c37204","Type":"ContainerStarted","Data":"37c3d0be2b1780c21b8bab5512922fb71a9e656b0043f51f7dd54016912eb988"}
Sep 14 11:02:49.568017 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:49.567728    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:49.586981 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:49.586914    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg" podStartSLOduration=2.191003727 podStartE2EDuration="3.586897559s" totalImagesPullingTime="1.395893832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:02:49.584906007 +0000 UTC m=+2267.126307808" watchObservedRunningTime="2026-09-14 11:02:49.586897559 +0000 UTC m=+2267.128299359"
Sep 14 11:02:55.576787 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:55.576760    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7964b8c79c-z2plg"
Sep 14 11:02:55.625653 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:55.625621    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"]
Sep 14 11:02:55.625846 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:55.625829    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j" podUID="b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" containerName="maas-api" containerID="cri-o://0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f" gracePeriod=30
Sep 14 11:02:56.196403 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.196359    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j" podUID="b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.32:8443/health\": dial tcp 10.133.0.32:8443: connect: connection refused"
Sep 14 11:02:56.872370 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.872344    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 11:02:56.925063 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.925036    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njp9g\" (UniqueName: \"kubernetes.io/projected/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-kube-api-access-njp9g\") pod \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") "
Sep 14 11:02:56.925212 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.925097    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-maas-api-tls\") pod \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") "
Sep 14 11:02:56.925212 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.925126    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-metrics-certs\") pod \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") "
Sep 14 11:02:56.925212 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.925163    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-openshift-service-ca\") pod \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\" (UID: \"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90\") "
Sep 14 11:02:56.925554 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.925530    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" (UID: "b8229365-3c1b-4e3c-86a7-4fd43ec8bd90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 11:02:56.927324 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.927294    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-kube-api-access-njp9g" (OuterVolumeSpecName: "kube-api-access-njp9g") pod "b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" (UID: "b8229365-3c1b-4e3c-86a7-4fd43ec8bd90"). InnerVolumeSpecName "kube-api-access-njp9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:02:56.927418 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.927322    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" (UID: "b8229365-3c1b-4e3c-86a7-4fd43ec8bd90"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:02:56.927418 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:56.927340    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" (UID: "b8229365-3c1b-4e3c-86a7-4fd43ec8bd90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 11:02:57.026347 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.026323    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-openshift-service-ca\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 11:02:57.026347 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.026347    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njp9g\" (UniqueName: \"kubernetes.io/projected/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-kube-api-access-njp9g\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 11:02:57.026473 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.026356    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-maas-api-tls\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 11:02:57.026473 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.026368    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90-metrics-certs\") on node \"ip-10-0-135-139.ec2.internal\" DevicePath \"\""
Sep 14 11:02:57.606396 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.606362    2578 generic.go:356] "Generic (PLEG): container finished" podID="b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" containerID="0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f" exitCode=0
Sep 14 11:02:57.606582 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.606411    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"
Sep 14 11:02:57.606582 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.606453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j" event={"ID":"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90","Type":"ContainerDied","Data":"0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f"}
Sep 14 11:02:57.606582 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.606525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j" event={"ID":"b8229365-3c1b-4e3c-86a7-4fd43ec8bd90","Type":"ContainerDied","Data":"589be3a4a3d1feed2cc82cfce34317210ec27b52acda705dcd66bf974faa9674"}
Sep 14 11:02:57.606582 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.606545    2578 scope.go:117] "RemoveContainer" containerID="0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f"
Sep 14 11:02:57.615572 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.615553    2578 scope.go:117] "RemoveContainer" containerID="0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f"
Sep 14 11:02:57.615857 ip-10-0-135-139 kubenswrapper[2578]: E0914 11:02:57.615829    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f\": container with ID starting with 0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f not found: ID does not exist" containerID="0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f"
Sep 14 11:02:57.615914 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.615865    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f"} err="failed to get container status \"0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f\": rpc error: code = NotFound desc = could not find container \"0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f\": container with ID starting with 0ce74db9a417d8e8660c25c6b9fc23b43d8f45c986646ed11a9a29e60dc6f11f not found: ID does not exist"
Sep 14 11:02:57.623888 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.623866    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"]
Sep 14 11:02:57.634695 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:57.630662    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6997c4c9fc-7c94j"]
Sep 14 11:02:58.976297 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:02:58.976268    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" path="/var/lib/kubelet/pods/b8229365-3c1b-4e3c-86a7-4fd43ec8bd90/volumes"
Sep 14 11:03:26.568716 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:26.568690    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757dcccd8b-svws6_dc0e9989-341b-497d-9eeb-f5ec9239ecaf/copy-manifests/0.log"
Sep 14 11:03:26.582094 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:26.582059    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757dcccd8b-svws6_dc0e9989-341b-497d-9eeb-f5ec9239ecaf/manager/0.log"
Sep 14 11:03:27.031663 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:27.031635    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7964b8c79c-z2plg_2f1d6b79-609e-4297-97f3-1684d8c37204/maas-api/0.log"
Sep 14 11:03:28.864334 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:28.864304    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-f2htw_906d74f1-d207-4362-b1ea-36d734133363/manager/0.log"
Sep 14 11:03:29.325032 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:29.324964    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vkhlm_337398ff-eb90-4c47-aedc-387a3672b408/discovery/0.log"
Sep 14 11:03:30.457755 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:30.457729    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-v2bs8_ac964901-034f-483f-9a5c-d49b840dbfcc/main/0.log"
Sep 14 11:03:30.672458 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:30.672428    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-x7bx7_28ad35a9-abe0-4543-af50-73c7d3d090de/main/0.log"
Sep 14 11:03:30.783811 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:30.783737    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f889pd_dc9fbd6a-1f38-456d-9472-e0f6b437abfa/main/0.log"
Sep 14 11:03:39.326773 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:39.326744    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qs687_b2a0e91f-654d-4dc1-aeaa-14267a34a523/global-pull-secret-syncer/0.log"
Sep 14 11:03:39.505996 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:39.505966    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xtj7j_d1c4c374-a18b-441b-b87d-58fcb8a86aa2/konnectivity-agent/0.log"
Sep 14 11:03:39.554498 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:39.554475    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-139.ec2.internal_6f2534fef1caace65913d4394bf8e9e2/haproxy/0.log"
Sep 14 11:03:44.387281 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:44.387256    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-f2htw_906d74f1-d207-4362-b1ea-36d734133363/manager/0.log"
Sep 14 11:03:46.213292 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:46.213267    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f6975b68b-n8vjg_42267498-b89c-4452-929b-51839c3cc629/metrics-server/0.log"
Sep 14 11:03:46.239518 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:46.239495    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-7l88l_6fdc388c-dfe1-4424-880d-f2dbfd27ba7a/monitoring-plugin/0.log"
Sep 14 11:03:46.271303 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:46.271283    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxv27_33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35/node-exporter/0.log"
Sep 14 11:03:46.300390 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:46.300371    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxv27_33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35/kube-rbac-proxy/0.log"
Sep 14 11:03:46.323921 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:46.323897    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxv27_33fc1af3-b0d2-4b43-83ca-c8b77cfdcb35/init-textfile/0.log"
Sep 14 11:03:46.890713 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:46.890685    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-99td2_3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e/prometheus-operator/0.log"
Sep 14 11:03:46.919299 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:46.919275    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-99td2_3a5ef2d9-c27c-4c8a-a0b8-cc3126afd77e/kube-rbac-proxy/0.log"
Sep 14 11:03:49.942155 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942093    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"]
Sep 14 11:03:49.942518 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942433    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy"
Sep 14 11:03:49.942518 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942446    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy"
Sep 14 11:03:49.942518 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942456    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" containerName="maas-api"
Sep 14 11:03:49.942518 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942463    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" containerName="maas-api"
Sep 14 11:03:49.942518 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942476    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy"
Sep 14 11:03:49.942518 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942482    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy"
Sep 14 11:03:49.942739 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942530    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f11dc6c1-081b-497f-9225-d97b4f9212d3" containerName="istio-proxy"
Sep 14 11:03:49.942739 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942537    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8229365-3c1b-4e3c-86a7-4fd43ec8bd90" containerName="maas-api"
Sep 14 11:03:49.942739 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.942546    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="98ec66c9-f524-4973-be75-5e1b6c711874" containerName="istio-proxy"
Sep 14 11:03:49.945408 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.945393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:49.948416 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.948347    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qn42v\"/\"openshift-service-ca.crt\""
Sep 14 11:03:49.948416 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.948359    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qn42v\"/\"kube-root-ca.crt\""
Sep 14 11:03:49.949539 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.949522    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qn42v\"/\"default-dockercfg-dgh7x\""
Sep 14 11:03:49.960832 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:49.960812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"]
Sep 14 11:03:50.115391 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.115361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-podres\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.115537 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.115419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mc24\" (UniqueName: \"kubernetes.io/projected/9e95d60d-dc49-407d-aee9-e838c5db5fb3-kube-api-access-7mc24\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.115537 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.115473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-lib-modules\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.115657 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.115560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-sys\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.115657 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.115632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-proc\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.216325 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.216262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-podres\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.216325 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.216298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mc24\" (UniqueName: \"kubernetes.io/projected/9e95d60d-dc49-407d-aee9-e838c5db5fb3-kube-api-access-7mc24\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.216325 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.216319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-lib-modules\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.216512 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.216351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-sys\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.216512 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.216382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-proc\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.216512 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.216416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-podres\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.216512 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.216460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-lib-modules\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.216512 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.216465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-proc\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.216512 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.216479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e95d60d-dc49-407d-aee9-e838c5db5fb3-sys\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.224437 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.224421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mc24\" (UniqueName: \"kubernetes.io/projected/9e95d60d-dc49-407d-aee9-e838c5db5fb3-kube-api-access-7mc24\") pod \"perf-node-gather-daemonset-76dtt\" (UID: \"9e95d60d-dc49-407d-aee9-e838c5db5fb3\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.255430 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.255409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.525860 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.525761    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"]
Sep 14 11:03:50.528298 ip-10-0-135-139 kubenswrapper[2578]: W0914 11:03:50.528271    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e95d60d_dc49_407d_aee9_e838c5db5fb3.slice/crio-e14824c1256ae923f6da211e0eaab1d76142013155b6733194e63212a032c289 WatchSource:0}: Error finding container e14824c1256ae923f6da211e0eaab1d76142013155b6733194e63212a032c289: Status 404 returned error can't find the container with id e14824c1256ae923f6da211e0eaab1d76142013155b6733194e63212a032c289
Sep 14 11:03:50.851985 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.851954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt" event={"ID":"9e95d60d-dc49-407d-aee9-e838c5db5fb3","Type":"ContainerStarted","Data":"07ac333a51ef9eaa35060863296ebea85c5e20e46bbc89d898ee870bf0799fa8"}
Sep 14 11:03:50.852104 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.852019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt" event={"ID":"9e95d60d-dc49-407d-aee9-e838c5db5fb3","Type":"ContainerStarted","Data":"e14824c1256ae923f6da211e0eaab1d76142013155b6733194e63212a032c289"}
Sep 14 11:03:50.852104 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.852049    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:50.870855 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:50.870810    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt" podStartSLOduration=1.870795277 podStartE2EDuration="1.870795277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 11:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:50.868954489 +0000 UTC m=+2328.410356290" watchObservedRunningTime="2026-09-14 11:03:50.870795277 +0000 UTC m=+2328.412197124"
Sep 14 11:03:51.664178 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:51.664151    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sklt4_de7a6090-1c0d-4a70-95f4-3f398a60513b/dns/0.log"
Sep 14 11:03:51.689131 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:51.689108    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sklt4_de7a6090-1c0d-4a70-95f4-3f398a60513b/kube-rbac-proxy/0.log"
Sep 14 11:03:51.755784 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:51.755766    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5kmw4_19dc5f96-e3fe-4bcf-9e50-cda9d99a2d55/dns-node-resolver/0.log"
Sep 14 11:03:52.369143 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:52.369117    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d789b5c7-cv72n_e48743b5-cc8a-4cbb-9fa1-a87b1fdc3f2a/registry/0.log"
Sep 14 11:03:52.391756 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:52.391735    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6j4z8_9fb96906-7504-42f9-97b1-98b23a0a63d8/node-ca/0.log"
Sep 14 11:03:53.743031 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:53.743003    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vkhlm_337398ff-eb90-4c47-aedc-387a3672b408/discovery/0.log"
Sep 14 11:03:54.881062 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:54.881032    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k7t76_2261f98f-d83a-476d-88d7-e42c037c25b7/serve-healthcheck-canary/0.log"
Sep 14 11:03:55.505343 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:55.505314    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hvfbq_00ce615a-bfca-4fb3-8a72-fb4649206267/kube-rbac-proxy/0.log"
Sep 14 11:03:55.536021 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:55.535992    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hvfbq_00ce615a-bfca-4fb3-8a72-fb4649206267/exporter/0.log"
Sep 14 11:03:55.567996 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:55.567976    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hvfbq_00ce615a-bfca-4fb3-8a72-fb4649206267/extractor/0.log"
Sep 14 11:03:56.866499 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:56.866472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-76dtt"
Sep 14 11:03:58.965389 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:58.965353    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757dcccd8b-svws6_dc0e9989-341b-497d-9eeb-f5ec9239ecaf/manager/0.log"
Sep 14 11:03:58.982650 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:03:58.982628    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757dcccd8b-svws6_dc0e9989-341b-497d-9eeb-f5ec9239ecaf/copy-manifests/0.log"
Sep 14 11:04:00.466222 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:04:00.466190    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-594c4c57b7-s7x5d_47f244df-100b-4787-8c15-4afa23a72440/manager/0.log"
Sep 14 11:04:01.016016 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:04:01.015985    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vkhlm_337398ff-eb90-4c47-aedc-387a3672b408/discovery/0.log"
Sep 14 11:04:03.237626 ip-10-0-135-139 kubenswrapper[2578]: I0914 11:04:03.237594    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vkhlm_337398ff-eb90-4c47-aedc-387a3672b408/discovery/0.log"