Sep 19 10:36:34.445875 ip-10-0-138-7 systemd[1]: Starting Kubernetes Kubelet...
Sep 19 10:36:37.930878 ip-10-0-138-7 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 10:36:37.930878 ip-10-0-138-7 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 19 10:36:37.930878 ip-10-0-138-7 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 10:36:37.930878 ip-10-0-138-7 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 19 10:36:37.930878 ip-10-0-138-7 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 10:36:37.931767 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.930966    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 19 10:36:37.935687 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935670    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:36:37.935687 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935686    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935690    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935693    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935696    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935700    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935703    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935706    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935709    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935712    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935715    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935718    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935722    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935724    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935727    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935730    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935733    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935736    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935738    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935741    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935744    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:36:37.935759 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935747    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935749    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935752    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935755    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935757    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935760    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935763    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935766    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935769    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935771    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935774    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935777    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935779    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935782    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935785    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935787    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935790    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935793    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935795    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935798    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:36:37.936232 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935801    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935809    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935812    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935814    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935817    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935819    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935822    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935826    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935830    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935833    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935836    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935839    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935842    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935845    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935848    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935852    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935855    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935858    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935861    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:36:37.936741 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935864    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935867    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935870    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935873    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935875    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935878    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935880    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935883    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935886    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935888    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935891    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935894    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935897    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935900    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935903    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935907    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935910    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935913    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935917    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:36:37.937246 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935920    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935923    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935926    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935928    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935931    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935934    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935936    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935940    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935944    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935947    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935950    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935953    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935956    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935959    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935962    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935965    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935968    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935971    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935973    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.935976    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:36:37.937722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936694    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936703    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936706    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936708    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936712    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936717    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936721    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936724    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936728    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936731    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936734    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936737    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936740    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936743    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936746    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936749    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936752    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936755    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936758    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:36:37.938205 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936761    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936763    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936766    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936769    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936772    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936775    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936777    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936780    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936782    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936785    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936787    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936790    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936793    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936796    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936798    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936801    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936804    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936807    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936810    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:36:37.938688 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936817    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936822    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936827    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936830    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936833    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936837    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936842    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936845    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936849    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936852    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936855    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936859    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936862    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936865    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936868    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936871    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936874    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936877    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:36:37.939189 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936880    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936883    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936886    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936889    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936891    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936894    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936897    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936899    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936910    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936913    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936915    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936918    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936920    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936924    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936927    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936930    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936933    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936936    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936938    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936941    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:36:37.939654 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936944    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936947    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936949    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936956    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936958    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936961    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936964    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936966    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936969    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936971    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936974    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936976    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936979    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936982    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936984    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936987    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936989    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936992    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936995    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.936997    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:36:37.940146 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937000    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937003    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937005    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937368    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937373    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937376    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937379    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937382    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937385    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937388    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937390    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937393    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937396    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937399    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937401    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937406    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937408    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937411    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937414    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937417    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:36:37.940658 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937419    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937422    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937425    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937427    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937430    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937432    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937435    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937438    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937440    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937443    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937445    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937450    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937453    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937456    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937460    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937464    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937467    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937469    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937472    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:36:37.941155 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937474    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937477    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937479    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937482    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937484    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937488    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937490    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937493    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937496    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937499    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937502    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937504    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937507    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937510    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937512    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937515    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937517    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937520    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937522    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937525    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:36:37.941625 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937527    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937530    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937532    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937535    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937538    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937541    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937558    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937560    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937563    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937566    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937569    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937572    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937574    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937577    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937580    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937582    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937585    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937587    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937590    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:36:37.942109 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937593    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937597    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937600    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937603    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937605    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937608    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937611    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937613    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937616    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937618    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937621    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937624    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937626    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937629    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937631    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937634    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937636    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937639    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937642    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937644    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:36:37.942590 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937647    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937651    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937655    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.937658    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937748    2563 flags.go:64] FLAG: --address="0.0.0.0"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937790    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937797    2563 flags.go:64] FLAG: --anonymous-auth="true"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937801    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937806    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937809    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937814    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937819    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937829    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937834    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937838    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937841    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937844    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937848    2563 flags.go:64] FLAG: --cgroup-root=""
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937851    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937854    2563 flags.go:64] FLAG: --client-ca-file=""
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937857    2563 flags.go:64] FLAG: --cloud-provider="external"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937860    2563 flags.go:64] FLAG: --cluster-dns="[]"
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937866    2563 flags.go:64] FLAG: --cluster-domain=""
Sep 19 10:36:37.943075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937869    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937872    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937875    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937879    2563 flags.go:64] FLAG: --container-log-max-files="5"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937882    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937886    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937889    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937892    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937895    2563 flags.go:64] FLAG: --contention-profiling="false"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937899    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937902    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937905    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937908    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937912    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937916    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937919    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937922    2563 flags.go:64] FLAG: --enable-load-reader="false"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937925    2563 flags.go:64] FLAG: --enable-server="true"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937928    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937932    2563 flags.go:64] FLAG: --event-burst="100"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937935    2563 flags.go:64] FLAG: --event-qps="50"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937938    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937944    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937947    2563 flags.go:64] FLAG: --eviction-hard=""
Sep 19 10:36:37.943642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937951    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937954    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937957    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937960    2563 flags.go:64] FLAG: --eviction-soft=""
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937964    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937967    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937970    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937973    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937976    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937979    2563 flags.go:64] FLAG: --fail-swap-on="true"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937982    2563 flags.go:64] FLAG: --feature-gates=""
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937986    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937990    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937993    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.937997    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938000    2563 flags.go:64] FLAG: --healthz-port="10248"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938003    2563 flags.go:64] FLAG: --help="false"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938006    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-138-7.ec2.internal"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938010    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938013    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938016    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938019    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938023    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938026    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 19 10:36:37.944218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938029    2563 flags.go:64] FLAG: --image-service-endpoint=""
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938032    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938035    2563 flags.go:64] FLAG: --kube-api-burst="100"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938038    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938041    2563 flags.go:64] FLAG: --kube-api-qps="50"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938062    2563 flags.go:64] FLAG: --kube-reserved=""
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938067    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938074    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938077    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938080    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938083    2563 flags.go:64] FLAG: --lock-file=""
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938087    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938090    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938093    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938098    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938101    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938104    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938107    2563 flags.go:64] FLAG: --logging-format="text"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938110    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938113    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938116    2563 flags.go:64] FLAG: --manifest-url=""
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938120    2563 flags.go:64] FLAG: --manifest-url-header=""
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938129    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938132    2563 flags.go:64] FLAG: --max-open-files="1000000"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938136    2563 flags.go:64] FLAG: --max-pods="110"
Sep 19 10:36:37.944873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938139    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938142    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938145    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938148    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938151    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938154    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938157    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938165    2563 flags.go:64] FLAG: --node-status-max-images="50"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938168    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938171    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938175    2563 flags.go:64] FLAG: --pod-cidr=""
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938179    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938185    2563 flags.go:64] FLAG: --pod-manifest-path=""
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938188    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938193    2563 flags.go:64] FLAG: --pods-per-core="0"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938202    2563 flags.go:64] FLAG: --port="10250"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938205    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938208    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e6dec6a6028e3e4a"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938211    2563 flags.go:64] FLAG: --qos-reserved=""
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938214    2563 flags.go:64] FLAG: --read-only-port="10255"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938218    2563 flags.go:64] FLAG: --register-node="true"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938221    2563 flags.go:64] FLAG: --register-with-taints=""
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938225    2563 flags.go:64] FLAG: --registry-burst="10"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938228    2563 flags.go:64] FLAG: --registry-qps="5"
Sep 19 10:36:37.945498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938231    2563 flags.go:64] FLAG: --reserved-cpus=""
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938234    2563 flags.go:64] FLAG: --reserved-memory=""
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938237    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938241    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938244    2563 flags.go:64] FLAG: --rotate-certificates="false"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938247    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938250    2563 flags.go:64] FLAG: --runonce="false"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938252    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938256    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938259    2563 flags.go:64] FLAG: --seccomp-default="false"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938262    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938265    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938268    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938271    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938274    2563 flags.go:64] FLAG: --storage-driver-password="root"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938277    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938280    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938283    2563 flags.go:64] FLAG: --storage-driver-user="root"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938286    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938291    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938294    2563 flags.go:64] FLAG: --system-cgroups=""
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938297    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938304    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938307    2563 flags.go:64] FLAG: --tls-cert-file=""
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938311    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 19 10:36:37.946112 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938316    2563 flags.go:64] FLAG: --tls-min-version=""
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938319    2563 flags.go:64] FLAG: --tls-private-key-file=""
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938322    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938325    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938328    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938331    2563 flags.go:64] FLAG: --v="2"
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938336    2563 flags.go:64] FLAG: --version="false"
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938340    2563 flags.go:64] FLAG: --vmodule=""
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938344    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.938347    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938471    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938475    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938478    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938481    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938486    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938489    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938493    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938496    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938499    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938502    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938505    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:36:37.946792 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938507    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938510    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938513    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938516    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938519    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938524    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938527    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938529    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938534    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938537    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938539    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938543    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938558    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938561    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938574    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938578    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938580    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938583    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938586    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938589    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:36:37.947322 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938591    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938595    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938599    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938603    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938607    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938611    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938614    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938617    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938620    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938623    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938626    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938628    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938631    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938633    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938637    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938640    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938643    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938645    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938650    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938653    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:36:37.947851 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938657    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938660    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938664    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938667    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938671    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938674    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938677    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938680    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938682    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938685    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938688    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938691    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938693    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938696    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938699    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938702    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938704    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938707    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938709    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938712    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:36:37.948379 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938715    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938717    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938720    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938723    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938726    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938729    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938732    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938735    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938738    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938740    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938744    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938747    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938751    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938754    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938756    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938759    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938761    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938764    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938767    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938769    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:36:37.948887 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938772    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938774    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938777    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938780    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938782    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938785    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938787    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.938790    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.939817    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.947927    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.947945    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.947966    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.947977    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948036    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:36:37.949384 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948041    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948044    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948047    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948050    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948053    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948057    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948059    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948062    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948066    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948069    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948072    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948075    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948077    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948080    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948083    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948086    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948089    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948091    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948094    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948097    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948100    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:36:37.949815 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948103    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948106    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948108    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948111    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948114    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948116    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948119    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948123    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948125    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948128    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948131    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948134    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948136    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948139    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948142    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948145    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948147    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948150    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948152    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948155    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:36:37.950514 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948157    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948162    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948166    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948168    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948172    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948176    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948180    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948183    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948185    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948188    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948191    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948194    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948197    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948199    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948202    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948206    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948209    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948212    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:36:37.951347 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948215    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948218    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948222    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948225    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948228    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948231    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948234    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948236    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948239    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948242    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948245    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948247    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948250    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948253    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948255    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948258    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948261    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948263    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948266    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948269    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:36:37.951837 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948272    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948274    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948277    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948280    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948283    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948285    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948288    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948290    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948293    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948295    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948298    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948301    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948304    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948307    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948309    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948313    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948315    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948318    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:36:37.952370 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948320    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.948325    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948447    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948453    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948456    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948459    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948461    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948464    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948466    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948469    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948472    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948474    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948477    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948480    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948482    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:36:37.952835 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948485    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948487    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948490    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948493    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948496    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948498    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948501    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948503    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948506    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948509    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948511    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948514    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948516    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948519    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948522    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948525    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948528    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948531    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948533    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948536    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:36:37.953211 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948538    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948541    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948563    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948567    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948570    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948573    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948575    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948578    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948581    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948583    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948586    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948588    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948591    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948594    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948596    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948599    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948602    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948605    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948608    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:36:37.953751 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948612    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948615    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948618    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948621    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948623    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948627    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948631    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948634    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948637    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948641    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948644    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948647    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948649    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948652    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948655    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948657    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948660    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948662    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948665    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948669    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:36:37.954223 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948672    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948675    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948678    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948681    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948684    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948687    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948689    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948692    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948695    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948698    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948701    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948703    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948706    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948708    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948711    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948714    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948717    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948719    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948722    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948724    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:36:37.954860 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948727    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948729    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948733    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948735    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948738    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948740    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:37.948743    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.948748    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.948866    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.953416    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.954396    2563 server.go:1019] "Starting client certificate rotation"
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.954490    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 10:36:37.955345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.954522    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 10:36:37.957206 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.957190    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 10:36:37.958526 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.958506    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 10:36:37.971072 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.971048    2563 log.go:25] "Validated CRI v1 runtime API"
Sep 19 10:36:37.973082 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.973065    2563 log.go:25] "Validated CRI v1 image API"
Sep 19 10:36:37.973950 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.973933    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 19 10:36:37.976274 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.976248    2563 fs.go:135] Filesystem UUIDs: map[710a91dc-9de7-40c1-8b76-c17cbb4a9fec:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7e29e580-a46e-40a9-b543-6d9a3b610132:/dev/nvme0n1p3]
Sep 19 10:36:37.976350 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.976273    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 19 10:36:37.980613 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.980483    2563 manager.go:216] Machine: {Timestamp:2026-09-19 10:36:37.980002997 +0000 UTC m=+1.913709223 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100143 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ff800a8b164e9279d9a99274b07e6 SystemUUID:ec2ff800-a8b1-64e9-279d-9a99274b07e6 BootID:c2fa989d-f10a-4c0e-814c-e4e5ecd39f91 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c1:b2:85:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c1:b2:85:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:5e:cf:cb:83:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 19 10:36:37.980613 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.980611    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 19 10:36:37.980728 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.980698    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 19 10:36:37.982635 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.982610    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 19 10:36:37.982781 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.982638    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 19 10:36:37.983977 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.983967    2563 topology_manager.go:138] "Creating topology manager with none policy"
Sep 19 10:36:37.984018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.983980    2563 container_manager_linux.go:309] "Creating device plugin manager"
Sep 19 10:36:37.984018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.983988    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 10:36:37.984018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.983999    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 10:36:37.985499 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.985488    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 19 10:36:37.989529 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.989515    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 10:36:37.989724 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.989713    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 19 10:36:37.989763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.989751    2563 kubelet.go:486] "Attempting to sync node with API server"
Sep 19 10:36:37.989791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.989762    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 19 10:36:37.989791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.989781    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 19 10:36:37.989791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.989791    2563 kubelet.go:398] "Adding apiserver pod source"
Sep 19 10:36:37.989865 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.989800    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 19 10:36:37.990196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.990175    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 10:36:37.990196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.990194    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 10:36:37.997091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.994126    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 19 10:36:37.997268 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.997248    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 10:36:37.999542 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.999523    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 19 10:36:37.999655 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.999578    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 19 10:36:37.999778 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.999762    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 19 10:36:37.999858 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.999785    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 19 10:36:37.999858 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.999794    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 19 10:36:37.999858 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.999802    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 19 10:36:37.999858 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.999813    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 19 10:36:37.999858 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:37.999819    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 19 10:36:38.000397 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.000383    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 19 10:36:38.000397 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.000396    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 19 10:36:38.000524 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.000405    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 19 10:36:38.000524 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.000413    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 19 10:36:38.000524 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.000424    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 19 10:36:38.000524 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.000435    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 19 10:36:38.000524 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.000467    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 19 10:36:38.000524 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.000475    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 19 10:36:38.002770 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.002742    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 19 10:36:38.003129 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.003108    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 19 10:36:38.003190 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.003109    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 19 10:36:38.004439 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.004426    2563 server.go:1268] "Started kubelet"
Sep 19 10:36:38.004504 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.004477    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 19 10:36:38.004957 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.004896    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 19 10:36:38.005032 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.004981    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 19 10:36:38.005301 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.005284    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 19 10:36:38.005357 ip-10-0-138-7 systemd[1]: Started Kubernetes Kubelet.
Sep 19 10:36:38.005873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.005720    2563 server.go:310] "Adding debug handlers to kubelet server"
Sep 19 10:36:38.009786 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.009755    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 19 10:36:38.012579 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.012564    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wdmdh"
Sep 19 10:36:38.012912 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.012885    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 19 10:36:38.012912 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.012896    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 19 10:36:38.013050 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.012967    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.013616 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.013599    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 19 10:36:38.013616 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.013603    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 19 10:36:38.013751 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.013626    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 19 10:36:38.013751 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.013709    2563 factory.go:55] Registering systemd factory
Sep 19 10:36:38.013751 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.013728    2563 factory.go:223] Registration of the systemd container factory successfully
Sep 19 10:36:38.013895 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.013765    2563 reconstruct.go:97] "Volume reconstruction finished"
Sep 19 10:36:38.013895 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.013773    2563 reconciler.go:29] "Reconciler: start to sync state"
Sep 19 10:36:38.013981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.013937    2563 factory.go:153] Registering CRI-O factory
Sep 19 10:36:38.013981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.013952    2563 factory.go:223] Registration of the crio container factory successfully
Sep 19 10:36:38.014071 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.014003    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 19 10:36:38.014071 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.014019    2563 factory.go:103] Registering Raw factory
Sep 19 10:36:38.014071 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.014035    2563 manager.go:1196] Started watching for new ooms in manager
Sep 19 10:36:38.014753 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.014737    2563 manager.go:349] Starting recovery of all containers
Sep 19 10:36:38.019327 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.019299    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wdmdh"
Sep 19 10:36:38.023288 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.023267    2563 manager.go:354] Recovery completed
Sep 19 10:36:38.023391 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.023313    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 19 10:36:38.023448 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.023425    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 19 10:36:38.037937 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.037900    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 19 10:36:38.042775 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.042644    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:36:38.042943 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.042007    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-7.ec2.internal.18d6b287be00b1c4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-7.ec2.internal,UID:ip-10-0-138-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-7.ec2.internal,},FirstTimestamp:2026-09-19 10:36:38.004396484 +0000 UTC m=+1.938102690,LastTimestamp:2026-09-19 10:36:38.004396484 +0000 UTC m=+1.938102690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-7.ec2.internal,}"
Sep 19 10:36:38.044813 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.044793    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:36:38.044915 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.044827    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:36:38.044915 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.044843    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:36:38.045435 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.045418    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 19 10:36:38.045435 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.045432    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 19 10:36:38.045581 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.045451    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 10:36:38.045581 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.045457    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:36:38.046181 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.046152    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:36:38.046256 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.046189    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:36:38.046256 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.046203    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:36:38.047389 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.047370    2563 policy_none.go:49] "None policy: Start"
Sep 19 10:36:38.047389 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.047385    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 19 10:36:38.047456 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.047396    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 19 10:36:38.049316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.049304    2563 policy_none.go:47] "Start"
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.087102    2563 manager.go:337] "Starting Device Plugin manager"
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.087139    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.087152    2563 server.go:87] "Starting device plugin registration server"
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.087424    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.087446    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.087520    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.087611    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.087621    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.088183    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 19 10:36:38.095196 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.088236    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.110207 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.110185    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 19 10:36:38.111442 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.111418    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 19 10:36:38.111538 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.111480    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 19 10:36:38.111615 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.111542    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 19 10:36:38.111615 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.111596    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 19 10:36:38.113394 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.113368    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:36:38.188334 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.188245    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:36:38.189276 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.189254    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:36:38.189402 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.189299    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:36:38.189402 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.189309    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:36:38.189402 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.189333    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.197093 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.197066    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.197093 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.197095    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-7.ec2.internal\": node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.211005 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.210976    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.212012 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.211985    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"]
Sep 19 10:36:38.212073 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.212063    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:36:38.212975 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.212961    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:36:38.213057 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.212988    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:36:38.213057 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.212999    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:36:38.214850 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.214839    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:36:38.214962 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.214948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.215004 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.214990    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:36:38.215609 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.215581    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:36:38.215609 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.215610    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:36:38.215751 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.215620    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:36:38.215751 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.215629    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:36:38.215751 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.215635    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:36:38.215751 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.215643    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:36:38.217533 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.217506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.217619 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.217560    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:36:38.218243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.218231    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:36:38.218307 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.218254    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:36:38.218307 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.218265    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:36:38.237218 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.237189    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-7.ec2.internal\" not found" node="ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.241655 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.241639    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-7.ec2.internal\" not found" node="ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.311385 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.311356    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.314707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.314679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.314767 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.314724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.411899 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.411854    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.415166 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.415147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.415221 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.415176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/638288756fad3699123da181b4a12476-config\") pod \"kube-apiserver-proxy-ip-10-0-138-7.ec2.internal\" (UID: \"638288756fad3699123da181b4a12476\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.415221 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.415194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.415290 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.415237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.415290 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.415248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.512604 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.512499    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.515811 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.515784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/638288756fad3699123da181b4a12476-config\") pod \"kube-apiserver-proxy-ip-10-0-138-7.ec2.internal\" (UID: \"638288756fad3699123da181b4a12476\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.515900 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.515835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/638288756fad3699123da181b4a12476-config\") pod \"kube-apiserver-proxy-ip-10-0-138-7.ec2.internal\" (UID: \"638288756fad3699123da181b4a12476\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.540918 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.540890    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.546188 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.545984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:38.613319 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.613280    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.713762 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.713729    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.814256 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.814188    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.914779 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:38.914737    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:38.954078 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.954047    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 19 10:36:38.954558 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:38.954196    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 10:36:39.015020 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:39.014994    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:39.024290 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.024253    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 10:31:38 +0000 UTC" deadline="2028-03-20 08:03:09.452721695 +0000 UTC"
Sep 19 10:36:39.024290 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.024284    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13149h26m30.428440961s"
Sep 19 10:36:39.115613 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:39.115587    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:39.197867 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:39.197831    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b445265b170965646453a6817cb35d0.slice/crio-e4ce4f9b84c38ca7e72398576e28c1478a0a75675498a5a2c302e1aa6049a2e2 WatchSource:0}: Error finding container e4ce4f9b84c38ca7e72398576e28c1478a0a75675498a5a2c302e1aa6049a2e2: Status 404 returned error can't find the container with id e4ce4f9b84c38ca7e72398576e28c1478a0a75675498a5a2c302e1aa6049a2e2
Sep 19 10:36:39.198310 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:39.198277    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638288756fad3699123da181b4a12476.slice/crio-f6fa4e84400ebaf21a8ad092d65ebf0b87dc04963af8da79c691bb11ac72147d WatchSource:0}: Error finding container f6fa4e84400ebaf21a8ad092d65ebf0b87dc04963af8da79c691bb11ac72147d: Status 404 returned error can't find the container with id f6fa4e84400ebaf21a8ad092d65ebf0b87dc04963af8da79c691bb11ac72147d
Sep 19 10:36:39.205256 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.205234    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 10:36:39.215704 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:39.215677    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 19 10:36:39.231477 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.231444    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:36:39.286036 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.286010    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:36:39.313954 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.313927    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:39.323944 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.323917    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 10:36:39.325005 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.324991    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 19 10:36:39.330185 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.330165    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 10:36:39.533489 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.533403    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:36:39.990659 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.990619    2563 apiserver.go:52] "Watching apiserver"
Sep 19 10:36:39.997138 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.997108    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 19 10:36:39.998988 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:39.998227    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2","openshift-cluster-node-tuning-operator/tuned-xvbcq","openshift-image-registry/node-ca-wf2sv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal","openshift-multus/multus-additional-cni-plugins-wxzdw","openshift-network-diagnostics/network-check-target-svp4v","openshift-ovn-kubernetes/ovnkube-node-btf2g","kube-system/global-pull-secret-syncer-m94pc","kube-system/konnectivity-agent-76xz7","openshift-dns/node-resolver-4dnbr","openshift-multus/multus-q5v2w","openshift-multus/network-metrics-daemon-8jnsk","openshift-network-operator/iptables-alerter-2bwmh"]
Sep 19 10:36:40.001026 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.000999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:40.001155 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.001092    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:40.003076 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.003051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.005242 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.005217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.005345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.005290    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tpjx7\""
Sep 19 10:36:40.005643 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.005622    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 19 10:36:40.005901 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.005881    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 19 10:36:40.007159 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.007138    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 19 10:36:40.007755 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.007370    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hh5jz\""
Sep 19 10:36:40.007755 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.007396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.007755 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.007479    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 19 10:36:40.009761 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.009672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.009761 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.009703    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 19 10:36:40.009903 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.009794    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 19 10:36:40.009952 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.009901    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-26cw7\""
Sep 19 10:36:40.010007 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.009707    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 19 10:36:40.011956 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.011933    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 19 10:36:40.012108 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.012091    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hbq2z\""
Sep 19 10:36:40.012172 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.012136    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 19 10:36:40.012172 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.012136    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 19 10:36:40.012987 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.012970    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.013361 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.013343    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 19 10:36:40.015468 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.015449    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 19 10:36:40.015583 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.015504    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 19 10:36:40.015583 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.015513    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v4cp9\""
Sep 19 10:36:40.015583 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.015530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 19 10:36:40.015796 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.015778    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 19 10:36:40.016193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.016176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.016275 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.016252    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:40.016394 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.016363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 19 10:36:40.018959 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.018939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:40.019060 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.019019    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:40.021806 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.021382    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-systemd\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m6w4\" (UniqueName: \"kubernetes.io/projected/668a08e1-686c-4da9-bf5a-1c3f6ca85595-kube-api-access-9m6w4\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7faa045-b0f1-47f4-b351-dae07815e965-host\") pod \"node-ca-wf2sv\" (UID: \"a7faa045-b0f1-47f4-b351-dae07815e965\") " pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f425e60-dd82-465b-a43e-70e197626980-tmp-dir\") pod \"node-resolver-4dnbr\" (UID: \"3f425e60-dd82-465b-a43e-70e197626980\") " pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06a78293-0523-4c11-8886-80b4cce2e7c8-cnibin\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8fr\" (UniqueName: \"kubernetes.io/projected/06a78293-0523-4c11-8886-80b4cce2e7c8-kube-api-access-gb8fr\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-run\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-sys\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d565c680-a0bf-4d9e-a10b-105f6cb621dc-host-slash\") pod \"iptables-alerter-2bwmh\" (UID: \"d565c680-a0bf-4d9e-a10b-105f6cb621dc\") " pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d565c680-a0bf-4d9e-a10b-105f6cb621dc-iptables-alerter-script\") pod \"iptables-alerter-2bwmh\" (UID: \"d565c680-a0bf-4d9e-a10b-105f6cb621dc\") " pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06a78293-0523-4c11-8886-80b4cce2e7c8-system-cni-dir\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.022243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06a78293-0523-4c11-8886-80b4cce2e7c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-sysctl-d\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/668a08e1-686c-4da9-bf5a-1c3f6ca85595-tmp\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7k2h\" (UniqueName: \"kubernetes.io/projected/a7faa045-b0f1-47f4-b351-dae07815e965-kube-api-access-d7k2h\") pod \"node-ca-wf2sv\" (UID: \"a7faa045-b0f1-47f4-b351-dae07815e965\") " pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f425e60-dd82-465b-a43e-70e197626980-hosts-file\") pod \"node-resolver-4dnbr\" (UID: \"3f425e60-dd82-465b-a43e-70e197626980\") " pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rrhv\" (UniqueName: \"kubernetes.io/projected/d565c680-a0bf-4d9e-a10b-105f6cb621dc-kube-api-access-2rrhv\") pod \"iptables-alerter-2bwmh\" (UID: \"d565c680-a0bf-4d9e-a10b-105f6cb621dc\") " pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06a78293-0523-4c11-8886-80b4cce2e7c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06a78293-0523-4c11-8886-80b4cce2e7c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-modprobe-d\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-host\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bf76517-aa49-4690-9df4-907efc1a73bb-dbus\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06a78293-0523-4c11-8886-80b4cce2e7c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-sysconfig\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-kubernetes\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-sysctl-conf\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-lib-modules\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.022888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-tuned\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.023641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7faa045-b0f1-47f4-b351-dae07815e965-serviceca\") pod \"node-ca-wf2sv\" (UID: \"a7faa045-b0f1-47f4-b351-dae07815e965\") " pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.023641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.023641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:40.023641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-var-lib-kubelet\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.023641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bf76517-aa49-4690-9df4-907efc1a73bb-kubelet-config\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.023641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.022985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqh6p\" (UniqueName: \"kubernetes.io/projected/3f425e60-dd82-465b-a43e-70e197626980-kube-api-access-hqh6p\") pod \"node-resolver-4dnbr\" (UID: \"3f425e60-dd82-465b-a43e-70e197626980\") " pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.023641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.023310    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 19 10:36:40.023973 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.023682    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 19 10:36:40.024030 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.023987    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 19 10:36:40.024281 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.024249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:36:40.024381 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.024251    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f6vfh\""
Sep 19 10:36:40.025644 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.025623    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 10:36:40.026570 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.026465    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 19 10:36:40.026570 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.026493    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qm8ss\""
Sep 19 10:36:40.026570 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.026532    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 19 10:36:40.026913 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.026872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.029055 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.029030    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 19 10:36:40.029055 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.029051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.029217 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.029153    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ln4ff\""
Sep 19 10:36:40.029217 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.029185    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 19 10:36:40.029319 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.029298    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 19 10:36:40.029369 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.029319    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 19 10:36:40.029762 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.029742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 19 10:36:40.030469 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.030452    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 19 10:36:40.031448 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.031414    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 19 10:36:40.031714 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.031695    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lfszl\""
Sep 19 10:36:40.044105 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.044067    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j2c7w"
Sep 19 10:36:40.048866 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.048841    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j2c7w"
Sep 19 10:36:40.114846 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.114819    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 19 10:36:40.116493 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.116445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal" event={"ID":"8b445265b170965646453a6817cb35d0","Type":"ContainerStarted","Data":"e4ce4f9b84c38ca7e72398576e28c1478a0a75675498a5a2c302e1aa6049a2e2"}
Sep 19 10:36:40.117511 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.117490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal" event={"ID":"638288756fad3699123da181b4a12476","Type":"ContainerStarted","Data":"f6fa4e84400ebaf21a8ad092d65ebf0b87dc04963af8da79c691bb11ac72147d"}
Sep 19 10:36:40.123768 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.123742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-log-socket\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.123875 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.123784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f425e60-dd82-465b-a43e-70e197626980-hosts-file\") pod \"node-resolver-4dnbr\" (UID: \"3f425e60-dd82-465b-a43e-70e197626980\") " pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.123875 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.123811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rrhv\" (UniqueName: \"kubernetes.io/projected/d565c680-a0bf-4d9e-a10b-105f6cb621dc-kube-api-access-2rrhv\") pod \"iptables-alerter-2bwmh\" (UID: \"d565c680-a0bf-4d9e-a10b-105f6cb621dc\") " pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.123875 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.123855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06a78293-0523-4c11-8886-80b4cce2e7c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.124015 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.123886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bf76517-aa49-4690-9df4-907efc1a73bb-dbus\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.124015 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.123891    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f425e60-dd82-465b-a43e-70e197626980-hosts-file\") pod \"node-resolver-4dnbr\" (UID: \"3f425e60-dd82-465b-a43e-70e197626980\") " pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.124015 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.123908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-device-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.124015 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.123975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27jhm\" (UniqueName: \"kubernetes.io/projected/aca7d975-9133-44cd-90c8-065f6e4c0d68-kube-api-access-27jhm\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.124015 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-var-lib-openvswitch\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-kubernetes\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-tuned\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124050    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bf76517-aa49-4690-9df4-907efc1a73bb-dbus\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-conf-dir\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-run-openvswitch\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-kubernetes\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-var-lib-kubelet\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-registration-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.124250 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.124244    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-var-lib-kubelet\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzs4s\" (UniqueName: \"kubernetes.io/projected/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-kube-api-access-vzs4s\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.124316    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret podName:1bf76517-aa49-4690-9df4-907efc1a73bb nodeName:}" failed. No retries permitted until 2026-09-19 10:36:40.624294365 +0000 UTC m=+4.558000557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret") pod "global-pull-secret-syncer-m94pc" (UID: "1bf76517-aa49-4690-9df4-907efc1a73bb") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-run-netns\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-var-lib-kubelet\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-etc-kubernetes\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124376    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-kubelet\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7faa045-b0f1-47f4-b351-dae07815e965-host\") pod \"node-ca-wf2sv\" (UID: \"a7faa045-b0f1-47f4-b351-dae07815e965\") " pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-run-netns\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-node-log\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7faa045-b0f1-47f4-b351-dae07815e965-host\") pod \"node-ca-wf2sv\" (UID: \"a7faa045-b0f1-47f4-b351-dae07815e965\") " pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f425e60-dd82-465b-a43e-70e197626980-tmp-dir\") pod \"node-resolver-4dnbr\" (UID: \"3f425e60-dd82-465b-a43e-70e197626980\") " pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-run\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06a78293-0523-4c11-8886-80b4cce2e7c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124582    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-socket-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.124743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-system-cni-dir\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db86s\" (UniqueName: \"kubernetes.io/projected/2924b046-7224-4ebb-bbf5-c36501c96018-kube-api-access-db86s\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-run\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-cnibin\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aca7d975-9133-44cd-90c8-065f6e4c0d68-cni-binary-copy\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfx4m\" (UniqueName: \"kubernetes.io/projected/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-kube-api-access-bfx4m\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06a78293-0523-4c11-8886-80b4cce2e7c8-system-cni-dir\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06a78293-0523-4c11-8886-80b4cce2e7c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f425e60-dd82-465b-a43e-70e197626980-tmp-dir\") pod \"node-resolver-4dnbr\" (UID: \"3f425e60-dd82-465b-a43e-70e197626980\") " pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-run-k8s-cni-cncf-io\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06a78293-0523-4c11-8886-80b4cce2e7c8-system-cni-dir\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-hostroot\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-env-overrides\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.124998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06a78293-0523-4c11-8886-80b4cce2e7c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-modprobe-d\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-host\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.125641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-run-multus-certs\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-systemd-units\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-run-ovn-kubernetes\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06a78293-0523-4c11-8886-80b4cce2e7c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06a78293-0523-4c11-8886-80b4cce2e7c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-sysconfig\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-modprobe-d\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-host\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-sysctl-conf\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-sysconfig\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-lib-modules\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06a78293-0523-4c11-8886-80b4cce2e7c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7faa045-b0f1-47f4-b351-dae07815e965-serviceca\") pod \"node-ca-wf2sv\" (UID: \"a7faa045-b0f1-47f4-b351-dae07815e965\") " pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-sysctl-conf\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bf76517-aa49-4690-9df4-907efc1a73bb-kubelet-config\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-run-ovn\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.126255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-ovnkube-script-lib\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-lib-modules\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86e5db16-04d9-4c47-b9ba-7b57a80fadab-konnectivity-ca\") pod \"konnectivity-agent-76xz7\" (UID: \"86e5db16-04d9-4c47-b9ba-7b57a80fadab\") " pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-run-systemd\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-cni-netd\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bf76517-aa49-4690-9df4-907efc1a73bb-kubelet-config\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqh6p\" (UniqueName: \"kubernetes.io/projected/3f425e60-dd82-465b-a43e-70e197626980-kube-api-access-hqh6p\") pod \"node-resolver-4dnbr\" (UID: \"3f425e60-dd82-465b-a43e-70e197626980\") " pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-systemd\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m6w4\" (UniqueName: \"kubernetes.io/projected/668a08e1-686c-4da9-bf5a-1c3f6ca85595-kube-api-access-9m6w4\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-systemd\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06a78293-0523-4c11-8886-80b4cce2e7c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-ovnkube-config\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06a78293-0523-4c11-8886-80b4cce2e7c8-cnibin\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125791    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7faa045-b0f1-47f4-b351-dae07815e965-serviceca\") pod \"node-ca-wf2sv\" (UID: \"a7faa045-b0f1-47f4-b351-dae07815e965\") " pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06a78293-0523-4c11-8886-80b4cce2e7c8-cnibin\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.126989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8fr\" (UniqueName: \"kubernetes.io/projected/06a78293-0523-4c11-8886-80b4cce2e7c8-kube-api-access-gb8fr\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-sys\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-sys-fs\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-sys\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-daemon-config\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.125982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-etc-openvswitch\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-ovn-node-metrics-cert\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-var-lib-cni-bin\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d565c680-a0bf-4d9e-a10b-105f6cb621dc-host-slash\") pod \"iptables-alerter-2bwmh\" (UID: \"d565c680-a0bf-4d9e-a10b-105f6cb621dc\") " pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86e5db16-04d9-4c47-b9ba-7b57a80fadab-agent-certs\") pod \"konnectivity-agent-76xz7\" (UID: \"86e5db16-04d9-4c47-b9ba-7b57a80fadab\") " pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-cni-dir\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126124    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d565c680-a0bf-4d9e-a10b-105f6cb621dc-host-slash\") pod \"iptables-alerter-2bwmh\" (UID: \"d565c680-a0bf-4d9e-a10b-105f6cb621dc\") " pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-socket-dir-parent\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-var-lib-cni-multus\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-slash\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-cni-bin\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d565c680-a0bf-4d9e-a10b-105f6cb621dc-iptables-alerter-script\") pod \"iptables-alerter-2bwmh\" (UID: \"d565c680-a0bf-4d9e-a10b-105f6cb621dc\") " pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.127682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-sysctl-d\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.128527 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/668a08e1-686c-4da9-bf5a-1c3f6ca85595-tmp\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.128527 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7k2h\" (UniqueName: \"kubernetes.io/projected/a7faa045-b0f1-47f4-b351-dae07815e965-kube-api-access-d7k2h\") pod \"node-ca-wf2sv\" (UID: \"a7faa045-b0f1-47f4-b351-dae07815e965\") " pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.128527 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.126391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-sysctl-d\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.128527 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.127030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d565c680-a0bf-4d9e-a10b-105f6cb621dc-iptables-alerter-script\") pod \"iptables-alerter-2bwmh\" (UID: \"d565c680-a0bf-4d9e-a10b-105f6cb621dc\") " pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.128527 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.127922    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/668a08e1-686c-4da9-bf5a-1c3f6ca85595-etc-tuned\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.128527 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.128442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/668a08e1-686c-4da9-bf5a-1c3f6ca85595-tmp\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.134541 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.134512    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:36:40.134541 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.134535    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:36:40.134720 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.134560    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9hw9d for pod openshift-network-diagnostics/network-check-target-svp4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:40.134720 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.134622    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d podName:2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d nodeName:}" failed. No retries permitted until 2026-09-19 10:36:40.63460703 +0000 UTC m=+4.568313224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9hw9d" (UniqueName: "kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d") pod "network-check-target-svp4v" (UID: "2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:40.137027 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.136963    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rrhv\" (UniqueName: \"kubernetes.io/projected/d565c680-a0bf-4d9e-a10b-105f6cb621dc-kube-api-access-2rrhv\") pod \"iptables-alerter-2bwmh\" (UID: \"d565c680-a0bf-4d9e-a10b-105f6cb621dc\") " pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.138109 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.138084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8fr\" (UniqueName: \"kubernetes.io/projected/06a78293-0523-4c11-8886-80b4cce2e7c8-kube-api-access-gb8fr\") pod \"multus-additional-cni-plugins-wxzdw\" (UID: \"06a78293-0523-4c11-8886-80b4cce2e7c8\") " pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.138420 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.138395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m6w4\" (UniqueName: \"kubernetes.io/projected/668a08e1-686c-4da9-bf5a-1c3f6ca85595-kube-api-access-9m6w4\") pod \"tuned-xvbcq\" (UID: \"668a08e1-686c-4da9-bf5a-1c3f6ca85595\") " pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.138828 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.138804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqh6p\" (UniqueName: \"kubernetes.io/projected/3f425e60-dd82-465b-a43e-70e197626980-kube-api-access-hqh6p\") pod \"node-resolver-4dnbr\" (UID: \"3f425e60-dd82-465b-a43e-70e197626980\") " pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.138893 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.138871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7k2h\" (UniqueName: \"kubernetes.io/projected/a7faa045-b0f1-47f4-b351-dae07815e965-kube-api-access-d7k2h\") pod \"node-ca-wf2sv\" (UID: \"a7faa045-b0f1-47f4-b351-dae07815e965\") " pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.226663 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.226663 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-ovnkube-config\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-sys-fs\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-daemon-config\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-etc-openvswitch\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-ovn-node-metrics-cert\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-var-lib-cni-bin\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86e5db16-04d9-4c47-b9ba-7b57a80fadab-agent-certs\") pod \"konnectivity-agent-76xz7\" (UID: \"86e5db16-04d9-4c47-b9ba-7b57a80fadab\") " pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-cni-dir\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-etc-openvswitch\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-socket-dir-parent\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.226899 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-var-lib-cni-multus\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-slash\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-cni-bin\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-log-socket\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-device-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27jhm\" (UniqueName: \"kubernetes.io/projected/aca7d975-9133-44cd-90c8-065f6e4c0d68-kube-api-access-27jhm\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-var-lib-openvswitch\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-conf-dir\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-run-openvswitch\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-registration-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzs4s\" (UniqueName: \"kubernetes.io/projected/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-kube-api-access-vzs4s\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-run-netns\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-var-lib-kubelet\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-etc-kubernetes\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-kubelet\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-run-netns\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.227455 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-node-log\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-socket-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-system-cni-dir\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db86s\" (UniqueName: \"kubernetes.io/projected/2924b046-7224-4ebb-bbf5-c36501c96018-kube-api-access-db86s\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-cnibin\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aca7d975-9133-44cd-90c8-065f6e4c0d68-cni-binary-copy\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfx4m\" (UniqueName: \"kubernetes.io/projected/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-kube-api-access-bfx4m\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-ovnkube-config\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-run-k8s-cni-cncf-io\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-hostroot\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-env-overrides\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-sys-fs\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-run-multus-certs\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-systemd-units\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-cni-dir\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-run-ovn-kubernetes\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-run-ovn\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-socket-dir-parent\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-ovnkube-script-lib\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227681    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-socket-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86e5db16-04d9-4c47-b9ba-7b57a80fadab-konnectivity-ca\") pod \"konnectivity-agent-76xz7\" (UID: \"86e5db16-04d9-4c47-b9ba-7b57a80fadab\") " pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-registration-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-run-systemd\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-cni-netd\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.227866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-cni-netd\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86e5db16-04d9-4c47-b9ba-7b57a80fadab-konnectivity-ca\") pod \"konnectivity-agent-76xz7\" (UID: \"86e5db16-04d9-4c47-b9ba-7b57a80fadab\") " pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-system-cni-dir\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-daemon-config\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.228180    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-run-netns\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-var-lib-kubelet\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.228662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-etc-kubernetes\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.228229    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs podName:2924b046-7224-4ebb-bbf5-c36501c96018 nodeName:}" failed. No retries permitted until 2026-09-19 10:36:40.728217239 +0000 UTC m=+4.661923431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs") pod "network-metrics-daemon-8jnsk" (UID: "2924b046-7224-4ebb-bbf5-c36501c96018") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228238    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-var-lib-cni-multus\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-run-netns\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228315    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-node-log\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-run-systemd\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-run-multus-certs\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-cnibin\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-device-dir\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-env-overrides\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-slash\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.226913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-var-lib-cni-bin\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-cni-bin\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-systemd-units\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-log-socket\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-var-lib-openvswitch\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-run-openvswitch\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.229567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.228928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-multus-conf-dir\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.230438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.229002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-host-run-k8s-cni-cncf-io\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.230438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.229044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-run-ovn\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.230438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.229063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aca7d975-9133-44cd-90c8-065f6e4c0d68-hostroot\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.230438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.229068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aca7d975-9133-44cd-90c8-065f6e4c0d68-cni-binary-copy\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.230438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.229088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-run-ovn-kubernetes\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.230438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.229114    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-host-kubelet\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.230438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.229297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-ovnkube-script-lib\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.230438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.229403    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86e5db16-04d9-4c47-b9ba-7b57a80fadab-agent-certs\") pod \"konnectivity-agent-76xz7\" (UID: \"86e5db16-04d9-4c47-b9ba-7b57a80fadab\") " pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:36:40.230824 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.230778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-ovn-node-metrics-cert\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.236671 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.236643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzs4s\" (UniqueName: \"kubernetes.io/projected/6e32f99a-4f55-4694-9ec3-792bd9bc9b19-kube-api-access-vzs4s\") pod \"aws-ebs-csi-driver-node-vhkn2\" (UID: \"6e32f99a-4f55-4694-9ec3-792bd9bc9b19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.236928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.236905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db86s\" (UniqueName: \"kubernetes.io/projected/2924b046-7224-4ebb-bbf5-c36501c96018-kube-api-access-db86s\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:40.237281 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.237262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfx4m\" (UniqueName: \"kubernetes.io/projected/ec0f034d-6f0b-41cb-bf7d-27ba74fcb047-kube-api-access-bfx4m\") pod \"ovnkube-node-btf2g\" (UID: \"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047\") " pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.237366 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.237347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27jhm\" (UniqueName: \"kubernetes.io/projected/aca7d975-9133-44cd-90c8-065f6e4c0d68-kube-api-access-27jhm\") pod \"multus-q5v2w\" (UID: \"aca7d975-9133-44cd-90c8-065f6e4c0d68\") " pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.272251 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.272220    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:36:40.316323 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.316227    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4dnbr"
Sep 19 10:36:40.324984 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.324965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xvbcq"
Sep 19 10:36:40.336728 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.336700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wf2sv"
Sep 19 10:36:40.342469 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.342444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2bwmh"
Sep 19 10:36:40.353311 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.353290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wxzdw"
Sep 19 10:36:40.362047 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.362025    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2"
Sep 19 10:36:40.368860 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.368839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:36:40.377669 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.377648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:36:40.383859 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.383837    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q5v2w"
Sep 19 10:36:40.631205 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.631165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:40.631395 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.631340    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:40.631460 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.631422    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret podName:1bf76517-aa49-4690-9df4-907efc1a73bb nodeName:}" failed. No retries permitted until 2026-09-19 10:36:41.631401534 +0000 UTC m=+5.565107941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret") pod "global-pull-secret-syncer-m94pc" (UID: "1bf76517-aa49-4690-9df4-907efc1a73bb") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:40.731850 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.731813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:40.732045 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:40.731875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:40.732045 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.731964    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:40.732045 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.731980    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:36:40.732045 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.731999    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:36:40.732045 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.732009    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9hw9d for pod openshift-network-diagnostics/network-check-target-svp4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:40.732045 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.732019    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs podName:2924b046-7224-4ebb-bbf5-c36501c96018 nodeName:}" failed. No retries permitted until 2026-09-19 10:36:41.732005587 +0000 UTC m=+5.665711778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs") pod "network-metrics-daemon-8jnsk" (UID: "2924b046-7224-4ebb-bbf5-c36501c96018") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:40.732353 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:40.732053    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d podName:2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d nodeName:}" failed. No retries permitted until 2026-09-19 10:36:41.732038701 +0000 UTC m=+5.665744906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hw9d" (UniqueName: "kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d") pod "network-check-target-svp4v" (UID: "2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:41.052611 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:41.052530    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 10:31:40 +0000 UTC" deadline="2028-04-26 11:17:40.631638754 +0000 UTC"
Sep 19 10:36:41.052611 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:41.052571    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14040h40m59.579070255s"
Sep 19 10:36:41.111995 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:41.111973    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:41.112224 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:41.112096    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:41.117727 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:41.117700    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e5db16_04d9_4c47_b9ba_7b57a80fadab.slice/crio-4684e791dd4abe2fd401bfb148994168836a9f4321a3c7eae4f2d534b5891a43 WatchSource:0}: Error finding container 4684e791dd4abe2fd401bfb148994168836a9f4321a3c7eae4f2d534b5891a43: Status 404 returned error can't find the container with id 4684e791dd4abe2fd401bfb148994168836a9f4321a3c7eae4f2d534b5891a43
Sep 19 10:36:41.119005 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:41.118978    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7faa045_b0f1_47f4_b351_dae07815e965.slice/crio-5ae9042766e3ce3957da96abcd58f9fbd33a0b4ad9c3f309c999e5ec7a4075e2 WatchSource:0}: Error finding container 5ae9042766e3ce3957da96abcd58f9fbd33a0b4ad9c3f309c999e5ec7a4075e2: Status 404 returned error can't find the container with id 5ae9042766e3ce3957da96abcd58f9fbd33a0b4ad9c3f309c999e5ec7a4075e2
Sep 19 10:36:41.123722 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:41.123697    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a78293_0523_4c11_8886_80b4cce2e7c8.slice/crio-2ae144e9ea662c07b0e31f14a66c0dcfe69cc3b83a11439a73b2315435bb09bb WatchSource:0}: Error finding container 2ae144e9ea662c07b0e31f14a66c0dcfe69cc3b83a11439a73b2315435bb09bb: Status 404 returned error can't find the container with id 2ae144e9ea662c07b0e31f14a66c0dcfe69cc3b83a11439a73b2315435bb09bb
Sep 19 10:36:41.126171 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:41.126138    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd565c680_a0bf_4d9e_a10b_105f6cb621dc.slice/crio-e2cafbaa22a217b0a8995fbbe0bbe9c2eb2ff77607db0ac71da5579309e645cc WatchSource:0}: Error finding container e2cafbaa22a217b0a8995fbbe0bbe9c2eb2ff77607db0ac71da5579309e645cc: Status 404 returned error can't find the container with id e2cafbaa22a217b0a8995fbbe0bbe9c2eb2ff77607db0ac71da5579309e645cc
Sep 19 10:36:41.126591 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:41.126567    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca7d975_9133_44cd_90c8_065f6e4c0d68.slice/crio-36126d5e05420f05a728828bf228ea514a51c899f22e39f73e5fd53b4776f9b8 WatchSource:0}: Error finding container 36126d5e05420f05a728828bf228ea514a51c899f22e39f73e5fd53b4776f9b8: Status 404 returned error can't find the container with id 36126d5e05420f05a728828bf228ea514a51c899f22e39f73e5fd53b4776f9b8
Sep 19 10:36:41.128713 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:41.128643    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f425e60_dd82_465b_a43e_70e197626980.slice/crio-19a7789a86ccf641849598a1570f0925e354e6042d189fb6cd197d18b5ddd191 WatchSource:0}: Error finding container 19a7789a86ccf641849598a1570f0925e354e6042d189fb6cd197d18b5ddd191: Status 404 returned error can't find the container with id 19a7789a86ccf641849598a1570f0925e354e6042d189fb6cd197d18b5ddd191
Sep 19 10:36:41.128999 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:41.128903    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668a08e1_686c_4da9_bf5a_1c3f6ca85595.slice/crio-c3d4dc8d7ca44f14e2fa367cfdf2f65ee89d38d52c895fd0ddd49b0ad9f91483 WatchSource:0}: Error finding container c3d4dc8d7ca44f14e2fa367cfdf2f65ee89d38d52c895fd0ddd49b0ad9f91483: Status 404 returned error can't find the container with id c3d4dc8d7ca44f14e2fa367cfdf2f65ee89d38d52c895fd0ddd49b0ad9f91483
Sep 19 10:36:41.131199 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:41.130958    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e32f99a_4f55_4694_9ec3_792bd9bc9b19.slice/crio-6478df9da77c0d232c3e9c8f3c6693ccd793fc23d16ba2e7b0802ced46582bc2 WatchSource:0}: Error finding container 6478df9da77c0d232c3e9c8f3c6693ccd793fc23d16ba2e7b0802ced46582bc2: Status 404 returned error can't find the container with id 6478df9da77c0d232c3e9c8f3c6693ccd793fc23d16ba2e7b0802ced46582bc2
Sep 19 10:36:41.133681 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:36:41.133626    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0f034d_6f0b_41cb_bf7d_27ba74fcb047.slice/crio-241bd7e31cc0bf8450b97cf33b0b4a63b840d03fad7ec10f0492e709f38b9f3c WatchSource:0}: Error finding container 241bd7e31cc0bf8450b97cf33b0b4a63b840d03fad7ec10f0492e709f38b9f3c: Status 404 returned error can't find the container with id 241bd7e31cc0bf8450b97cf33b0b4a63b840d03fad7ec10f0492e709f38b9f3c
Sep 19 10:36:41.638373 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:41.637975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:41.638373 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:41.638232    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:41.638373 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:41.638309    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret podName:1bf76517-aa49-4690-9df4-907efc1a73bb nodeName:}" failed. No retries permitted until 2026-09-19 10:36:43.638288985 +0000 UTC m=+7.571995182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret") pod "global-pull-secret-syncer-m94pc" (UID: "1bf76517-aa49-4690-9df4-907efc1a73bb") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:41.738851 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:41.738807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:41.739036 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:41.738873    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:41.739098 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:41.739039    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:36:41.739098 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:41.739060    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:36:41.739098 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:41.739075    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9hw9d for pod openshift-network-diagnostics/network-check-target-svp4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:41.739245 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:41.739132    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d podName:2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d nodeName:}" failed. No retries permitted until 2026-09-19 10:36:43.739114779 +0000 UTC m=+7.672820974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hw9d" (UniqueName: "kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d") pod "network-check-target-svp4v" (UID: "2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:41.739564 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:41.739530    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:41.739652 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:41.739598    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs podName:2924b046-7224-4ebb-bbf5-c36501c96018 nodeName:}" failed. No retries permitted until 2026-09-19 10:36:43.739580573 +0000 UTC m=+7.673286772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs") pod "network-metrics-daemon-8jnsk" (UID: "2924b046-7224-4ebb-bbf5-c36501c96018") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:42.053794 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.053704    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 10:31:40 +0000 UTC" deadline="2028-05-22 08:57:33.18144846 +0000 UTC"
Sep 19 10:36:42.053794 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.053746    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14662h20m51.127707169s"
Sep 19 10:36:42.115047 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.112789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:42.115047 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:42.112934    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:42.115047 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.113328    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:42.115047 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:42.113434    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:42.140168 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.140132    2563 generic.go:356] "Generic (PLEG): container finished" podID="8b445265b170965646453a6817cb35d0" containerID="5d6a222eb0333cb6dc410e3f3fed757b93f161cb5848cc5d67d462251722d4dc" exitCode=0
Sep 19 10:36:42.140350 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.140217    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal" event={"ID":"8b445265b170965646453a6817cb35d0","Type":"ContainerDied","Data":"5d6a222eb0333cb6dc410e3f3fed757b93f161cb5848cc5d67d462251722d4dc"}
Sep 19 10:36:42.150644 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.150116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal" event={"ID":"638288756fad3699123da181b4a12476","Type":"ContainerStarted","Data":"5a6db3bf6ff5f23d2f0276217b39d131b7906b634c746b278dcb34fdbcc3e67c"}
Sep 19 10:36:42.160838 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.160802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2" event={"ID":"6e32f99a-4f55-4694-9ec3-792bd9bc9b19","Type":"ContainerStarted","Data":"6478df9da77c0d232c3e9c8f3c6693ccd793fc23d16ba2e7b0802ced46582bc2"}
Sep 19 10:36:42.164204 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.164170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xvbcq" event={"ID":"668a08e1-686c-4da9-bf5a-1c3f6ca85595","Type":"ContainerStarted","Data":"c3d4dc8d7ca44f14e2fa367cfdf2f65ee89d38d52c895fd0ddd49b0ad9f91483"}
Sep 19 10:36:42.169893 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.169835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2bwmh" event={"ID":"d565c680-a0bf-4d9e-a10b-105f6cb621dc","Type":"ContainerStarted","Data":"e2cafbaa22a217b0a8995fbbe0bbe9c2eb2ff77607db0ac71da5579309e645cc"}
Sep 19 10:36:42.189264 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.189223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerStarted","Data":"241bd7e31cc0bf8450b97cf33b0b4a63b840d03fad7ec10f0492e709f38b9f3c"}
Sep 19 10:36:42.204460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.204425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4dnbr" event={"ID":"3f425e60-dd82-465b-a43e-70e197626980","Type":"ContainerStarted","Data":"19a7789a86ccf641849598a1570f0925e354e6042d189fb6cd197d18b5ddd191"}
Sep 19 10:36:42.209867 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.209832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q5v2w" event={"ID":"aca7d975-9133-44cd-90c8-065f6e4c0d68","Type":"ContainerStarted","Data":"36126d5e05420f05a728828bf228ea514a51c899f22e39f73e5fd53b4776f9b8"}
Sep 19 10:36:42.232504 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.232403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxzdw" event={"ID":"06a78293-0523-4c11-8886-80b4cce2e7c8","Type":"ContainerStarted","Data":"2ae144e9ea662c07b0e31f14a66c0dcfe69cc3b83a11439a73b2315435bb09bb"}
Sep 19 10:36:42.255471 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.255434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wf2sv" event={"ID":"a7faa045-b0f1-47f4-b351-dae07815e965","Type":"ContainerStarted","Data":"5ae9042766e3ce3957da96abcd58f9fbd33a0b4ad9c3f309c999e5ec7a4075e2"}
Sep 19 10:36:42.288187 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:42.288139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-76xz7" event={"ID":"86e5db16-04d9-4c47-b9ba-7b57a80fadab","Type":"ContainerStarted","Data":"4684e791dd4abe2fd401bfb148994168836a9f4321a3c7eae4f2d534b5891a43"}
Sep 19 10:36:43.111787 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:43.111754    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:43.112281 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:43.111883    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:43.302207 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:43.302139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal" event={"ID":"8b445265b170965646453a6817cb35d0","Type":"ContainerStarted","Data":"832e2ae83877cc0e5c4257b1a15a4afae75f7139094199661b76b849302b7c34"}
Sep 19 10:36:43.316419 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:43.315878    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal" podStartSLOduration=4.315855811 podStartE2EDuration="4.315855811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:36:42.172705876 +0000 UTC m=+6.106412112" watchObservedRunningTime="2026-09-19 10:36:43.315855811 +0000 UTC m=+7.249562030"
Sep 19 10:36:43.316419 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:43.316185    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal" podStartSLOduration=4.31617929 podStartE2EDuration="4.31617929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:36:43.31491241 +0000 UTC m=+7.248618628" watchObservedRunningTime="2026-09-19 10:36:43.31617929 +0000 UTC m=+7.249885506"
Sep 19 10:36:43.655214 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:43.655175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:43.655422 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:43.655405    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:43.655493 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:43.655480    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret podName:1bf76517-aa49-4690-9df4-907efc1a73bb nodeName:}" failed. No retries permitted until 2026-09-19 10:36:47.655460151 +0000 UTC m=+11.589166366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret") pod "global-pull-secret-syncer-m94pc" (UID: "1bf76517-aa49-4690-9df4-907efc1a73bb") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:43.755895 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:43.755851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:43.756070 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:43.755920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:43.756122 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:43.756091    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:36:43.756122 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:43.756114    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:36:43.756235 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:43.756127    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9hw9d for pod openshift-network-diagnostics/network-check-target-svp4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:43.756235 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:43.756191    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d podName:2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d nodeName:}" failed. No retries permitted until 2026-09-19 10:36:47.756171284 +0000 UTC m=+11.689877476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hw9d" (UniqueName: "kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d") pod "network-check-target-svp4v" (UID: "2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:43.756637 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:43.756619    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:43.756740 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:43.756677    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs podName:2924b046-7224-4ebb-bbf5-c36501c96018 nodeName:}" failed. No retries permitted until 2026-09-19 10:36:47.756660124 +0000 UTC m=+11.690366336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs") pod "network-metrics-daemon-8jnsk" (UID: "2924b046-7224-4ebb-bbf5-c36501c96018") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:44.113750 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:44.113689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:44.114218 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:44.113825    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:44.114218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:44.113689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:44.114218 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:44.113960    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:45.112211 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:45.112169    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:45.112377 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:45.112320    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:46.112650 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:46.112614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:46.113168 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:46.112763    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:46.113168 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:46.112948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:46.113168 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:46.113084    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:47.112308 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:47.111787    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:47.112308 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:47.111918    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:47.689901 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:47.689817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:47.690365 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:47.689983    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:47.690365 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:47.690059    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret podName:1bf76517-aa49-4690-9df4-907efc1a73bb nodeName:}" failed. No retries permitted until 2026-09-19 10:36:55.690039434 +0000 UTC m=+19.623745633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret") pod "global-pull-secret-syncer-m94pc" (UID: "1bf76517-aa49-4690-9df4-907efc1a73bb") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:47.790378 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:47.790342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:47.790570 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:47.790396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:47.790570 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:47.790529    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:36:47.790716 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:47.790632    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:47.791117 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:47.790761    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs podName:2924b046-7224-4ebb-bbf5-c36501c96018 nodeName:}" failed. No retries permitted until 2026-09-19 10:36:55.790741112 +0000 UTC m=+19.724447323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs") pod "network-metrics-daemon-8jnsk" (UID: "2924b046-7224-4ebb-bbf5-c36501c96018") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:47.791255 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:47.791237    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:36:47.791332 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:47.791264    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9hw9d for pod openshift-network-diagnostics/network-check-target-svp4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:47.791332 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:47.791329    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d podName:2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d nodeName:}" failed. No retries permitted until 2026-09-19 10:36:55.791313603 +0000 UTC m=+19.725019814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hw9d" (UniqueName: "kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d") pod "network-check-target-svp4v" (UID: "2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:48.113709 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:48.113244    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:48.113709 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:48.113354    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:48.113709 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:48.113538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:48.113709 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:48.113669    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:49.112212 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:49.111733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:49.112212 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:49.111864    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:50.111775 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:50.111734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:50.111970 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:50.111868    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:50.111970 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:50.111919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:50.112080 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:50.112017    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:51.111963 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:51.111931    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:51.112310 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:51.112090    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:52.111833 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:52.111787    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:52.112016 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:52.111787    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:52.112016 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:52.111917    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:52.112365 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:52.112014    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:53.112145 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:53.112113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:53.112642 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:53.112250    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:54.112628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:54.112593    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:54.112628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:54.112624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:54.113157 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:54.112740    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:54.113157 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:54.112881    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:55.112329 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:55.112293    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:55.112663 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:55.112468    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:55.747528 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:55.747489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:55.747742 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:55.747639    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:55.747742 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:55.747702    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret podName:1bf76517-aa49-4690-9df4-907efc1a73bb nodeName:}" failed. No retries permitted until 2026-09-19 10:37:11.74768254 +0000 UTC m=+35.681388747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret") pod "global-pull-secret-syncer-m94pc" (UID: "1bf76517-aa49-4690-9df4-907efc1a73bb") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:36:55.848787 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:55.848743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:55.848995 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:55.848807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:55.848995 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:55.848924    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:55.848995 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:55.848986    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:36:55.849125 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:55.849007    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:36:55.849125 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:55.849020    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9hw9d for pod openshift-network-diagnostics/network-check-target-svp4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:55.849125 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:55.849008    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs podName:2924b046-7224-4ebb-bbf5-c36501c96018 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:11.848989146 +0000 UTC m=+35.782695360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs") pod "network-metrics-daemon-8jnsk" (UID: "2924b046-7224-4ebb-bbf5-c36501c96018") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:36:55.849125 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:55.849093    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d podName:2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d nodeName:}" failed. No retries permitted until 2026-09-19 10:37:11.849072661 +0000 UTC m=+35.782778864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hw9d" (UniqueName: "kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d") pod "network-check-target-svp4v" (UID: "2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:36:56.112512 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:56.112471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:56.112712 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:56.112623    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:56.113095 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:56.112472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:56.113095 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:56.113072    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:57.112770 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:57.112732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:57.113203 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:57.112881    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:58.112789 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:58.112753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:36:58.113258 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:58.112849    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:36:58.113258 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:58.112899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:36:58.113258 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:58.112961    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:36:59.112910 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.112645    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:36:59.113408 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:36:59.113025    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:36:59.335226 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.334985    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q5v2w" event={"ID":"aca7d975-9133-44cd-90c8-065f6e4c0d68","Type":"ContainerStarted","Data":"3fa94e662e2aa9c680d2ed770cd35db8914555ea5339c3e795e119eb15e8d931"}
Sep 19 10:36:59.336753 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.336722    2563 generic.go:356] "Generic (PLEG): container finished" podID="06a78293-0523-4c11-8886-80b4cce2e7c8" containerID="7f5dd51afad862f0fb8460fef476542d3fe239ff9dd0c1340e93d7fb14e00203" exitCode=0
Sep 19 10:36:59.336860 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.336800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxzdw" event={"ID":"06a78293-0523-4c11-8886-80b4cce2e7c8","Type":"ContainerDied","Data":"7f5dd51afad862f0fb8460fef476542d3fe239ff9dd0c1340e93d7fb14e00203"}
Sep 19 10:36:59.338481 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.338452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wf2sv" event={"ID":"a7faa045-b0f1-47f4-b351-dae07815e965","Type":"ContainerStarted","Data":"c01522ffbad04c61f5b01a9a75c7d3aec6ba9dde30d03cab7813b79e96206f50"}
Sep 19 10:36:59.339967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.339944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-76xz7" event={"ID":"86e5db16-04d9-4c47-b9ba-7b57a80fadab","Type":"ContainerStarted","Data":"d3c7bffa02e7187545b7ea36fa6a3d6baebbdd44ecaf92a7314e8fa60cc29e62"}
Sep 19 10:36:59.341673 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.341649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2" event={"ID":"6e32f99a-4f55-4694-9ec3-792bd9bc9b19","Type":"ContainerStarted","Data":"49618ba86b24f63578d1baee0251d3d7d6ac9751c2598e31cdef07f75f504f30"}
Sep 19 10:36:59.343251 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.343225    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xvbcq" event={"ID":"668a08e1-686c-4da9-bf5a-1c3f6ca85595","Type":"ContainerStarted","Data":"01bf3e1737aa3c1806301ac5f71d43208715e20dcfd3f6f582c8df73e634796c"}
Sep 19 10:36:59.348511 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.348490    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:36:59.348965 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.348931    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec0f034d-6f0b-41cb-bf7d-27ba74fcb047" containerID="c6af55a5e704e2d83dfd18310295b95ebece64db71d48c2c9648b29da4e1302d" exitCode=1
Sep 19 10:36:59.349066 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.349004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerStarted","Data":"02b0f5fd9e995713932073fae53c7a8b243d9ee2afb3f692fad1d100ef1539ad"}
Sep 19 10:36:59.349137 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.349087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerStarted","Data":"1ca674df7ab499d0b435c75704a318413bb1916824aa32fe186f42290d893074"}
Sep 19 10:36:59.349202 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.349140    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerStarted","Data":"d5ba49e7bfbef739d30d5865571e0711d8a11f108fcf89ec258679a21f7d38ad"}
Sep 19 10:36:59.349202 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.349189    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerDied","Data":"c6af55a5e704e2d83dfd18310295b95ebece64db71d48c2c9648b29da4e1302d"}
Sep 19 10:36:59.349296 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.349239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerStarted","Data":"8a98c0a8864b94953ba4ecc69b65fedc2cdb67c343de26f2fd57fb9254b40b1e"}
Sep 19 10:36:59.350629 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.350603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4dnbr" event={"ID":"3f425e60-dd82-465b-a43e-70e197626980","Type":"ContainerStarted","Data":"97eb19f1322eeab5de4e9699473d7ce756057e4168a8b196c7227551b6322db5"}
Sep 19 10:36:59.354866 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.354811    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q5v2w" podStartSLOduration=3.903049321 podStartE2EDuration="21.354790531s" totalImagesPullingTime="17.45174121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:36:59.35396009 +0000 UTC m=+23.287666306" watchObservedRunningTime="2026-09-19 10:36:59.354790531 +0000 UTC m=+23.288496745"
Sep 19 10:36:59.405118 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.404977    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4dnbr" podStartSLOduration=3.979533476 podStartE2EDuration="21.404955696s" totalImagesPullingTime="17.42542222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:36:59.379766045 +0000 UTC m=+23.313472278" watchObservedRunningTime="2026-09-19 10:36:59.404955696 +0000 UTC m=+23.338661909"
Sep 19 10:36:59.419724 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.419669    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wf2sv" podStartSLOduration=11.461607503 podStartE2EDuration="21.419646504s" totalImagesPullingTime="9.958039001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:36:59.404530912 +0000 UTC m=+23.338237148" watchObservedRunningTime="2026-09-19 10:36:59.419646504 +0000 UTC m=+23.353352722"
Sep 19 10:36:59.420244 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.420213    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-76xz7" podStartSLOduration=11.459880407 podStartE2EDuration="21.420203863s" totalImagesPullingTime="9.960323456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:36:59.41934105 +0000 UTC m=+23.353047285" watchObservedRunningTime="2026-09-19 10:36:59.420203863 +0000 UTC m=+23.353910078"
Sep 19 10:36:59.440187 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.437747    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xvbcq" podStartSLOduration=3.9896661 podStartE2EDuration="21.437724739s" totalImagesPullingTime="17.448058639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:36:59.437684755 +0000 UTC m=+23.371390989" watchObservedRunningTime="2026-09-19 10:36:59.437724739 +0000 UTC m=+23.371430957"
Sep 19 10:36:59.950422 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:36:59.950296    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 19 10:37:00.099748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.099642    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T10:36:59.950352081Z","UUID":"984fd324-0b26-4395-ac98-e0d1760575b2","Handler":null,"Name":"","Endpoint":""}
Sep 19 10:37:00.101328 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.101305    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 19 10:37:00.101470 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.101343    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 19 10:37:00.112927 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.112901    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:00.113561 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:00.113034    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:37:00.113561 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.113359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:00.113561 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:00.113442    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:37:00.355559 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.355521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2" event={"ID":"6e32f99a-4f55-4694-9ec3-792bd9bc9b19","Type":"ContainerStarted","Data":"0ced43785a8a732ebf9c23908423e534c41e0cda96c0c1970b575a0737bcf2ca"}
Sep 19 10:37:00.357358 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.357327    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2bwmh" event={"ID":"d565c680-a0bf-4d9e-a10b-105f6cb621dc","Type":"ContainerStarted","Data":"760271bfd8a37bf76ec17302631bf80ae92aec626927de143d8ce9607f02555f"}
Sep 19 10:37:00.360709 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.360685    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:37:00.361165 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.361141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerStarted","Data":"6f12463cddcf4b6d2b03e127a5c7a9a7d993b4c6a6b42bd1fdbe236cd57f4a0b"}
Sep 19 10:37:00.369888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:00.369845    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2bwmh" podStartSLOduration=5.106879522 podStartE2EDuration="22.36983138s" totalImagesPullingTime="17.262951858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:00.369726126 +0000 UTC m=+24.303432361" watchObservedRunningTime="2026-09-19 10:37:00.36983138 +0000 UTC m=+24.303537609"
Sep 19 10:37:01.111755 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:01.111727    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:01.111920 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:01.111848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:37:01.365700 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:01.365666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2" event={"ID":"6e32f99a-4f55-4694-9ec3-792bd9bc9b19","Type":"ContainerStarted","Data":"a5c2e2cc39d1c17deddaf237035f2fc7c2076d0d89eec5ec79aed30680b5da9a"}
Sep 19 10:37:01.382721 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:01.382673    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhkn2" podStartSLOduration=4.171223112 podStartE2EDuration="23.382653287s" totalImagesPullingTime="19.211430175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:01.381010359 +0000 UTC m=+25.314716592" watchObservedRunningTime="2026-09-19 10:37:01.382653287 +0000 UTC m=+25.316359568"
Sep 19 10:37:02.112251 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:02.112212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:02.112444 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:02.112212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:02.112444 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:02.112355    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:37:02.112444 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:02.112428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:37:02.371522 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:02.371443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:37:02.372104 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:02.372053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerStarted","Data":"e2e8451f618d270396eeec5489a3219b558a734e04013da09027aa814e4283ff"}
Sep 19 10:37:03.112446 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:03.112411    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:03.112646 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:03.112560    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:37:03.306504 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:03.306471    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:37:03.307118 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:03.307096    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:37:03.374687 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:03.374615    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:37:03.375135 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:03.375113    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-76xz7"
Sep 19 10:37:04.112321 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:04.112135    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:04.112469 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:04.112213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:04.112469 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:04.112404    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:37:04.112606 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:04.112514    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:37:04.380172 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:04.380147    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:37:04.381139 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:04.380618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerStarted","Data":"775a25eadb0dcafd91022fe40d53f40926fbe01e0b6137e737f250dd0948b73f"}
Sep 19 10:37:04.381139 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:04.380899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:37:04.381139 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:04.381134    2563 scope.go:117] "RemoveContainer" containerID="c6af55a5e704e2d83dfd18310295b95ebece64db71d48c2c9648b29da4e1302d"
Sep 19 10:37:04.382755 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:04.382730    2563 generic.go:356] "Generic (PLEG): container finished" podID="06a78293-0523-4c11-8886-80b4cce2e7c8" containerID="b0208c73d12638664fe80b4a4ab6450b887b10655d7cf154c415aa4771a2aa51" exitCode=0
Sep 19 10:37:04.382869 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:04.382813    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxzdw" event={"ID":"06a78293-0523-4c11-8886-80b4cce2e7c8","Type":"ContainerDied","Data":"b0208c73d12638664fe80b4a4ab6450b887b10655d7cf154c415aa4771a2aa51"}
Sep 19 10:37:04.398658 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:04.398632    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:37:05.112114 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.111926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:05.112278 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:05.112206    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:37:05.390296 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.390264    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:37:05.390844 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.390804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" event={"ID":"ec0f034d-6f0b-41cb-bf7d-27ba74fcb047","Type":"ContainerStarted","Data":"384520e6de9cd7084fbad0feb01572983a8eb54dac4823ec049752b8764966a8"}
Sep 19 10:37:05.391110 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.391088    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:37:05.391200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.391172    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:37:05.407368 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.407344    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:37:05.417244 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.417192    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g" podStartSLOduration=9.910075336 podStartE2EDuration="27.417178061s" totalImagesPullingTime="17.507102725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:05.415655761 +0000 UTC m=+29.349361988" watchObservedRunningTime="2026-09-19 10:37:05.417178061 +0000 UTC m=+29.350884323"
Sep 19 10:37:05.577870 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.577840    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svp4v"]
Sep 19 10:37:05.578008 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.577951    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:05.578182 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:05.578059    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:37:05.581196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.581168    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m94pc"]
Sep 19 10:37:05.581335 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.581291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:05.581427 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:05.581391    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:37:05.581754 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.581731    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8jnsk"]
Sep 19 10:37:05.581864 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:05.581830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:05.581943 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:05.581921    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:37:06.396474 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:06.396443    2563 generic.go:356] "Generic (PLEG): container finished" podID="06a78293-0523-4c11-8886-80b4cce2e7c8" containerID="087efbdc52a107bd08d7a1c015fd4f2b35ad2758913566584da28aee79199f96" exitCode=0
Sep 19 10:37:06.396978 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:06.396539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxzdw" event={"ID":"06a78293-0523-4c11-8886-80b4cce2e7c8","Type":"ContainerDied","Data":"087efbdc52a107bd08d7a1c015fd4f2b35ad2758913566584da28aee79199f96"}
Sep 19 10:37:07.111864 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:07.111827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:07.111864 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:07.111865    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:07.112083 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:07.111956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:07.112083 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:07.111954    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:37:07.112161 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:07.112076    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:37:07.112204 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:07.112162    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:37:08.407347 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:08.407172    2563 generic.go:356] "Generic (PLEG): container finished" podID="06a78293-0523-4c11-8886-80b4cce2e7c8" containerID="bc2425cd31a3ea42ca97642fc7d311b1601697072f18133e60c1996491bdfad1" exitCode=0
Sep 19 10:37:08.407686 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:08.407252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxzdw" event={"ID":"06a78293-0523-4c11-8886-80b4cce2e7c8","Type":"ContainerDied","Data":"bc2425cd31a3ea42ca97642fc7d311b1601697072f18133e60c1996491bdfad1"}
Sep 19 10:37:09.112470 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:09.112432    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:09.112470 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:09.112456    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:09.112709 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:09.112459    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:09.112709 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:09.112575    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:37:09.112802 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:09.112717    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:37:09.112867 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:09.112819    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:37:11.112799 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.112763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:11.112799 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.112797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:11.113360 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.112877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:11.113360 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.112901    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svp4v" podUID="2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d"
Sep 19 10:37:11.113360 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.112957    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m94pc" podUID="1bf76517-aa49-4690-9df4-907efc1a73bb"
Sep 19 10:37:11.113360 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.113023    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jnsk" podUID="2924b046-7224-4ebb-bbf5-c36501c96018"
Sep 19 10:37:11.379666 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.379592    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeReady"
Sep 19 10:37:11.379866 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.379734    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 19 10:37:11.425687 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.425650    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n62mk"]
Sep 19 10:37:11.446832 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.446801    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2tzrs"]
Sep 19 10:37:11.446988 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.446963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.452511 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.452035    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 19 10:37:11.452511 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.452154    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 19 10:37:11.452511 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.452154    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qlvz2\""
Sep 19 10:37:11.464821 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.464796    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2tzrs"]
Sep 19 10:37:11.464967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.464830    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n62mk"]
Sep 19 10:37:11.464967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.464956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2tzrs"
Sep 19 10:37:11.467316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.467217    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 19 10:37:11.467316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.467241    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-62jc5\""
Sep 19 10:37:11.467316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.467217    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 19 10:37:11.467561 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.467325    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 19 10:37:11.556180 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.556144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbf61033-adcb-4c4a-9e75-30a5515907c2-cert\") pod \"ingress-canary-2tzrs\" (UID: \"cbf61033-adcb-4c4a-9e75-30a5515907c2\") " pod="openshift-ingress-canary/ingress-canary-2tzrs"
Sep 19 10:37:11.556180 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.556178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.556437 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.556198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89a38211-9d09-43df-8a79-fc1b09bbc395-tmp-dir\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.556437 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.556285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hff56\" (UniqueName: \"kubernetes.io/projected/cbf61033-adcb-4c4a-9e75-30a5515907c2-kube-api-access-hff56\") pod \"ingress-canary-2tzrs\" (UID: \"cbf61033-adcb-4c4a-9e75-30a5515907c2\") " pod="openshift-ingress-canary/ingress-canary-2tzrs"
Sep 19 10:37:11.556437 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.556360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj2d8\" (UniqueName: \"kubernetes.io/projected/89a38211-9d09-43df-8a79-fc1b09bbc395-kube-api-access-mj2d8\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.556437 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.556424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89a38211-9d09-43df-8a79-fc1b09bbc395-config-volume\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.657220 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.657135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hff56\" (UniqueName: \"kubernetes.io/projected/cbf61033-adcb-4c4a-9e75-30a5515907c2-kube-api-access-hff56\") pod \"ingress-canary-2tzrs\" (UID: \"cbf61033-adcb-4c4a-9e75-30a5515907c2\") " pod="openshift-ingress-canary/ingress-canary-2tzrs"
Sep 19 10:37:11.657220 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.657188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj2d8\" (UniqueName: \"kubernetes.io/projected/89a38211-9d09-43df-8a79-fc1b09bbc395-kube-api-access-mj2d8\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.657445 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.657236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89a38211-9d09-43df-8a79-fc1b09bbc395-config-volume\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.657445 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.657279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbf61033-adcb-4c4a-9e75-30a5515907c2-cert\") pod \"ingress-canary-2tzrs\" (UID: \"cbf61033-adcb-4c4a-9e75-30a5515907c2\") " pod="openshift-ingress-canary/ingress-canary-2tzrs"
Sep 19 10:37:11.657445 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.657306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.657445 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.657392    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:37:11.657700 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.657451    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls podName:89a38211-9d09-43df-8a79-fc1b09bbc395 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:12.157430932 +0000 UTC m=+36.091137145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls") pod "dns-default-n62mk" (UID: "89a38211-9d09-43df-8a79-fc1b09bbc395") : secret "dns-default-metrics-tls" not found
Sep 19 10:37:11.657700 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.657469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89a38211-9d09-43df-8a79-fc1b09bbc395-tmp-dir\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.657798 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.657779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89a38211-9d09-43df-8a79-fc1b09bbc395-tmp-dir\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.657953 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.657924    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89a38211-9d09-43df-8a79-fc1b09bbc395-config-volume\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.662137 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.662110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbf61033-adcb-4c4a-9e75-30a5515907c2-cert\") pod \"ingress-canary-2tzrs\" (UID: \"cbf61033-adcb-4c4a-9e75-30a5515907c2\") " pod="openshift-ingress-canary/ingress-canary-2tzrs"
Sep 19 10:37:11.665629 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.665602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj2d8\" (UniqueName: \"kubernetes.io/projected/89a38211-9d09-43df-8a79-fc1b09bbc395-kube-api-access-mj2d8\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:11.665913 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.665889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hff56\" (UniqueName: \"kubernetes.io/projected/cbf61033-adcb-4c4a-9e75-30a5515907c2-kube-api-access-hff56\") pod \"ingress-canary-2tzrs\" (UID: \"cbf61033-adcb-4c4a-9e75-30a5515907c2\") " pod="openshift-ingress-canary/ingress-canary-2tzrs"
Sep 19 10:37:11.757991 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.757953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:11.758171 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.758137    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:37:11.758243 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.758231    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret podName:1bf76517-aa49-4690-9df4-907efc1a73bb nodeName:}" failed. No retries permitted until 2026-09-19 10:37:43.758209382 +0000 UTC m=+67.691915588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret") pod "global-pull-secret-syncer-m94pc" (UID: "1bf76517-aa49-4690-9df4-907efc1a73bb") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:37:11.773760 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.773731    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2tzrs"
Sep 19 10:37:11.858749 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.858720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:11.858909 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:11.858765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:11.858909 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.858876    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:37:11.858992 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.858956    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs podName:2924b046-7224-4ebb-bbf5-c36501c96018 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:43.858938919 +0000 UTC m=+67.792645110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs") pod "network-metrics-daemon-8jnsk" (UID: "2924b046-7224-4ebb-bbf5-c36501c96018") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:37:11.858992 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.858881    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:37:11.858992 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.858984    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:37:11.858992 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.858993    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9hw9d for pod openshift-network-diagnostics/network-check-target-svp4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:37:11.859126 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:11.859033    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d podName:2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d nodeName:}" failed. No retries permitted until 2026-09-19 10:37:43.859022321 +0000 UTC m=+67.792728513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9hw9d" (UniqueName: "kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d") pod "network-check-target-svp4v" (UID: "2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:37:12.105400 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:12.105363    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2tzrs"]
Sep 19 10:37:12.161013 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:12.160976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:12.161623 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:12.161137    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:37:12.161623 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:12.161219    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls podName:89a38211-9d09-43df-8a79-fc1b09bbc395 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:13.161197771 +0000 UTC m=+37.094903977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls") pod "dns-default-n62mk" (UID: "89a38211-9d09-43df-8a79-fc1b09bbc395") : secret "dns-default-metrics-tls" not found
Sep 19 10:37:13.112236 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.112202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:13.112236 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.112224    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:13.112469 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.112202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:13.115924 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.115903    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 10:37:13.115924 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.115917    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 10:37:13.116087 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.115928    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ql7r7\""
Sep 19 10:37:13.116087 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.115968    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6z24q\""
Sep 19 10:37:13.116087 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.115949    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 10:37:13.116087 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.115911    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 10:37:13.170093 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:13.170058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:13.170514 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:13.170188    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:37:13.170514 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:13.170277    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls podName:89a38211-9d09-43df-8a79-fc1b09bbc395 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:15.170259141 +0000 UTC m=+39.103965333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls") pod "dns-default-n62mk" (UID: "89a38211-9d09-43df-8a79-fc1b09bbc395") : secret "dns-default-metrics-tls" not found
Sep 19 10:37:13.468949 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:13.468876    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf61033_adcb_4c4a_9e75_30a5515907c2.slice/crio-ae522b19ad0bd510d78dfb634fe7beffdc492380492ea28fcb4fa555149d9ccc WatchSource:0}: Error finding container ae522b19ad0bd510d78dfb634fe7beffdc492380492ea28fcb4fa555149d9ccc: Status 404 returned error can't find the container with id ae522b19ad0bd510d78dfb634fe7beffdc492380492ea28fcb4fa555149d9ccc
Sep 19 10:37:14.425961 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:14.425669    2563 generic.go:356] "Generic (PLEG): container finished" podID="06a78293-0523-4c11-8886-80b4cce2e7c8" containerID="686233a2e7cf97f5b51430b552dad7c8b5aeb612f2dc7be329364b9ff23c4bfc" exitCode=0
Sep 19 10:37:14.425961 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:14.425743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxzdw" event={"ID":"06a78293-0523-4c11-8886-80b4cce2e7c8","Type":"ContainerDied","Data":"686233a2e7cf97f5b51430b552dad7c8b5aeb612f2dc7be329364b9ff23c4bfc"}
Sep 19 10:37:14.427445 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:14.427419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2tzrs" event={"ID":"cbf61033-adcb-4c4a-9e75-30a5515907c2","Type":"ContainerStarted","Data":"ae522b19ad0bd510d78dfb634fe7beffdc492380492ea28fcb4fa555149d9ccc"}
Sep 19 10:37:15.187746 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.187693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:15.187940 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:15.187882    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:37:15.188008 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:15.187960    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls podName:89a38211-9d09-43df-8a79-fc1b09bbc395 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:19.187943323 +0000 UTC m=+43.121649519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls") pod "dns-default-n62mk" (UID: "89a38211-9d09-43df-8a79-fc1b09bbc395") : secret "dns-default-metrics-tls" not found
Sep 19 10:37:15.434567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.434459    2563 generic.go:356] "Generic (PLEG): container finished" podID="06a78293-0523-4c11-8886-80b4cce2e7c8" containerID="9bd8b506f8d683432e6b5eec3f3cee4f031f81ce341cf661a5841d5324bd2c28" exitCode=0
Sep 19 10:37:15.435000 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.434568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxzdw" event={"ID":"06a78293-0523-4c11-8886-80b4cce2e7c8","Type":"ContainerDied","Data":"9bd8b506f8d683432e6b5eec3f3cee4f031f81ce341cf661a5841d5324bd2c28"}
Sep 19 10:37:15.795789 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.795757    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-txvkd"]
Sep 19 10:37:15.798431 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.798404    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.800706 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.800682    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 19 10:37:15.800843 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.800692    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 19 10:37:15.800920 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.800878    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 19 10:37:15.800920 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.800882    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 19 10:37:15.801152 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.801132    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5c6t4\""
Sep 19 10:37:15.807765 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.807743    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-txvkd"]
Sep 19 10:37:15.893336 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.893298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.893336 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.893336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzl9q\" (UniqueName: \"kubernetes.io/projected/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-api-access-rzl9q\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.893510 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.893360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.893510 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.893470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d00e0c2-7919-4740-939b-f3dbf8380733-crio-socket\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.893621 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.893511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d00e0c2-7919-4740-939b-f3dbf8380733-data-volume\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.994027 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.993947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d00e0c2-7919-4740-939b-f3dbf8380733-crio-socket\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.994027 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.993997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d00e0c2-7919-4740-939b-f3dbf8380733-data-volume\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.994164 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.994142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.994211 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.994176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d00e0c2-7919-4740-939b-f3dbf8380733-crio-socket\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.994211 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.994181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzl9q\" (UniqueName: \"kubernetes.io/projected/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-api-access-rzl9q\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.994280 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.994236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.994280 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:15.994251    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 10:37:15.994369 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:15.994316    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:16.494299439 +0000 UTC m=+40.428005646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : configmap "kube-rbac-proxy" not found
Sep 19 10:37:15.994369 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:15.994326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d00e0c2-7919-4740-939b-f3dbf8380733-data-volume\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:15.994474 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:15.994397    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:15.994474 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:15.994456    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:16.494439016 +0000 UTC m=+40.428145216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:16.005358 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:16.005321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzl9q\" (UniqueName: \"kubernetes.io/projected/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-api-access-rzl9q\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:16.440497 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:16.440457    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wxzdw" event={"ID":"06a78293-0523-4c11-8886-80b4cce2e7c8","Type":"ContainerStarted","Data":"9fd82a6cb7e5732a6e54d6f6c4c5a3f6fefab410fd2af98c3c151d9d9fa4b0c1"}
Sep 19 10:37:16.441909 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:16.441888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2tzrs" event={"ID":"cbf61033-adcb-4c4a-9e75-30a5515907c2","Type":"ContainerStarted","Data":"3ac88d856c862ae19a6c3f41d03a7ddd37f4752a33f1e5ff5fa7885092732d0b"}
Sep 19 10:37:16.459954 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:16.459906    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wxzdw" podStartSLOduration=9.020419245 podStartE2EDuration="38.459872324s" totalImagesPullingTime="29.439453079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:16.459145878 +0000 UTC m=+40.392852104" watchObservedRunningTime="2026-09-19 10:37:16.459872324 +0000 UTC m=+40.393578533"
Sep 19 10:37:16.474580 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:16.474506    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2tzrs" podStartSLOduration=3.257627382 podStartE2EDuration="5.474490098s" totalImagesPullingTime="2.216862716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:16.47417616 +0000 UTC m=+40.407882396" watchObservedRunningTime="2026-09-19 10:37:16.474490098 +0000 UTC m=+40.408196313"
Sep 19 10:37:16.497646 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:16.497618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:16.497877 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:16.497656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:16.497877 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:16.497745    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 10:37:16.497877 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:16.497777    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:16.497877 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:16.497830    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:17.497810524 +0000 UTC m=+41.431516736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : configmap "kube-rbac-proxy" not found
Sep 19 10:37:16.497877 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:16.497848    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:17.497839562 +0000 UTC m=+41.431545753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:17.507478 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:17.507434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:17.507984 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:17.507486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:17.507984 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:17.507637    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:17.507984 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:17.507726    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:19.507704579 +0000 UTC m=+43.441410785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:17.507984 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:17.507795    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 10:37:17.507984 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:17.507867    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:19.507852187 +0000 UTC m=+43.441558393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : configmap "kube-rbac-proxy" not found
Sep 19 10:37:17.560521 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:17.560494    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4dnbr_3f425e60-dd82-465b-a43e-70e197626980/dns-node-resolver/0.log"
Sep 19 10:37:17.854821 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:17.854785    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd"]
Sep 19 10:37:17.857082 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:17.857066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd"
Sep 19 10:37:17.859354 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:17.859332    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 19 10:37:17.860165 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:17.860147    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-w5p9g\""
Sep 19 10:37:17.860257 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:17.860176    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 19 10:37:17.865285 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:17.865258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd"]
Sep 19 10:37:18.009633 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.009586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hswg\" (UniqueName: \"kubernetes.io/projected/99c2b3d2-de8f-4390-bea7-71289cc2ffc2-kube-api-access-7hswg\") pod \"migrator-76794cbd6c-tjdwd\" (UID: \"99c2b3d2-de8f-4390-bea7-71289cc2ffc2\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd"
Sep 19 10:37:18.110218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.110130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hswg\" (UniqueName: \"kubernetes.io/projected/99c2b3d2-de8f-4390-bea7-71289cc2ffc2-kube-api-access-7hswg\") pod \"migrator-76794cbd6c-tjdwd\" (UID: \"99c2b3d2-de8f-4390-bea7-71289cc2ffc2\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd"
Sep 19 10:37:18.117666 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.117640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hswg\" (UniqueName: \"kubernetes.io/projected/99c2b3d2-de8f-4390-bea7-71289cc2ffc2-kube-api-access-7hswg\") pod \"migrator-76794cbd6c-tjdwd\" (UID: \"99c2b3d2-de8f-4390-bea7-71289cc2ffc2\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd"
Sep 19 10:37:18.165989 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.165946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd"
Sep 19 10:37:18.431491 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.431380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd"]
Sep 19 10:37:18.435011 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:18.434986    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c2b3d2_de8f_4390_bea7_71289cc2ffc2.slice/crio-cf9cf1f81ae192cd826ac0606e56ee4ba16aaca825a8b72af7b6417f9b605a94 WatchSource:0}: Error finding container cf9cf1f81ae192cd826ac0606e56ee4ba16aaca825a8b72af7b6417f9b605a94: Status 404 returned error can't find the container with id cf9cf1f81ae192cd826ac0606e56ee4ba16aaca825a8b72af7b6417f9b605a94
Sep 19 10:37:18.447115 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.447090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd" event={"ID":"99c2b3d2-de8f-4390-bea7-71289cc2ffc2","Type":"ContainerStarted","Data":"cf9cf1f81ae192cd826ac0606e56ee4ba16aaca825a8b72af7b6417f9b605a94"}
Sep 19 10:37:18.507117 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.507085    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-jrbh8"]
Sep 19 10:37:18.509641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.509623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.511858 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.511831    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 19 10:37:18.511967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.511866    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 19 10:37:18.511967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.511892    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 19 10:37:18.511967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.511839    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 19 10:37:18.512991 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.512973    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wnxhv\""
Sep 19 10:37:18.516591 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.516568    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-jrbh8"]
Sep 19 10:37:18.614168 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.614137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e1ec60e4-74e4-49af-beca-d4e69322e0c4-signing-key\") pod \"service-ca-55f6fc7b86-jrbh8\" (UID: \"e1ec60e4-74e4-49af-beca-d4e69322e0c4\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.614311 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.614185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e1ec60e4-74e4-49af-beca-d4e69322e0c4-signing-cabundle\") pod \"service-ca-55f6fc7b86-jrbh8\" (UID: \"e1ec60e4-74e4-49af-beca-d4e69322e0c4\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.614368 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.614324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldzbv\" (UniqueName: \"kubernetes.io/projected/e1ec60e4-74e4-49af-beca-d4e69322e0c4-kube-api-access-ldzbv\") pod \"service-ca-55f6fc7b86-jrbh8\" (UID: \"e1ec60e4-74e4-49af-beca-d4e69322e0c4\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.715743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.715650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldzbv\" (UniqueName: \"kubernetes.io/projected/e1ec60e4-74e4-49af-beca-d4e69322e0c4-kube-api-access-ldzbv\") pod \"service-ca-55f6fc7b86-jrbh8\" (UID: \"e1ec60e4-74e4-49af-beca-d4e69322e0c4\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.715743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.715693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e1ec60e4-74e4-49af-beca-d4e69322e0c4-signing-key\") pod \"service-ca-55f6fc7b86-jrbh8\" (UID: \"e1ec60e4-74e4-49af-beca-d4e69322e0c4\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.715743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.715731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e1ec60e4-74e4-49af-beca-d4e69322e0c4-signing-cabundle\") pod \"service-ca-55f6fc7b86-jrbh8\" (UID: \"e1ec60e4-74e4-49af-beca-d4e69322e0c4\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.716476 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.716444    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e1ec60e4-74e4-49af-beca-d4e69322e0c4-signing-cabundle\") pod \"service-ca-55f6fc7b86-jrbh8\" (UID: \"e1ec60e4-74e4-49af-beca-d4e69322e0c4\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.718267 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.718233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e1ec60e4-74e4-49af-beca-d4e69322e0c4-signing-key\") pod \"service-ca-55f6fc7b86-jrbh8\" (UID: \"e1ec60e4-74e4-49af-beca-d4e69322e0c4\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.723372 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.723346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldzbv\" (UniqueName: \"kubernetes.io/projected/e1ec60e4-74e4-49af-beca-d4e69322e0c4-kube-api-access-ldzbv\") pod \"service-ca-55f6fc7b86-jrbh8\" (UID: \"e1ec60e4-74e4-49af-beca-d4e69322e0c4\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.819188 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.819138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8"
Sep 19 10:37:18.961422 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:18.961397    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wf2sv_a7faa045-b0f1-47f4-b351-dae07815e965/node-ca/0.log"
Sep 19 10:37:19.088429 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:19.088391    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-jrbh8"]
Sep 19 10:37:19.094931 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:19.094898    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ec60e4_74e4_49af_beca_d4e69322e0c4.slice/crio-e3377563afed1e6e4d40305adce08ed9b6a8c46bba4af2e65cd7e2590b601f8c WatchSource:0}: Error finding container e3377563afed1e6e4d40305adce08ed9b6a8c46bba4af2e65cd7e2590b601f8c: Status 404 returned error can't find the container with id e3377563afed1e6e4d40305adce08ed9b6a8c46bba4af2e65cd7e2590b601f8c
Sep 19 10:37:19.219422 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:19.219383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:19.219629 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:19.219597    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:37:19.219779 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:19.219697    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls podName:89a38211-9d09-43df-8a79-fc1b09bbc395 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:27.219675931 +0000 UTC m=+51.153382124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls") pod "dns-default-n62mk" (UID: "89a38211-9d09-43df-8a79-fc1b09bbc395") : secret "dns-default-metrics-tls" not found
Sep 19 10:37:19.361525 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:19.361445    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2tzrs_cbf61033-adcb-4c4a-9e75-30a5515907c2/serve-healthcheck-canary/0.log"
Sep 19 10:37:19.451109 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:19.451071    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8" event={"ID":"e1ec60e4-74e4-49af-beca-d4e69322e0c4","Type":"ContainerStarted","Data":"e3377563afed1e6e4d40305adce08ed9b6a8c46bba4af2e65cd7e2590b601f8c"}
Sep 19 10:37:19.521512 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:19.521470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:19.522019 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:19.521525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:19.522019 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:19.521646    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 10:37:19.522019 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:19.521697    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:19.522019 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:19.521731    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:23.521710026 +0000 UTC m=+47.455416241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : configmap "kube-rbac-proxy" not found
Sep 19 10:37:19.522019 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:19.521764    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:23.521747482 +0000 UTC m=+47.455453691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:20.455051 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:20.455012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd" event={"ID":"99c2b3d2-de8f-4390-bea7-71289cc2ffc2","Type":"ContainerStarted","Data":"e7c5ad72e281392bf8df1008a7797678fdb2c61b123c3b4444fd223068e1ecd6"}
Sep 19 10:37:20.455198 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:20.455075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd" event={"ID":"99c2b3d2-de8f-4390-bea7-71289cc2ffc2","Type":"ContainerStarted","Data":"1a648084666898a180526f86424a73965efb54a33ede2c63d9da83bba8cb9851"}
Sep 19 10:37:20.470151 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:20.470099    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-tjdwd" podStartSLOduration=2.3469961919999998 podStartE2EDuration="3.47008445s" totalImagesPullingTime="1.123088258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:20.469139411 +0000 UTC m=+44.402845651" watchObservedRunningTime="2026-09-19 10:37:20.47008445 +0000 UTC m=+44.403790672"
Sep 19 10:37:21.459057 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:21.459020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8" event={"ID":"e1ec60e4-74e4-49af-beca-d4e69322e0c4","Type":"ContainerStarted","Data":"d67a6a92e5170ad8a0c67d1f1a21785f34eb856c6eee1bd4bdabbd932c09751a"}
Sep 19 10:37:21.477056 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:21.476996    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-jrbh8" podStartSLOduration=1.522031751 podStartE2EDuration="3.476976411s" totalImagesPullingTime="1.95494466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:21.476771565 +0000 UTC m=+45.410477779" watchObservedRunningTime="2026-09-19 10:37:21.476976411 +0000 UTC m=+45.410682626"
Sep 19 10:37:23.553815 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:23.553766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:23.554204 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:23.553828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:23.554204 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:23.553899    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 10:37:23.554204 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:23.553953    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:23.554204 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:23.553971    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:31.553955075 +0000 UTC m=+55.487661290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : configmap "kube-rbac-proxy" not found
Sep 19 10:37:23.554204 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:23.554003    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:31.553987832 +0000 UTC m=+55.487694028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:27.279883 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:27.279845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:27.282252 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:27.282228    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89a38211-9d09-43df-8a79-fc1b09bbc395-metrics-tls\") pod \"dns-default-n62mk\" (UID: \"89a38211-9d09-43df-8a79-fc1b09bbc395\") " pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:27.360290 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:27.360247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:27.646006 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:27.645974    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n62mk"]
Sep 19 10:37:27.649719 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:27.649676    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a38211_9d09_43df_8a79_fc1b09bbc395.slice/crio-794ccd56dae26ad617b9d2bd7354f46bd5375e5cbaa819551083533391de9bdd WatchSource:0}: Error finding container 794ccd56dae26ad617b9d2bd7354f46bd5375e5cbaa819551083533391de9bdd: Status 404 returned error can't find the container with id 794ccd56dae26ad617b9d2bd7354f46bd5375e5cbaa819551083533391de9bdd
Sep 19 10:37:28.478464 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:28.478396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n62mk" event={"ID":"89a38211-9d09-43df-8a79-fc1b09bbc395","Type":"ContainerStarted","Data":"794ccd56dae26ad617b9d2bd7354f46bd5375e5cbaa819551083533391de9bdd"}
Sep 19 10:37:30.486143 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:30.486053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n62mk" event={"ID":"89a38211-9d09-43df-8a79-fc1b09bbc395","Type":"ContainerStarted","Data":"b975def30d35dd257b18e589a7e194bb9546067d67d4dd6c9c9ed8b2ac88e9b1"}
Sep 19 10:37:30.486143 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:30.486114    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n62mk" event={"ID":"89a38211-9d09-43df-8a79-fc1b09bbc395","Type":"ContainerStarted","Data":"3a91b3714632b97f6f35d87b8d8dbdb4af49d5c7d026f319475d2a835f2f7e80"}
Sep 19 10:37:30.486650 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:30.486192    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:30.500825 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:30.500777    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n62mk" podStartSLOduration=17.307040364 podStartE2EDuration="19.500761627s" totalImagesPullingTime="2.193721263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:30.499990002 +0000 UTC m=+54.433696215" watchObservedRunningTime="2026-09-19 10:37:30.500761627 +0000 UTC m=+54.434467841"
Sep 19 10:37:31.615356 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:31.615308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:31.615856 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:31.615369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:31.615856 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:31.615473    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:31.615856 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:31.615528    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls podName:7d00e0c2-7919-4740-939b-f3dbf8380733 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:47.615512387 +0000 UTC m=+71.549218600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txvkd" (UID: "7d00e0c2-7919-4740-939b-f3dbf8380733") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:37:31.615856 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:31.615832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d00e0c2-7919-4740-939b-f3dbf8380733-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:37.417981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:37.417949    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-btf2g"
Sep 19 10:37:40.491936 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:40.491903    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n62mk"
Sep 19 10:37:41.540832 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.540802    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"]
Sep 19 10:37:41.544271 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.544250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"
Sep 19 10:37:41.547581 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.547557    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 19 10:37:41.547714 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.547561    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m45ws\""
Sep 19 10:37:41.547714 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.547566    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 19 10:37:41.551926 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.551901    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"]
Sep 19 10:37:41.638732 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.638703    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-7x6mm"]
Sep 19 10:37:41.640685 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.640670    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-7x6mm"
Sep 19 10:37:41.643080 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.643040    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79c94b8b8b-psgnl"]
Sep 19 10:37:41.643230 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.643197    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 19 10:37:41.643393 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.643373    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 19 10:37:41.643462 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.643450    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-r5gxk\""
Sep 19 10:37:41.645080 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.645051    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7744689dd4-n8qwn"]
Sep 19 10:37:41.645189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.645171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.647123 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.647104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.647233 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.647186    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 19 10:37:41.647296 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.647190    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 19 10:37:41.647611 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.647592    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lp9gc\""
Sep 19 10:37:41.647702 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.647686    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 19 10:37:41.649354 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.649338    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f4tr5\""
Sep 19 10:37:41.649572 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.649539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 19 10:37:41.649922 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.649903    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 19 10:37:41.650066 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.650050    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 19 10:37:41.650148 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.650077    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 19 10:37:41.650341 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.650324    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 19 10:37:41.652283 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.652267    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 19 10:37:41.655262 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.655243    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-7x6mm"]
Sep 19 10:37:41.660842 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.660820    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7744689dd4-n8qwn"]
Sep 19 10:37:41.661448 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.661428    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c94b8b8b-psgnl"]
Sep 19 10:37:41.686177 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.686149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/127ade86-ef4e-4c60-8238-5e0a6dffa0d4-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-9rsbs\" (UID: \"127ade86-ef4e-4c60-8238-5e0a6dffa0d4\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"
Sep 19 10:37:41.686333 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.686213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/127ade86-ef4e-4c60-8238-5e0a6dffa0d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9rsbs\" (UID: \"127ade86-ef4e-4c60-8238-5e0a6dffa0d4\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"
Sep 19 10:37:41.786895 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.786860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-registry-certificates\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.787098 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.786915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-bound-sa-token\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.787098 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.786949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/127ade86-ef4e-4c60-8238-5e0a6dffa0d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9rsbs\" (UID: \"127ade86-ef4e-4c60-8238-5e0a6dffa0d4\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"
Sep 19 10:37:41.787098 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.786976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-config\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.787098 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.786994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vnfx\" (UniqueName: \"kubernetes.io/projected/657de118-63a3-48a5-a1ae-732a7f1eabef-kube-api-access-8vnfx\") pod \"downloads-6594f4c75-7x6mm\" (UID: \"657de118-63a3-48a5-a1ae-732a7f1eabef\") " pod="openshift-console/downloads-6594f4c75-7x6mm"
Sep 19 10:37:41.787098 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-oauth-serving-cert\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.787098 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/127ade86-ef4e-4c60-8238-5e0a6dffa0d4-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-9rsbs\" (UID: \"127ade86-ef4e-4c60-8238-5e0a6dffa0d4\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"
Sep 19 10:37:41.787098 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-image-registry-private-configuration\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.787475 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b4jk\" (UniqueName: \"kubernetes.io/projected/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-kube-api-access-9b4jk\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.787530 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-service-ca\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.787837 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-oauth-config\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.787935 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-trusted-ca\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.787935 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-serving-cert\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.788038 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-installation-pull-secrets\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.788038 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.787990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxtm\" (UniqueName: \"kubernetes.io/projected/c8ce03eb-46d4-4564-ab97-01be94eba8a9-kube-api-access-tkxtm\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.788038 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.788024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-ca-trust-extracted\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.788180 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.788082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-registry-tls\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.788271 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.788244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/127ade86-ef4e-4c60-8238-5e0a6dffa0d4-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-9rsbs\" (UID: \"127ade86-ef4e-4c60-8238-5e0a6dffa0d4\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"
Sep 19 10:37:41.790464 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.790438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/127ade86-ef4e-4c60-8238-5e0a6dffa0d4-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-9rsbs\" (UID: \"127ade86-ef4e-4c60-8238-5e0a6dffa0d4\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"
Sep 19 10:37:41.853893 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.853859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"
Sep 19 10:37:41.889461 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-registry-certificates\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.889461 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-bound-sa-token\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.889707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-config\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.889707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vnfx\" (UniqueName: \"kubernetes.io/projected/657de118-63a3-48a5-a1ae-732a7f1eabef-kube-api-access-8vnfx\") pod \"downloads-6594f4c75-7x6mm\" (UID: \"657de118-63a3-48a5-a1ae-732a7f1eabef\") " pod="openshift-console/downloads-6594f4c75-7x6mm"
Sep 19 10:37:41.889707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-oauth-serving-cert\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.889707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-image-registry-private-configuration\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.889707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b4jk\" (UniqueName: \"kubernetes.io/projected/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-kube-api-access-9b4jk\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.889707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-service-ca\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.890002 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-oauth-config\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.890002 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-trusted-ca\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.890002 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-serving-cert\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.890002 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-installation-pull-secrets\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.890002 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxtm\" (UniqueName: \"kubernetes.io/projected/c8ce03eb-46d4-4564-ab97-01be94eba8a9-kube-api-access-tkxtm\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.890002 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-ca-trust-extracted\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.890002 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.889943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-registry-tls\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.890798 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.890339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-config\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.890798 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.890349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-oauth-serving-cert\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.890798 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.890772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-registry-certificates\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.891081 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.890867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-service-ca\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.891081 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.891073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-ca-trust-extracted\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.891446 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.891421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-trusted-ca\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.893978 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.893021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-registry-tls\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.893978 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.893021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-serving-cert\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.893978 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.893447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-image-registry-private-configuration\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.893978 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.893757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-oauth-config\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.894735 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.894713    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-installation-pull-secrets\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.897432 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.897402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-bound-sa-token\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.897867 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.897849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxtm\" (UniqueName: \"kubernetes.io/projected/c8ce03eb-46d4-4564-ab97-01be94eba8a9-kube-api-access-tkxtm\") pod \"console-7744689dd4-n8qwn\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") " pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:41.898231 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.898213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vnfx\" (UniqueName: \"kubernetes.io/projected/657de118-63a3-48a5-a1ae-732a7f1eabef-kube-api-access-8vnfx\") pod \"downloads-6594f4c75-7x6mm\" (UID: \"657de118-63a3-48a5-a1ae-732a7f1eabef\") " pod="openshift-console/downloads-6594f4c75-7x6mm"
Sep 19 10:37:41.898664 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.898646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b4jk\" (UniqueName: \"kubernetes.io/projected/6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0-kube-api-access-9b4jk\") pod \"image-registry-79c94b8b8b-psgnl\" (UID: \"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0\") " pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.951309 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.951275    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-7x6mm"
Sep 19 10:37:41.958643 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.958608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:41.964739 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:41.964715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:42.128426 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.128344    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs"]
Sep 19 10:37:42.132896 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:42.132848    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127ade86_ef4e_4c60_8238_5e0a6dffa0d4.slice/crio-9dfde4d446a1e83d6e40f16c47776904710657d0b6c9c933017dc1883dceabd1 WatchSource:0}: Error finding container 9dfde4d446a1e83d6e40f16c47776904710657d0b6c9c933017dc1883dceabd1: Status 404 returned error can't find the container with id 9dfde4d446a1e83d6e40f16c47776904710657d0b6c9c933017dc1883dceabd1
Sep 19 10:37:42.227096 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.227057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-7x6mm"]
Sep 19 10:37:42.230368 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:42.230345    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657de118_63a3_48a5_a1ae_732a7f1eabef.slice/crio-54e935f8b87e32b82b1437213a01b2f0a7a159526a87cc325d4a66879eab6dfb WatchSource:0}: Error finding container 54e935f8b87e32b82b1437213a01b2f0a7a159526a87cc325d4a66879eab6dfb: Status 404 returned error can't find the container with id 54e935f8b87e32b82b1437213a01b2f0a7a159526a87cc325d4a66879eab6dfb
Sep 19 10:37:42.243503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.243480    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c94b8b8b-psgnl"]
Sep 19 10:37:42.244417 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.244399    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7744689dd4-n8qwn"]
Sep 19 10:37:42.246287 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:42.246246    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ce03eb_46d4_4564_ab97_01be94eba8a9.slice/crio-f74de165809e4ab0cac8b72cb29c50ca64a33afce40bc542d0aaf39a89c2813d WatchSource:0}: Error finding container f74de165809e4ab0cac8b72cb29c50ca64a33afce40bc542d0aaf39a89c2813d: Status 404 returned error can't find the container with id f74de165809e4ab0cac8b72cb29c50ca64a33afce40bc542d0aaf39a89c2813d
Sep 19 10:37:42.246969 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:42.246936    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbcb24a_0b6f_4b50_906f_56ca6c64f8c0.slice/crio-3ff1e79a901d1d796a7073ece00195e484c724be599aaea53243ab1e1d7b0a82 WatchSource:0}: Error finding container 3ff1e79a901d1d796a7073ece00195e484c724be599aaea53243ab1e1d7b0a82: Status 404 returned error can't find the container with id 3ff1e79a901d1d796a7073ece00195e484c724be599aaea53243ab1e1d7b0a82
Sep 19 10:37:42.529235 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.529137    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-7x6mm" event={"ID":"657de118-63a3-48a5-a1ae-732a7f1eabef","Type":"ContainerStarted","Data":"54e935f8b87e32b82b1437213a01b2f0a7a159526a87cc325d4a66879eab6dfb"}
Sep 19 10:37:42.530416 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.530390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7744689dd4-n8qwn" event={"ID":"c8ce03eb-46d4-4564-ab97-01be94eba8a9","Type":"ContainerStarted","Data":"f74de165809e4ab0cac8b72cb29c50ca64a33afce40bc542d0aaf39a89c2813d"}
Sep 19 10:37:42.532046 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.532021    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl" event={"ID":"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0","Type":"ContainerStarted","Data":"dbafc29a57cc56b5654db791af2fe8a8a76be47c12056c94443cba7d723063cb"}
Sep 19 10:37:42.532156 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.532065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl" event={"ID":"6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0","Type":"ContainerStarted","Data":"3ff1e79a901d1d796a7073ece00195e484c724be599aaea53243ab1e1d7b0a82"}
Sep 19 10:37:42.532156 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.532145    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:37:42.533339 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.533320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs" event={"ID":"127ade86-ef4e-4c60-8238-5e0a6dffa0d4","Type":"ContainerStarted","Data":"9dfde4d446a1e83d6e40f16c47776904710657d0b6c9c933017dc1883dceabd1"}
Sep 19 10:37:42.551248 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:42.551204    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl" podStartSLOduration=1.5511864499999999 podStartE2EDuration="1.55118645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:42.549993184 +0000 UTC m=+66.483699422" watchObservedRunningTime="2026-09-19 10:37:42.55118645 +0000 UTC m=+66.484892667"
Sep 19 10:37:43.438349 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.437230    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"]
Sep 19 10:37:43.443305 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.442634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"
Sep 19 10:37:43.445439 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.445198    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 19 10:37:43.445439 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.445245    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7wnkq\""
Sep 19 10:37:43.447919 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.447792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"]
Sep 19 10:37:43.613140 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.613100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/16a55a1a-274a-45e3-93a5-37e39915de99-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-bgtbv\" (UID: \"16a55a1a-274a-45e3-93a5-37e39915de99\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"
Sep 19 10:37:43.714223 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.714142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/16a55a1a-274a-45e3-93a5-37e39915de99-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-bgtbv\" (UID: \"16a55a1a-274a-45e3-93a5-37e39915de99\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"
Sep 19 10:37:43.714383 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:43.714309    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 19 10:37:43.714448 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:43.714383    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16a55a1a-274a-45e3-93a5-37e39915de99-tls-certificates podName:16a55a1a-274a-45e3-93a5-37e39915de99 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:44.214362032 +0000 UTC m=+68.148068230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/16a55a1a-274a-45e3-93a5-37e39915de99-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-bgtbv" (UID: "16a55a1a-274a-45e3-93a5-37e39915de99") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 19 10:37:43.814698 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.814663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:43.817258 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.817098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 10:37:43.829711 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.829683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bf76517-aa49-4690-9df4-907efc1a73bb-original-pull-secret\") pod \"global-pull-secret-syncer-m94pc\" (UID: \"1bf76517-aa49-4690-9df4-907efc1a73bb\") " pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:43.915597 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.915050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:43.915597 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.915155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:43.917521 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.917496    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 10:37:43.917521 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.917513    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 10:37:43.928716 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.928688    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 10:37:43.933230 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.933202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2924b046-7224-4ebb-bbf5-c36501c96018-metrics-certs\") pod \"network-metrics-daemon-8jnsk\" (UID: \"2924b046-7224-4ebb-bbf5-c36501c96018\") " pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:43.941698 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:43.941672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hw9d\" (UniqueName: \"kubernetes.io/projected/2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d-kube-api-access-9hw9d\") pod \"network-check-target-svp4v\" (UID: \"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d\") " pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:44.026610 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:44.026513    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6z24q\""
Sep 19 10:37:44.030654 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:44.030405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m94pc"
Sep 19 10:37:44.034779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:44.034473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jnsk"
Sep 19 10:37:44.037228 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:44.037169    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ql7r7\""
Sep 19 10:37:44.046152 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:44.046123    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:37:44.218349 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:44.218317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/16a55a1a-274a-45e3-93a5-37e39915de99-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-bgtbv\" (UID: \"16a55a1a-274a-45e3-93a5-37e39915de99\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"
Sep 19 10:37:44.218534 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:44.218493    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 19 10:37:44.218618 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:44.218585    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16a55a1a-274a-45e3-93a5-37e39915de99-tls-certificates podName:16a55a1a-274a-45e3-93a5-37e39915de99 nodeName:}" failed. No retries permitted until 2026-09-19 10:37:45.218561956 +0000 UTC m=+69.152268163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/16a55a1a-274a-45e3-93a5-37e39915de99-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-bgtbv" (UID: "16a55a1a-274a-45e3-93a5-37e39915de99") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 19 10:37:44.545037 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:44.544879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs" event={"ID":"127ade86-ef4e-4c60-8238-5e0a6dffa0d4","Type":"ContainerStarted","Data":"e44ee033fe89a313c3a865d4900ed0ed5cbdb8a4b09c510fb1bacb8281ccfe33"}
Sep 19 10:37:44.559279 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:44.559015    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-9rsbs" podStartSLOduration=1.893648156 podStartE2EDuration="3.558989619s" totalImagesPullingTime="1.665341463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:44.558614251 +0000 UTC m=+68.492320487" watchObservedRunningTime="2026-09-19 10:37:44.558989619 +0000 UTC m=+68.492695836"
Sep 19 10:37:45.226625 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:45.226080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/16a55a1a-274a-45e3-93a5-37e39915de99-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-bgtbv\" (UID: \"16a55a1a-274a-45e3-93a5-37e39915de99\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"
Sep 19 10:37:45.229258 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:45.229230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/16a55a1a-274a-45e3-93a5-37e39915de99-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-bgtbv\" (UID: \"16a55a1a-274a-45e3-93a5-37e39915de99\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"
Sep 19 10:37:45.258164 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:45.258068    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"
Sep 19 10:37:47.278664 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.278578    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m94pc"]
Sep 19 10:37:47.282311 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.282240    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svp4v"]
Sep 19 10:37:47.286580 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:47.286524    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf76517_aa49_4690_9df4_907efc1a73bb.slice/crio-6b87d64abda996a5a4414d0063e5c8a212c1f8039da33dc9db93b4ee334be9d2 WatchSource:0}: Error finding container 6b87d64abda996a5a4414d0063e5c8a212c1f8039da33dc9db93b4ee334be9d2: Status 404 returned error can't find the container with id 6b87d64abda996a5a4414d0063e5c8a212c1f8039da33dc9db93b4ee334be9d2
Sep 19 10:37:47.288506 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:47.288478    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2035d6aa_74ec_4d7d_bbff_1ac8dd91c46d.slice/crio-10355ba73d4d7a7453f5ca4488b59a586bf43780fb799daa04f677c61736971f WatchSource:0}: Error finding container 10355ba73d4d7a7453f5ca4488b59a586bf43780fb799daa04f677c61736971f: Status 404 returned error can't find the container with id 10355ba73d4d7a7453f5ca4488b59a586bf43780fb799daa04f677c61736971f
Sep 19 10:37:47.298707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.298680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"]
Sep 19 10:37:47.299854 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.299829    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8jnsk"]
Sep 19 10:37:47.302828 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:47.302804    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16a55a1a_274a_45e3_93a5_37e39915de99.slice/crio-2351c333a2ee48256326bf41099ba13a047024207ab8a10a5339f9705a801c7f WatchSource:0}: Error finding container 2351c333a2ee48256326bf41099ba13a047024207ab8a10a5339f9705a801c7f: Status 404 returned error can't find the container with id 2351c333a2ee48256326bf41099ba13a047024207ab8a10a5339f9705a801c7f
Sep 19 10:37:47.303634 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:47.303508    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2924b046_7224_4ebb_bbf5_c36501c96018.slice/crio-35d60e3d617e7bea19ee2dc6149cadf5f3e867e93a7cd5755f437342c751124e WatchSource:0}: Error finding container 35d60e3d617e7bea19ee2dc6149cadf5f3e867e93a7cd5755f437342c751124e: Status 404 returned error can't find the container with id 35d60e3d617e7bea19ee2dc6149cadf5f3e867e93a7cd5755f437342c751124e
Sep 19 10:37:47.563440 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.563352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv" event={"ID":"16a55a1a-274a-45e3-93a5-37e39915de99","Type":"ContainerStarted","Data":"2351c333a2ee48256326bf41099ba13a047024207ab8a10a5339f9705a801c7f"}
Sep 19 10:37:47.564680 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.564655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jnsk" event={"ID":"2924b046-7224-4ebb-bbf5-c36501c96018","Type":"ContainerStarted","Data":"35d60e3d617e7bea19ee2dc6149cadf5f3e867e93a7cd5755f437342c751124e"}
Sep 19 10:37:47.565948 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.565920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svp4v" event={"ID":"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d","Type":"ContainerStarted","Data":"10355ba73d4d7a7453f5ca4488b59a586bf43780fb799daa04f677c61736971f"}
Sep 19 10:37:47.567290 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.567268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m94pc" event={"ID":"1bf76517-aa49-4690-9df4-907efc1a73bb","Type":"ContainerStarted","Data":"6b87d64abda996a5a4414d0063e5c8a212c1f8039da33dc9db93b4ee334be9d2"}
Sep 19 10:37:47.569067 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.569047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7744689dd4-n8qwn" event={"ID":"c8ce03eb-46d4-4564-ab97-01be94eba8a9","Type":"ContainerStarted","Data":"f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274"}
Sep 19 10:37:47.585218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.584987    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7744689dd4-n8qwn" podStartSLOduration=1.7722019279999999 podStartE2EDuration="6.584964614s" totalImagesPullingTime="4.812762686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:47.58442723 +0000 UTC m=+71.518133468" watchObservedRunningTime="2026-09-19 10:37:47.584964614 +0000 UTC m=+71.518670830"
Sep 19 10:37:47.650287 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.650244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:47.652728 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.652703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d00e0c2-7919-4740-939b-f3dbf8380733-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txvkd\" (UID: \"7d00e0c2-7919-4740-939b-f3dbf8380733\") " pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:47.912314 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.911961    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5c6t4\""
Sep 19 10:37:47.920168 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:47.920136    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-txvkd"
Sep 19 10:37:48.227408 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:48.226167    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-txvkd"]
Sep 19 10:37:48.232258 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:37:48.232227    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d00e0c2_7919_4740_939b_f3dbf8380733.slice/crio-3bae119c4dc5508fd214ec5e154309aea79899b47d7c296357397e032cf4136f WatchSource:0}: Error finding container 3bae119c4dc5508fd214ec5e154309aea79899b47d7c296357397e032cf4136f: Status 404 returned error can't find the container with id 3bae119c4dc5508fd214ec5e154309aea79899b47d7c296357397e032cf4136f
Sep 19 10:37:48.577046 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:48.577008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txvkd" event={"ID":"7d00e0c2-7919-4740-939b-f3dbf8380733","Type":"ContainerStarted","Data":"a866f3f23957241232b7b692a04a7285454dd939cc0cb908036a71a510a3c45d"}
Sep 19 10:37:48.577501 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:48.577075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txvkd" event={"ID":"7d00e0c2-7919-4740-939b-f3dbf8380733","Type":"ContainerStarted","Data":"3bae119c4dc5508fd214ec5e154309aea79899b47d7c296357397e032cf4136f"}
Sep 19 10:37:49.584179 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:49.584117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv" event={"ID":"16a55a1a-274a-45e3-93a5-37e39915de99","Type":"ContainerStarted","Data":"ecc5c8659262680fa97f9fbc5a6c45f6a6d58154f3eca626ff0006579bfaba28"}
Sep 19 10:37:49.584628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:49.584564    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"
Sep 19 10:37:49.588429 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:49.587753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txvkd" event={"ID":"7d00e0c2-7919-4740-939b-f3dbf8380733","Type":"ContainerStarted","Data":"8a157b2ddf0fbf2b54584df2ca0ee36cb8a617aaa8877c41c02ca75f530d1ed1"}
Sep 19 10:37:49.591124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:49.591097    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv"
Sep 19 10:37:49.591788 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:49.591694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jnsk" event={"ID":"2924b046-7224-4ebb-bbf5-c36501c96018","Type":"ContainerStarted","Data":"3591344e67d2583c6833de7d8fb286b4c750bb1ed1b7c586a7ec805dadd5d5e0"}
Sep 19 10:37:49.591788 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:49.591734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jnsk" event={"ID":"2924b046-7224-4ebb-bbf5-c36501c96018","Type":"ContainerStarted","Data":"f6cb2114e6a81008a8a23724ac037d2300459eccccacab23136342efade28bc4"}
Sep 19 10:37:49.607325 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:49.607267    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bgtbv" podStartSLOduration=4.779364173 podStartE2EDuration="6.607248127s" totalImagesPullingTime="1.827883954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:49.605884647 +0000 UTC m=+73.539590891" watchObservedRunningTime="2026-09-19 10:37:49.607248127 +0000 UTC m=+73.540954343"
Sep 19 10:37:49.627381 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:49.627313    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8jnsk" podStartSLOduration=69.802128236 podStartE2EDuration="1m11.627288607s" totalImagesPullingTime="1.825160371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:49.626921146 +0000 UTC m=+73.560627379" watchObservedRunningTime="2026-09-19 10:37:49.627288607 +0000 UTC m=+73.560994823"
Sep 19 10:37:50.540291 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.540238    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"]
Sep 19 10:37:50.544102 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.544077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.548763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.548739    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 19 10:37:50.550125 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.550091    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 19 10:37:50.550392 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.550372    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gwbrv\""
Sep 19 10:37:50.550611 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.550592    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 19 10:37:50.550835 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.550817    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 19 10:37:50.551018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.551001    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 19 10:37:50.556690 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.554321    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"]
Sep 19 10:37:50.581782 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.580942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af834c89-5417-44da-ab71-88f4a9bca93c-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.581782 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.580995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af834c89-5417-44da-ab71-88f4a9bca93c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.581782 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.581025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-656fg\" (UniqueName: \"kubernetes.io/projected/af834c89-5417-44da-ab71-88f4a9bca93c-kube-api-access-656fg\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.581782 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.581052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af834c89-5417-44da-ab71-88f4a9bca93c-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.682120 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.682078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af834c89-5417-44da-ab71-88f4a9bca93c-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.682628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.682138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af834c89-5417-44da-ab71-88f4a9bca93c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.682628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.682171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-656fg\" (UniqueName: \"kubernetes.io/projected/af834c89-5417-44da-ab71-88f4a9bca93c-kube-api-access-656fg\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.682628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.682202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af834c89-5417-44da-ab71-88f4a9bca93c-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.682628 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:50.682326    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 19 10:37:50.682628 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:37:50.682380    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af834c89-5417-44da-ab71-88f4a9bca93c-prometheus-operator-tls podName:af834c89-5417-44da-ab71-88f4a9bca93c nodeName:}" failed. No retries permitted until 2026-09-19 10:37:51.18236449 +0000 UTC m=+75.116070682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/af834c89-5417-44da-ab71-88f4a9bca93c-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-zh29f" (UID: "af834c89-5417-44da-ab71-88f4a9bca93c") : secret "prometheus-operator-tls" not found
Sep 19 10:37:50.683941 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.683623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af834c89-5417-44da-ab71-88f4a9bca93c-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.687796 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.687757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af834c89-5417-44da-ab71-88f4a9bca93c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:50.696614 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:50.696535    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-656fg\" (UniqueName: \"kubernetes.io/projected/af834c89-5417-44da-ab71-88f4a9bca93c-kube-api-access-656fg\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:51.186846 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:51.186640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af834c89-5417-44da-ab71-88f4a9bca93c-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:51.189759 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:51.189709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af834c89-5417-44da-ab71-88f4a9bca93c-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-zh29f\" (UID: \"af834c89-5417-44da-ab71-88f4a9bca93c\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:51.462712 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:51.462632    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"
Sep 19 10:37:51.966239 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:51.965627    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:51.966239 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:51.965962    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:51.972466 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:51.972434    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:37:52.611562 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:37:52.611514    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:38:01.115760 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.115682    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f"]
Sep 19 10:38:01.162931 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:38:01.162900    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf834c89_5417_44da_ab71_88f4a9bca93c.slice/crio-31bd0f3913cb8457cf875be48168817868301fcad46d4286b852298b7c07e16e WatchSource:0}: Error finding container 31bd0f3913cb8457cf875be48168817868301fcad46d4286b852298b7c07e16e: Status 404 returned error can't find the container with id 31bd0f3913cb8457cf875be48168817868301fcad46d4286b852298b7c07e16e
Sep 19 10:38:01.645628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.645587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svp4v" event={"ID":"2035d6aa-74ec-4d7d-bbff-1ac8dd91c46d","Type":"ContainerStarted","Data":"7b0e0255f8f5f9d470cdf4343145c4aff9640f25870c259e6c3674b2a919a4d0"}
Sep 19 10:38:01.645808 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.645680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:38:01.647509 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.647478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m94pc" event={"ID":"1bf76517-aa49-4690-9df4-907efc1a73bb","Type":"ContainerStarted","Data":"c70a8c9878782668319a06b43eb900c2ef041e436452b0c84a083873010ffb69"}
Sep 19 10:38:01.649097 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.649069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f" event={"ID":"af834c89-5417-44da-ab71-88f4a9bca93c","Type":"ContainerStarted","Data":"31bd0f3913cb8457cf875be48168817868301fcad46d4286b852298b7c07e16e"}
Sep 19 10:38:01.651037 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.651015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-7x6mm" event={"ID":"657de118-63a3-48a5-a1ae-732a7f1eabef","Type":"ContainerStarted","Data":"4865d9c66502ae3308e2dd2744371a38a6f7e53df4039997f37cb8f8bf79f30c"}
Sep 19 10:38:01.651287 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.651266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-7x6mm"
Sep 19 10:38:01.654202 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.654173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txvkd" event={"ID":"7d00e0c2-7919-4740-939b-f3dbf8380733","Type":"ContainerStarted","Data":"ddef09e68e9c4cd493bca788d071c48dd76013c5fffd94665f4dd97ea3f34d34"}
Sep 19 10:38:01.657332 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.657309    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-7x6mm"
Sep 19 10:38:01.660414 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.660377    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-svp4v" podStartSLOduration=70.096140709 podStartE2EDuration="1m23.660364516s" totalImagesPullingTime="13.564223807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:01.659899831 +0000 UTC m=+85.593606067" watchObservedRunningTime="2026-09-19 10:38:01.660364516 +0000 UTC m=+85.594070730"
Sep 19 10:38:01.672479 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.672450    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7744689dd4-n8qwn"]
Sep 19 10:38:01.678347 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.678293    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-7x6mm" podStartSLOduration=1.681397358 podStartE2EDuration="20.67827605s" totalImagesPullingTime="18.996878692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:01.677155633 +0000 UTC m=+85.610861876" watchObservedRunningTime="2026-09-19 10:38:01.67827605 +0000 UTC m=+85.611982261"
Sep 19 10:38:01.700001 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.699673    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m94pc" podStartSLOduration=70.135237736 podStartE2EDuration="1m23.699652194s" totalImagesPullingTime="13.564414458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:01.698398736 +0000 UTC m=+85.632105003" watchObservedRunningTime="2026-09-19 10:38:01.699652194 +0000 UTC m=+85.633358411"
Sep 19 10:38:01.715199 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:01.715142    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-txvkd" podStartSLOduration=34.25335879 podStartE2EDuration="46.715125445s" totalImagesPullingTime="12.461766655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:37:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:01.713776586 +0000 UTC m=+85.647482823" watchObservedRunningTime="2026-09-19 10:38:01.715125445 +0000 UTC m=+85.648831659"
Sep 19 10:38:03.545879 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:03.545479    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79c94b8b8b-psgnl"
Sep 19 10:38:03.666309 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:03.666270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f" event={"ID":"af834c89-5417-44da-ab71-88f4a9bca93c","Type":"ContainerStarted","Data":"dffbed16b68cc790bb803063ae6c610e7e1d98d11db54d2776708ee46e5ce6a6"}
Sep 19 10:38:03.666468 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:03.666329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f" event={"ID":"af834c89-5417-44da-ab71-88f4a9bca93c","Type":"ContainerStarted","Data":"d75f2a1df09cdd5425a94c3c9faf4b5e7c215b208be5bb547b8f43e99eca7180"}
Sep 19 10:38:03.682777 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:03.682722    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-zh29f" podStartSLOduration=11.640640872 podStartE2EDuration="13.682701478s" totalImagesPullingTime="2.042060606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:03.681150819 +0000 UTC m=+87.614857090" watchObservedRunningTime="2026-09-19 10:38:03.682701478 +0000 UTC m=+87.616407693"
Sep 19 10:38:05.857822 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.857771    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"]
Sep 19 10:38:05.904567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.903262    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"]
Sep 19 10:38:05.904567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.903324    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"]
Sep 19 10:38:05.904567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.903671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:05.918408 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.911986    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 19 10:38:05.918408 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.912913    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2tzcq\""
Sep 19 10:38:05.919526 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.919505    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 19 10:38:05.934604 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.933150    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"]
Sep 19 10:38:05.934604 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.933203    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5v7jl"]
Sep 19 10:38:05.934604 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.933346    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:05.939735 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.938098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 19 10:38:05.939735 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.938291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 19 10:38:05.939735 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.938449    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-w4t54\""
Sep 19 10:38:05.941040 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.940169    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 19 10:38:05.970494 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.970470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:05.974630 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.974564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 19 10:38:05.975859 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.974628    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 19 10:38:05.975859 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.974677    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 19 10:38:05.976007 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:05.974692    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c42jv\""
Sep 19 10:38:06.012284 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/74a8663e-3d20-4970-a20a-86e9561096e6-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.012459 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d67d6bb5-14af-4b45-869d-b885e38baf50-root\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.012459 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjs78\" (UniqueName: \"kubernetes.io/projected/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-kube-api-access-bjs78\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.012459 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-accelerators-collector-config\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.012459 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d67d6bb5-14af-4b45-869d-b885e38baf50-sys\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.012459 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.012459 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-tls\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.012459 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a8663e-3d20-4970-a20a-86e9561096e6-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d67d6bb5-14af-4b45-869d-b885e38baf50-metrics-client-ca\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/74a8663e-3d20-4970-a20a-86e9561096e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-textfile\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wmjv\" (UniqueName: \"kubernetes.io/projected/d67d6bb5-14af-4b45-869d-b885e38baf50-kube-api-access-8wmjv\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74a8663e-3d20-4970-a20a-86e9561096e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-wtmp\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74a8663e-3d20-4970-a20a-86e9561096e6-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.012814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.012805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhmmn\" (UniqueName: \"kubernetes.io/projected/74a8663e-3d20-4970-a20a-86e9561096e6-kube-api-access-xhmmn\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-wtmp\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74a8663e-3d20-4970-a20a-86e9561096e6-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhmmn\" (UniqueName: \"kubernetes.io/projected/74a8663e-3d20-4970-a20a-86e9561096e6-kube-api-access-xhmmn\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/74a8663e-3d20-4970-a20a-86e9561096e6-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d67d6bb5-14af-4b45-869d-b885e38baf50-root\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjs78\" (UniqueName: \"kubernetes.io/projected/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-kube-api-access-bjs78\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-accelerators-collector-config\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d67d6bb5-14af-4b45-869d-b885e38baf50-sys\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-tls\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.115969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a8663e-3d20-4970-a20a-86e9561096e6-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.116008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d67d6bb5-14af-4b45-869d-b885e38baf50-metrics-client-ca\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.116052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/74a8663e-3d20-4970-a20a-86e9561096e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.116092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-textfile\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.116130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.118519 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.116156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.116194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.116222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wmjv\" (UniqueName: \"kubernetes.io/projected/d67d6bb5-14af-4b45-869d-b885e38baf50-kube-api-access-8wmjv\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.116244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74a8663e-3d20-4970-a20a-86e9561096e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.116714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-wtmp\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:38:06.117178    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:38:06.117246    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-tls podName:d67d6bb5-14af-4b45-869d-b885e38baf50 nodeName:}" failed. No retries permitted until 2026-09-19 10:38:06.617225837 +0000 UTC m=+90.550932046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-tls") pod "node-exporter-5v7jl" (UID: "d67d6bb5-14af-4b45-869d-b885e38baf50") : secret "node-exporter-tls" not found
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.117714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74a8663e-3d20-4970-a20a-86e9561096e6-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.117801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/74a8663e-3d20-4970-a20a-86e9561096e6-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.117862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d67d6bb5-14af-4b45-869d-b885e38baf50-root\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.118661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-accelerators-collector-config\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.119423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.118729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d67d6bb5-14af-4b45-869d-b885e38baf50-sys\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.119987 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.119446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.122322 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.120643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/74a8663e-3d20-4970-a20a-86e9561096e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.122322 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.121088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d67d6bb5-14af-4b45-869d-b885e38baf50-metrics-client-ca\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.122322 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.121325    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-textfile\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.128218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.128186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjs78\" (UniqueName: \"kubernetes.io/projected/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-kube-api-access-bjs78\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.128961 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.128939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhmmn\" (UniqueName: \"kubernetes.io/projected/74a8663e-3d20-4970-a20a-86e9561096e6-kube-api-access-xhmmn\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.131389 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.131346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.136654 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.132995    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wmjv\" (UniqueName: \"kubernetes.io/projected/d67d6bb5-14af-4b45-869d-b885e38baf50-kube-api-access-8wmjv\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.136654 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.133423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a8663e-3d20-4970-a20a-86e9561096e6-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.136654 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.133770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74a8663e-3d20-4970-a20a-86e9561096e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mcn4m\" (UID: \"74a8663e-3d20-4970-a20a-86e9561096e6\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.136654 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.134019    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.136654 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.134330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/268ecc34-0d8b-4d27-95e8-850fab8fe9f0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-dvld4\" (UID: \"268ecc34-0d8b-4d27-95e8-850fab8fe9f0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.223451 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.223413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"
Sep 19 10:38:06.253276 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.253237    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"
Sep 19 10:38:06.543224 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.543149    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4"]
Sep 19 10:38:06.546498 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:38:06.546470    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268ecc34_0d8b_4d27_95e8_850fab8fe9f0.slice/crio-46c457a08e3ecc01aafa9c4eceb2ba64712e75771e14085e101aaa3ae9ebc6f5 WatchSource:0}: Error finding container 46c457a08e3ecc01aafa9c4eceb2ba64712e75771e14085e101aaa3ae9ebc6f5: Status 404 returned error can't find the container with id 46c457a08e3ecc01aafa9c4eceb2ba64712e75771e14085e101aaa3ae9ebc6f5
Sep 19 10:38:06.586767 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.585083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mcn4m"]
Sep 19 10:38:06.590214 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:38:06.590175    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a8663e_3d20_4970_a20a_86e9561096e6.slice/crio-4e37de63fe026748002666177d573070dcb64721610a4de167955a8adbe45e87 WatchSource:0}: Error finding container 4e37de63fe026748002666177d573070dcb64721610a4de167955a8adbe45e87: Status 404 returned error can't find the container with id 4e37de63fe026748002666177d573070dcb64721610a4de167955a8adbe45e87
Sep 19 10:38:06.631489 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.631455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-tls\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.634218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.634190    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d67d6bb5-14af-4b45-869d-b885e38baf50-node-exporter-tls\") pod \"node-exporter-5v7jl\" (UID: \"d67d6bb5-14af-4b45-869d-b885e38baf50\") " pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.680636 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.680596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m" event={"ID":"74a8663e-3d20-4970-a20a-86e9561096e6","Type":"ContainerStarted","Data":"4e37de63fe026748002666177d573070dcb64721610a4de167955a8adbe45e87"}
Sep 19 10:38:06.682606 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.682579    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4" event={"ID":"268ecc34-0d8b-4d27-95e8-850fab8fe9f0","Type":"ContainerStarted","Data":"6e7443b862a09143d20f149ce9bbfefca6023575c49f76b2a05460d17cfba0f9"}
Sep 19 10:38:06.682738 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.682642    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4" event={"ID":"268ecc34-0d8b-4d27-95e8-850fab8fe9f0","Type":"ContainerStarted","Data":"46c457a08e3ecc01aafa9c4eceb2ba64712e75771e14085e101aaa3ae9ebc6f5"}
Sep 19 10:38:06.885892 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:06.884872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5v7jl"
Sep 19 10:38:06.911278 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:38:06.911243    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67d6bb5_14af_4b45_869d_b885e38baf50.slice/crio-4972fdfc0b6a68d92bb7ee7aedda639a6ec6990fb082fda7a1a96278c401ec3e WatchSource:0}: Error finding container 4972fdfc0b6a68d92bb7ee7aedda639a6ec6990fb082fda7a1a96278c401ec3e: Status 404 returned error can't find the container with id 4972fdfc0b6a68d92bb7ee7aedda639a6ec6990fb082fda7a1a96278c401ec3e
Sep 19 10:38:07.694315 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:07.694212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4" event={"ID":"268ecc34-0d8b-4d27-95e8-850fab8fe9f0","Type":"ContainerStarted","Data":"c95ac90b06d637f0eb07cf3a77b0a467912732e31fc42e8e0d9721d1277f7013"}
Sep 19 10:38:07.696245 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:07.696159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v7jl" event={"ID":"d67d6bb5-14af-4b45-869d-b885e38baf50","Type":"ContainerStarted","Data":"4972fdfc0b6a68d92bb7ee7aedda639a6ec6990fb082fda7a1a96278c401ec3e"}
Sep 19 10:38:10.120468 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.120431    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c9766869-7j5kc"]
Sep 19 10:38:10.135647 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.135613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c9766869-7j5kc"]
Sep 19 10:38:10.135874 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.135820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.138434 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.138411    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 19 10:38:10.139046 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.139028    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-w27nt\""
Sep 19 10:38:10.139321 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.139304    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 19 10:38:10.141058 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.139522    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-602r423as8eui\""
Sep 19 10:38:10.141058 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.139742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 19 10:38:10.141058 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.139829    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 10:38:10.267943 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.267846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1cc8a5-a918-45c2-8822-739df8bf9f38-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.267943 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.267906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da1cc8a5-a918-45c2-8822-739df8bf9f38-client-ca-bundle\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.268147 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.267954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkxm5\" (UniqueName: \"kubernetes.io/projected/da1cc8a5-a918-45c2-8822-739df8bf9f38-kube-api-access-wkxm5\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.268147 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.268047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/da1cc8a5-a918-45c2-8822-739df8bf9f38-secret-metrics-server-tls\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.268147 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.268088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/da1cc8a5-a918-45c2-8822-739df8bf9f38-secret-metrics-server-client-certs\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.268147 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.268116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/da1cc8a5-a918-45c2-8822-739df8bf9f38-metrics-server-audit-profiles\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.268337 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.268244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/da1cc8a5-a918-45c2-8822-739df8bf9f38-audit-log\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.369123 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.369080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/da1cc8a5-a918-45c2-8822-739df8bf9f38-secret-metrics-server-tls\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.369316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.369135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/da1cc8a5-a918-45c2-8822-739df8bf9f38-secret-metrics-server-client-certs\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.369316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.369159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/da1cc8a5-a918-45c2-8822-739df8bf9f38-metrics-server-audit-profiles\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.369316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.369198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/da1cc8a5-a918-45c2-8822-739df8bf9f38-audit-log\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.369316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.369224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1cc8a5-a918-45c2-8822-739df8bf9f38-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.369316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.369290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da1cc8a5-a918-45c2-8822-739df8bf9f38-client-ca-bundle\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.369591 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.369331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkxm5\" (UniqueName: \"kubernetes.io/projected/da1cc8a5-a918-45c2-8822-739df8bf9f38-kube-api-access-wkxm5\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.369761 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.369726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/da1cc8a5-a918-45c2-8822-739df8bf9f38-audit-log\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.370132 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.370108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1cc8a5-a918-45c2-8822-739df8bf9f38-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.370355 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.370334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/da1cc8a5-a918-45c2-8822-739df8bf9f38-metrics-server-audit-profiles\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.371772 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.371746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da1cc8a5-a918-45c2-8822-739df8bf9f38-client-ca-bundle\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.371864 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.371782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/da1cc8a5-a918-45c2-8822-739df8bf9f38-secret-metrics-server-tls\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.371864 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.371800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/da1cc8a5-a918-45c2-8822-739df8bf9f38-secret-metrics-server-client-certs\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.376620 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.376593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkxm5\" (UniqueName: \"kubernetes.io/projected/da1cc8a5-a918-45c2-8822-739df8bf9f38-kube-api-access-wkxm5\") pod \"metrics-server-6c9766869-7j5kc\" (UID: \"da1cc8a5-a918-45c2-8822-739df8bf9f38\") " pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.449460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.449423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:10.663766 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.663736    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-644cb7d875-t7kvm"]
Sep 19 10:38:10.688460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.688427    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644cb7d875-t7kvm"]
Sep 19 10:38:10.688621 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.688573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.695763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.695736    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 19 10:38:10.715696 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.715665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m" event={"ID":"74a8663e-3d20-4970-a20a-86e9561096e6","Type":"ContainerStarted","Data":"805e3309bc5e79238495f2bc875d71c8a8347b5bab5ab7a338c2618046815721"}
Sep 19 10:38:10.715850 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.715741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m" event={"ID":"74a8663e-3d20-4970-a20a-86e9561096e6","Type":"ContainerStarted","Data":"9b65145007ec0f7a9f221504db1e60816f2e6378c341a3b58a4b356f7f107012"}
Sep 19 10:38:10.715850 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.715760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m" event={"ID":"74a8663e-3d20-4970-a20a-86e9561096e6","Type":"ContainerStarted","Data":"470a0ee24a650c3aaef2906b686ed8bd868edbea06ff8588cdeb4a37208d8b32"}
Sep 19 10:38:10.718110 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.718081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4" event={"ID":"268ecc34-0d8b-4d27-95e8-850fab8fe9f0","Type":"ContainerStarted","Data":"99aa6ffca9aa0a9821faa39506b624f4edb298f0da5e868118c92e60edc6f079"}
Sep 19 10:38:10.719846 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.719823    2563 generic.go:356] "Generic (PLEG): container finished" podID="d67d6bb5-14af-4b45-869d-b885e38baf50" containerID="767f2a53a5574ccacfb199d6033ab3657c905b410fd7464e4fe1ce67ca87f607" exitCode=0
Sep 19 10:38:10.719951 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.719890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v7jl" event={"ID":"d67d6bb5-14af-4b45-869d-b885e38baf50","Type":"ContainerDied","Data":"767f2a53a5574ccacfb199d6033ab3657c905b410fd7464e4fe1ce67ca87f607"}
Sep 19 10:38:10.733776 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.733734    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-mcn4m" podStartSLOduration=2.68112132 podStartE2EDuration="5.733717228s" totalImagesPullingTime="3.052595908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:10.731971606 +0000 UTC m=+94.665677821" watchObservedRunningTime="2026-09-19 10:38:10.733717228 +0000 UTC m=+94.667423433"
Sep 19 10:38:10.747298 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.747272    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c9766869-7j5kc"]
Sep 19 10:38:10.750075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.750031    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-dvld4" podStartSLOduration=2.9335725249999998 podStartE2EDuration="5.750016353s" totalImagesPullingTime="2.816443828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:10.748602251 +0000 UTC m=+94.682308491" watchObservedRunningTime="2026-09-19 10:38:10.750016353 +0000 UTC m=+94.683722566"
Sep 19 10:38:10.750762 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:38:10.750739    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1cc8a5_a918_45c2_8822_739df8bf9f38.slice/crio-5dae58bc5c60707bd310631ec18be3508b5f3451ff7da456b8f625124f5b1d02 WatchSource:0}: Error finding container 5dae58bc5c60707bd310631ec18be3508b5f3451ff7da456b8f625124f5b1d02: Status 404 returned error can't find the container with id 5dae58bc5c60707bd310631ec18be3508b5f3451ff7da456b8f625124f5b1d02
Sep 19 10:38:10.772645 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.772619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-config\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.772791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.772654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-trusted-ca-bundle\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.772791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.772682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-serving-cert\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.772791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.772748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-oauth-serving-cert\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.772928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.772816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-oauth-config\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.772928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.772859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-service-ca\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.773038 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.772952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmvlb\" (UniqueName: \"kubernetes.io/projected/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-kube-api-access-qmvlb\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.873529 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.873501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmvlb\" (UniqueName: \"kubernetes.io/projected/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-kube-api-access-qmvlb\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.873963 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.873910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-config\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.873963 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.873952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-trusted-ca-bundle\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.874140 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.873985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-serving-cert\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.874140 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.874042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-oauth-serving-cert\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.874242 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.874131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-oauth-config\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.874242 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.874184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-service-ca\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.874857 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.874665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-config\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.874957 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.874926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-oauth-serving-cert\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.874957 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.874953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-trusted-ca-bundle\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.875212 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.875193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-service-ca\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.877052 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.877028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-oauth-config\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.877149 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.877038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-serving-cert\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.880826 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.880805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmvlb\" (UniqueName: \"kubernetes.io/projected/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-kube-api-access-qmvlb\") pod \"console-644cb7d875-t7kvm\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") " pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:10.999309 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:10.999267    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:11.283370 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:11.283345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644cb7d875-t7kvm"]
Sep 19 10:38:11.285652 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:38:11.285623    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6b6135_dacc_47ba_ad1f_1c9d9a52a1a3.slice/crio-b569629a8be39337aa803e00ed8b7aaab021ff1cdfb38440f7bfaf01a81bd77b WatchSource:0}: Error finding container b569629a8be39337aa803e00ed8b7aaab021ff1cdfb38440f7bfaf01a81bd77b: Status 404 returned error can't find the container with id b569629a8be39337aa803e00ed8b7aaab021ff1cdfb38440f7bfaf01a81bd77b
Sep 19 10:38:11.728568 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:11.728516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v7jl" event={"ID":"d67d6bb5-14af-4b45-869d-b885e38baf50","Type":"ContainerStarted","Data":"59622148f9bd5996cbcc9654231782faa14fff5132d710f68382464578a60e38"}
Sep 19 10:38:11.728814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:11.728607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v7jl" event={"ID":"d67d6bb5-14af-4b45-869d-b885e38baf50","Type":"ContainerStarted","Data":"40c6d129b3e9ac6c2082bcef30495ef7d845388d72229bdee27f8da767232043"}
Sep 19 10:38:11.730611 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:11.730582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c9766869-7j5kc" event={"ID":"da1cc8a5-a918-45c2-8822-739df8bf9f38","Type":"ContainerStarted","Data":"5dae58bc5c60707bd310631ec18be3508b5f3451ff7da456b8f625124f5b1d02"}
Sep 19 10:38:11.732433 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:11.732407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644cb7d875-t7kvm" event={"ID":"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3","Type":"ContainerStarted","Data":"a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3"}
Sep 19 10:38:11.732572 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:11.732463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644cb7d875-t7kvm" event={"ID":"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3","Type":"ContainerStarted","Data":"b569629a8be39337aa803e00ed8b7aaab021ff1cdfb38440f7bfaf01a81bd77b"}
Sep 19 10:38:11.746163 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:11.746105    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5v7jl" podStartSLOduration=3.891243958 podStartE2EDuration="6.746083705s" totalImagesPullingTime="2.734932587s" totalInitContainerRuntime="119.90716ms" isStatefulPod=true podCreationTimestamp="2026-09-19 10:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:11.744504525 +0000 UTC m=+95.678210773" watchObservedRunningTime="2026-09-19 10:38:11.746083705 +0000 UTC m=+95.679789920"
Sep 19 10:38:11.760214 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:11.760166    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-644cb7d875-t7kvm" podStartSLOduration=1.76014517 podStartE2EDuration="1.76014517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:38:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:11.759562442 +0000 UTC m=+95.693268669" watchObservedRunningTime="2026-09-19 10:38:11.76014517 +0000 UTC m=+95.693851386"
Sep 19 10:38:13.742323 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:13.742285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c9766869-7j5kc" event={"ID":"da1cc8a5-a918-45c2-8822-739df8bf9f38","Type":"ContainerStarted","Data":"0896df569f4b74d09545270728b8cf8de066349f6ccb2cf794662fd4793caf30"}
Sep 19 10:38:15.923659 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:15.923599    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c9766869-7j5kc" podStartSLOduration=3.872837107 podStartE2EDuration="5.923580906s" totalImagesPullingTime="2.050743799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:13.759965278 +0000 UTC m=+97.693671521" watchObservedRunningTime="2026-09-19 10:38:15.923580906 +0000 UTC m=+99.857287121"
Sep 19 10:38:15.924073 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:15.923743    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644cb7d875-t7kvm"]
Sep 19 10:38:15.955386 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:15.955349    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8dff9fbcf-l6t7r"]
Sep 19 10:38:15.973692 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:15.973655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8dff9fbcf-l6t7r"]
Sep 19 10:38:15.973844 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:15.973792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.120830 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.120802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-serving-cert\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.120988 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.120839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-console-config\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.120988 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.120859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-oauth-serving-cert\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.120988 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.120938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-service-ca\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.120988 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.120967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-trusted-ca-bundle\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.121129 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.121070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bftj\" (UniqueName: \"kubernetes.io/projected/b2710b67-1c46-4550-b005-57b599545168-kube-api-access-4bftj\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.121129 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.121108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-oauth-config\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.222343 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.222244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-oauth-config\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.222343 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.222305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-serving-cert\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.222343 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.222335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-console-config\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.222624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.222359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-oauth-serving-cert\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.222624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.222397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-service-ca\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.222624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.222537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-trusted-ca-bundle\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.222779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.222641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bftj\" (UniqueName: \"kubernetes.io/projected/b2710b67-1c46-4550-b005-57b599545168-kube-api-access-4bftj\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.223220 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.223199    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-service-ca\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.223315 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.223223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-console-config\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.223511 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.223488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-trusted-ca-bundle\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.223583 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.223540    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-oauth-serving-cert\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.224892 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.224874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-serving-cert\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.225071 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.225053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-oauth-config\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.230473 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.230444    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bftj\" (UniqueName: \"kubernetes.io/projected/b2710b67-1c46-4550-b005-57b599545168-kube-api-access-4bftj\") pod \"console-8dff9fbcf-l6t7r\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") " pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.285478 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.285437    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:16.603538 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.603499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8dff9fbcf-l6t7r"]
Sep 19 10:38:16.759488 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.759458    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8dff9fbcf-l6t7r" event={"ID":"b2710b67-1c46-4550-b005-57b599545168","Type":"ContainerStarted","Data":"af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c"}
Sep 19 10:38:16.759662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.759504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8dff9fbcf-l6t7r" event={"ID":"b2710b67-1c46-4550-b005-57b599545168","Type":"ContainerStarted","Data":"a7b8d6c1c033818eeacfc90a982ca153e94a5e4dfaf3db5156d8afcbf0d6dee0"}
Sep 19 10:38:16.776191 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:16.776141    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8dff9fbcf-l6t7r" podStartSLOduration=1.776124094 podStartE2EDuration="1.776124094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:16.774923026 +0000 UTC m=+100.708629267" watchObservedRunningTime="2026-09-19 10:38:16.776124094 +0000 UTC m=+100.709830371"
Sep 19 10:38:21.000289 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:21.000247    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:26.285694 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:26.285658    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:26.286254 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:26.285717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:26.290746 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:26.290721    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:26.696400 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:26.696357    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7744689dd4-n8qwn" podUID="c8ce03eb-46d4-4564-ab97-01be94eba8a9" containerName="console" containerID="cri-o://f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274" gracePeriod=15
Sep 19 10:38:26.801767 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:26.801734    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:38:26.971785 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:26.971720    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:38:27.013062 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.013033    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-oauth-config\") pod \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") "
Sep 19 10:38:27.013215 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.013096    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkxtm\" (UniqueName: \"kubernetes.io/projected/c8ce03eb-46d4-4564-ab97-01be94eba8a9-kube-api-access-tkxtm\") pod \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") "
Sep 19 10:38:27.013215 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.013136    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-oauth-serving-cert\") pod \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") "
Sep 19 10:38:27.013215 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.013183    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-service-ca\") pod \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") "
Sep 19 10:38:27.013419 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.013216    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-serving-cert\") pod \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") "
Sep 19 10:38:27.013419 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.013257    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-config\") pod \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\" (UID: \"c8ce03eb-46d4-4564-ab97-01be94eba8a9\") "
Sep 19 10:38:27.013632 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.013603    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c8ce03eb-46d4-4564-ab97-01be94eba8a9" (UID: "c8ce03eb-46d4-4564-ab97-01be94eba8a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:38:27.013728 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.013706    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-config" (OuterVolumeSpecName: "console-config") pod "c8ce03eb-46d4-4564-ab97-01be94eba8a9" (UID: "c8ce03eb-46d4-4564-ab97-01be94eba8a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:38:27.013771 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.013703    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "c8ce03eb-46d4-4564-ab97-01be94eba8a9" (UID: "c8ce03eb-46d4-4564-ab97-01be94eba8a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:38:27.015582 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.015542    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c8ce03eb-46d4-4564-ab97-01be94eba8a9" (UID: "c8ce03eb-46d4-4564-ab97-01be94eba8a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:38:27.015849 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.015826    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c8ce03eb-46d4-4564-ab97-01be94eba8a9" (UID: "c8ce03eb-46d4-4564-ab97-01be94eba8a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:38:27.015898 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.015857    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ce03eb-46d4-4564-ab97-01be94eba8a9-kube-api-access-tkxtm" (OuterVolumeSpecName: "kube-api-access-tkxtm") pod "c8ce03eb-46d4-4564-ab97-01be94eba8a9" (UID: "c8ce03eb-46d4-4564-ab97-01be94eba8a9"). InnerVolumeSpecName "kube-api-access-tkxtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:38:27.113872 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.113840    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-oauth-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:27.113872 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.113871    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:27.114114 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.113885    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:27.114114 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.113911    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:27.114114 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.113925    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8ce03eb-46d4-4564-ab97-01be94eba8a9-console-oauth-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:27.114114 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.113938    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkxtm\" (UniqueName: \"kubernetes.io/projected/c8ce03eb-46d4-4564-ab97-01be94eba8a9-kube-api-access-tkxtm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:27.802482 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.802447    2563 generic.go:356] "Generic (PLEG): container finished" podID="c8ce03eb-46d4-4564-ab97-01be94eba8a9" containerID="f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274" exitCode=0
Sep 19 10:38:27.802974 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.802501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7744689dd4-n8qwn"
Sep 19 10:38:27.802974 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.802534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7744689dd4-n8qwn" event={"ID":"c8ce03eb-46d4-4564-ab97-01be94eba8a9","Type":"ContainerDied","Data":"f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274"}
Sep 19 10:38:27.802974 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.802601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7744689dd4-n8qwn" event={"ID":"c8ce03eb-46d4-4564-ab97-01be94eba8a9","Type":"ContainerDied","Data":"f74de165809e4ab0cac8b72cb29c50ca64a33afce40bc542d0aaf39a89c2813d"}
Sep 19 10:38:27.802974 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.802621    2563 scope.go:117] "RemoveContainer" containerID="f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274"
Sep 19 10:38:27.811675 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.811654    2563 scope.go:117] "RemoveContainer" containerID="f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274"
Sep 19 10:38:27.811985 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:38:27.811963    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274\": container with ID starting with f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274 not found: ID does not exist" containerID="f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274"
Sep 19 10:38:27.812059 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.811996    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274"} err="failed to get container status \"f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274\": rpc error: code = NotFound desc = could not find container \"f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274\": container with ID starting with f8c1b8371f8ada4ac375ad7ffac9f143a41bccfb3630f2139db7c31bfba6c274 not found: ID does not exist"
Sep 19 10:38:27.822442 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.822423    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7744689dd4-n8qwn"]
Sep 19 10:38:27.828438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:27.828416    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7744689dd4-n8qwn"]
Sep 19 10:38:28.117750 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:28.117713    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ce03eb-46d4-4564-ab97-01be94eba8a9" path="/var/lib/kubelet/pods/c8ce03eb-46d4-4564-ab97-01be94eba8a9/volumes"
Sep 19 10:38:30.449877 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:30.449836    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:30.450266 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:30.449901    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:32.662182 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:32.662153    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-svp4v"
Sep 19 10:38:40.942490 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:40.942427    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-644cb7d875-t7kvm" podUID="4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" containerName="console" containerID="cri-o://a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3" gracePeriod=15
Sep 19 10:38:41.221119 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.221037    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:41.320973 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.320935    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-oauth-config\") pod \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") "
Sep 19 10:38:41.320973 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.320977    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-oauth-serving-cert\") pod \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") "
Sep 19 10:38:41.321232 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.320997    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-service-ca\") pod \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") "
Sep 19 10:38:41.321232 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.321013    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmvlb\" (UniqueName: \"kubernetes.io/projected/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-kube-api-access-qmvlb\") pod \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") "
Sep 19 10:38:41.321232 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.321082    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-config\") pod \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") "
Sep 19 10:38:41.321232 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.321167    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-trusted-ca-bundle\") pod \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") "
Sep 19 10:38:41.321431 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.321239    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-serving-cert\") pod \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\" (UID: \"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3\") "
Sep 19 10:38:41.321578 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.321527    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" (UID: "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:38:41.321578 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.321541    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" (UID: "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:38:41.321764 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.321570    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-config" (OuterVolumeSpecName: "console-config") pod "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" (UID: "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:38:41.321892 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.321866    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" (UID: "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:38:41.323225 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.323205    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" (UID: "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:38:41.323344 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.323280    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" (UID: "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:38:41.323344 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.323300    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-kube-api-access-qmvlb" (OuterVolumeSpecName: "kube-api-access-qmvlb") pod "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" (UID: "4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3"). InnerVolumeSpecName "kube-api-access-qmvlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:38:41.421834 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.421798    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:41.421834 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.421826    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-oauth-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:41.421834 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.421836    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-oauth-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:41.421834 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.421845    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:41.422085 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.421854    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmvlb\" (UniqueName: \"kubernetes.io/projected/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-kube-api-access-qmvlb\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:41.422085 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.421863    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-console-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:41.422085 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.421871    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3-trusted-ca-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:38:41.859775 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.859738    2563 generic.go:356] "Generic (PLEG): container finished" podID="4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" containerID="a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3" exitCode=0
Sep 19 10:38:41.859952 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.859784    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644cb7d875-t7kvm"
Sep 19 10:38:41.859952 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.859824    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644cb7d875-t7kvm" event={"ID":"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3","Type":"ContainerDied","Data":"a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3"}
Sep 19 10:38:41.859952 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.859879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644cb7d875-t7kvm" event={"ID":"4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3","Type":"ContainerDied","Data":"b569629a8be39337aa803e00ed8b7aaab021ff1cdfb38440f7bfaf01a81bd77b"}
Sep 19 10:38:41.859952 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.859899    2563 scope.go:117] "RemoveContainer" containerID="a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3"
Sep 19 10:38:41.868585 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.868535    2563 scope.go:117] "RemoveContainer" containerID="a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3"
Sep 19 10:38:41.868839 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:38:41.868821    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3\": container with ID starting with a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3 not found: ID does not exist" containerID="a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3"
Sep 19 10:38:41.868882 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.868849    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3"} err="failed to get container status \"a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3\": rpc error: code = NotFound desc = could not find container \"a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3\": container with ID starting with a3ec054c625347225be13f17dec8f7f58a0b37ba8765f089f98c5196a4542fd3 not found: ID does not exist"
Sep 19 10:38:41.879699 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.879670    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644cb7d875-t7kvm"]
Sep 19 10:38:41.882850 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:41.882824    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-644cb7d875-t7kvm"]
Sep 19 10:38:42.116902 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:42.116828    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" path="/var/lib/kubelet/pods/4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3/volumes"
Sep 19 10:38:50.455484 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:50.455455    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:38:50.459168 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:38:50.459148    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c9766869-7j5kc"
Sep 19 10:39:31.919672 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.919636    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76c6bfdf4d-w5f5z"]
Sep 19 10:39:31.920124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.919941    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ce03eb-46d4-4564-ab97-01be94eba8a9" containerName="console"
Sep 19 10:39:31.920124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.919952    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ce03eb-46d4-4564-ab97-01be94eba8a9" containerName="console"
Sep 19 10:39:31.920124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.919966    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" containerName="console"
Sep 19 10:39:31.920124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.919971    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" containerName="console"
Sep 19 10:39:31.920124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.920038    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c6b6135-dacc-47ba-ad1f-1c9d9a52a1a3" containerName="console"
Sep 19 10:39:31.920124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.920047    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ce03eb-46d4-4564-ab97-01be94eba8a9" containerName="console"
Sep 19 10:39:31.921972 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.921949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:31.932838 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.932806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c6bfdf4d-w5f5z"]
Sep 19 10:39:31.947479 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.947449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-trusted-ca-bundle\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:31.947641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.947492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-oauth-serving-cert\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:31.947641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.947523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-config\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:31.947641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.947583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-oauth-config\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:31.947641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.947604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-service-ca\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:31.947641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.947637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-serving-cert\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:31.947823 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:31.947654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjbg7\" (UniqueName: \"kubernetes.io/projected/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-kube-api-access-bjbg7\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.048593 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.048538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-config\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.048779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.048610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-oauth-config\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.048779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.048634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-service-ca\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.048779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.048668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-serving-cert\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.048779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.048685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjbg7\" (UniqueName: \"kubernetes.io/projected/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-kube-api-access-bjbg7\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.048779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.048713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-trusted-ca-bundle\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.048779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.048751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-oauth-serving-cert\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.049397 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.049367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-config\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.049506 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.049465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-oauth-serving-cert\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.049690 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.049665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-service-ca\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.049992 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.049970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-trusted-ca-bundle\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.051303 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.051280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-serving-cert\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.051584 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.051567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-oauth-config\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.055290 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.055266    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjbg7\" (UniqueName: \"kubernetes.io/projected/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-kube-api-access-bjbg7\") pod \"console-76c6bfdf4d-w5f5z\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") " pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.231014 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.230916    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:32.498709 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:32.498686    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c6bfdf4d-w5f5z"]
Sep 19 10:39:33.058336 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:33.058306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c6bfdf4d-w5f5z" event={"ID":"1a4f9d9b-1384-4851-ba8d-44e00b7947d8","Type":"ContainerStarted","Data":"15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d"}
Sep 19 10:39:33.058700 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:33.058352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c6bfdf4d-w5f5z" event={"ID":"1a4f9d9b-1384-4851-ba8d-44e00b7947d8","Type":"ContainerStarted","Data":"2165908107d347dde719a41059ffd766fb4230234be3ffdd5d30e9fa10e19a0a"}
Sep 19 10:39:33.074002 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:33.073950    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76c6bfdf4d-w5f5z" podStartSLOduration=2.0739333 podStartE2EDuration="2.0739333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:39:33.073446531 +0000 UTC m=+177.007152762" watchObservedRunningTime="2026-09-19 10:39:33.0739333 +0000 UTC m=+177.007639514"
Sep 19 10:39:42.231208 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:42.231168    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:42.231603 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:42.231236    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:42.235842 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:42.235820    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:43.102255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:43.102224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:39:43.144678 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:39:43.144650    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8dff9fbcf-l6t7r"]
Sep 19 10:40:08.164326 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.164271    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8dff9fbcf-l6t7r" podUID="b2710b67-1c46-4550-b005-57b599545168" containerName="console" containerID="cri-o://af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c" gracePeriod=15
Sep 19 10:40:08.399345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.399319    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:40:08.554970 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.554888    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-oauth-serving-cert\") pod \"b2710b67-1c46-4550-b005-57b599545168\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") "
Sep 19 10:40:08.554970 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.554934    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-serving-cert\") pod \"b2710b67-1c46-4550-b005-57b599545168\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") "
Sep 19 10:40:08.555189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.554985    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-console-config\") pod \"b2710b67-1c46-4550-b005-57b599545168\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") "
Sep 19 10:40:08.555189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.555025    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bftj\" (UniqueName: \"kubernetes.io/projected/b2710b67-1c46-4550-b005-57b599545168-kube-api-access-4bftj\") pod \"b2710b67-1c46-4550-b005-57b599545168\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") "
Sep 19 10:40:08.555189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.555043    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-service-ca\") pod \"b2710b67-1c46-4550-b005-57b599545168\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") "
Sep 19 10:40:08.555189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.555065    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-trusted-ca-bundle\") pod \"b2710b67-1c46-4550-b005-57b599545168\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") "
Sep 19 10:40:08.555189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.555102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-oauth-config\") pod \"b2710b67-1c46-4550-b005-57b599545168\" (UID: \"b2710b67-1c46-4550-b005-57b599545168\") "
Sep 19 10:40:08.555433 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.555276    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2710b67-1c46-4550-b005-57b599545168" (UID: "b2710b67-1c46-4550-b005-57b599545168"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:40:08.555599 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.555570    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-console-config" (OuterVolumeSpecName: "console-config") pod "b2710b67-1c46-4550-b005-57b599545168" (UID: "b2710b67-1c46-4550-b005-57b599545168"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:40:08.555666 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.555597    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b2710b67-1c46-4550-b005-57b599545168" (UID: "b2710b67-1c46-4550-b005-57b599545168"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:40:08.555666 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.555618    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2710b67-1c46-4550-b005-57b599545168" (UID: "b2710b67-1c46-4550-b005-57b599545168"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:40:08.557326 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.557296    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2710b67-1c46-4550-b005-57b599545168" (UID: "b2710b67-1c46-4550-b005-57b599545168"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:40:08.557326 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.557306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2710b67-1c46-4550-b005-57b599545168-kube-api-access-4bftj" (OuterVolumeSpecName: "kube-api-access-4bftj") pod "b2710b67-1c46-4550-b005-57b599545168" (UID: "b2710b67-1c46-4550-b005-57b599545168"). InnerVolumeSpecName "kube-api-access-4bftj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:40:08.557450 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.557324    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2710b67-1c46-4550-b005-57b599545168" (UID: "b2710b67-1c46-4550-b005-57b599545168"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:40:08.655962 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.655916    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:40:08.655962 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.655956    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-console-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:40:08.655962 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.655968    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bftj\" (UniqueName: \"kubernetes.io/projected/b2710b67-1c46-4550-b005-57b599545168-kube-api-access-4bftj\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:40:08.655962 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.655977    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:40:08.656228 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.655985    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-trusted-ca-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:40:08.656228 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.655994    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2710b67-1c46-4550-b005-57b599545168-console-oauth-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:40:08.656228 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:08.656003    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2710b67-1c46-4550-b005-57b599545168-oauth-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:40:09.199981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:09.199945    2563 generic.go:356] "Generic (PLEG): container finished" podID="b2710b67-1c46-4550-b005-57b599545168" containerID="af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c" exitCode=0
Sep 19 10:40:09.199981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:09.199986    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8dff9fbcf-l6t7r"
Sep 19 10:40:09.200448 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:09.200028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8dff9fbcf-l6t7r" event={"ID":"b2710b67-1c46-4550-b005-57b599545168","Type":"ContainerDied","Data":"af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c"}
Sep 19 10:40:09.200448 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:09.200078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8dff9fbcf-l6t7r" event={"ID":"b2710b67-1c46-4550-b005-57b599545168","Type":"ContainerDied","Data":"a7b8d6c1c033818eeacfc90a982ca153e94a5e4dfaf3db5156d8afcbf0d6dee0"}
Sep 19 10:40:09.200448 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:09.200099    2563 scope.go:117] "RemoveContainer" containerID="af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c"
Sep 19 10:40:09.208784 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:09.208764    2563 scope.go:117] "RemoveContainer" containerID="af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c"
Sep 19 10:40:09.209065 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:40:09.209046    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c\": container with ID starting with af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c not found: ID does not exist" containerID="af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c"
Sep 19 10:40:09.209115 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:09.209075    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c"} err="failed to get container status \"af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c\": rpc error: code = NotFound desc = could not find container \"af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c\": container with ID starting with af8459c65a431f33daee23d07b5ce5bc40ab18bfd223f72584f715711e41620c not found: ID does not exist"
Sep 19 10:40:09.220345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:09.220315    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8dff9fbcf-l6t7r"]
Sep 19 10:40:09.222487 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:09.222463    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8dff9fbcf-l6t7r"]
Sep 19 10:40:10.117036 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:10.117005    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2710b67-1c46-4550-b005-57b599545168" path="/var/lib/kubelet/pods/b2710b67-1c46-4550-b005-57b599545168/volumes"
Sep 19 10:40:43.648467 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.648433    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"]
Sep 19 10:40:43.648988 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.648761    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2710b67-1c46-4550-b005-57b599545168" containerName="console"
Sep 19 10:40:43.648988 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.648773    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2710b67-1c46-4550-b005-57b599545168" containerName="console"
Sep 19 10:40:43.648988 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.648834    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2710b67-1c46-4550-b005-57b599545168" containerName="console"
Sep 19 10:40:43.651498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.651482    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.653747 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.653722    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 10:40:43.654643 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.654625    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 10:40:43.654757 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.654626    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rtgbv\""
Sep 19 10:40:43.661978 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.661958    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"]
Sep 19 10:40:43.723713 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.723671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.723713 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.723720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.723955 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.723810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz6fh\" (UniqueName: \"kubernetes.io/projected/e14b8217-9c49-4281-ae13-add4a43bc364-kube-api-access-lz6fh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.824538 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.824501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.824744 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.824573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.824744 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.824616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz6fh\" (UniqueName: \"kubernetes.io/projected/e14b8217-9c49-4281-ae13-add4a43bc364-kube-api-access-lz6fh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.824997 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.824973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.825072 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.824983    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.833083 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.833061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz6fh\" (UniqueName: \"kubernetes.io/projected/e14b8217-9c49-4281-ae13-add4a43bc364-kube-api-access-lz6fh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:43.961077 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:43.960997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:40:44.229459 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:44.229361    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"]
Sep 19 10:40:44.232164 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:40:44.232131    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14b8217_9c49_4281_ae13_add4a43bc364.slice/crio-a96d95d6c19351d007cf83746ffe77edd0a10fad0ea8783108b3fc615bbd24e4 WatchSource:0}: Error finding container a96d95d6c19351d007cf83746ffe77edd0a10fad0ea8783108b3fc615bbd24e4: Status 404 returned error can't find the container with id a96d95d6c19351d007cf83746ffe77edd0a10fad0ea8783108b3fc615bbd24e4
Sep 19 10:40:44.334832 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:44.334788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4" event={"ID":"e14b8217-9c49-4281-ae13-add4a43bc364","Type":"ContainerStarted","Data":"a96d95d6c19351d007cf83746ffe77edd0a10fad0ea8783108b3fc615bbd24e4"}
Sep 19 10:40:50.364705 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:50.364669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4" event={"ID":"e14b8217-9c49-4281-ae13-add4a43bc364","Type":"ContainerStarted","Data":"62b94e39ee1b25b362eb5f53bf0f8af9934aaaba939c6b2e8ce888b8565e8151"}
Sep 19 10:40:51.370091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:51.370051    2563 generic.go:356] "Generic (PLEG): container finished" podID="e14b8217-9c49-4281-ae13-add4a43bc364" containerID="62b94e39ee1b25b362eb5f53bf0f8af9934aaaba939c6b2e8ce888b8565e8151" exitCode=0
Sep 19 10:40:51.370536 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:51.370133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4" event={"ID":"e14b8217-9c49-4281-ae13-add4a43bc364","Type":"ContainerDied","Data":"62b94e39ee1b25b362eb5f53bf0f8af9934aaaba939c6b2e8ce888b8565e8151"}
Sep 19 10:40:53.380125 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:53.380089    2563 generic.go:356] "Generic (PLEG): container finished" podID="e14b8217-9c49-4281-ae13-add4a43bc364" containerID="b594e6c4373efbd97f7c5c68db799ad153cec724d83dc759d5ea73ba47afb8f0" exitCode=0
Sep 19 10:40:53.380485 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:40:53.380147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4" event={"ID":"e14b8217-9c49-4281-ae13-add4a43bc364","Type":"ContainerDied","Data":"b594e6c4373efbd97f7c5c68db799ad153cec724d83dc759d5ea73ba47afb8f0"}
Sep 19 10:41:00.413257 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:00.413226    2563 generic.go:356] "Generic (PLEG): container finished" podID="e14b8217-9c49-4281-ae13-add4a43bc364" containerID="8893ab4b5f8a092e737dcff830386cfe3f06bad5fb81b5027e5003cf70c974c2" exitCode=0
Sep 19 10:41:00.413646 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:00.413282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4" event={"ID":"e14b8217-9c49-4281-ae13-add4a43bc364","Type":"ContainerDied","Data":"8893ab4b5f8a092e737dcff830386cfe3f06bad5fb81b5027e5003cf70c974c2"}
Sep 19 10:41:01.535221 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.535195    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:41:01.681168 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.681077    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-util\") pod \"e14b8217-9c49-4281-ae13-add4a43bc364\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") "
Sep 19 10:41:01.681168 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.681149    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-bundle\") pod \"e14b8217-9c49-4281-ae13-add4a43bc364\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") "
Sep 19 10:41:01.681168 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.681168    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz6fh\" (UniqueName: \"kubernetes.io/projected/e14b8217-9c49-4281-ae13-add4a43bc364-kube-api-access-lz6fh\") pod \"e14b8217-9c49-4281-ae13-add4a43bc364\" (UID: \"e14b8217-9c49-4281-ae13-add4a43bc364\") "
Sep 19 10:41:01.681806 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.681776    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-bundle" (OuterVolumeSpecName: "bundle") pod "e14b8217-9c49-4281-ae13-add4a43bc364" (UID: "e14b8217-9c49-4281-ae13-add4a43bc364"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:01.683595 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.683567    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14b8217-9c49-4281-ae13-add4a43bc364-kube-api-access-lz6fh" (OuterVolumeSpecName: "kube-api-access-lz6fh") pod "e14b8217-9c49-4281-ae13-add4a43bc364" (UID: "e14b8217-9c49-4281-ae13-add4a43bc364"). InnerVolumeSpecName "kube-api-access-lz6fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:41:01.685446 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.685428    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-util" (OuterVolumeSpecName: "util") pod "e14b8217-9c49-4281-ae13-add4a43bc364" (UID: "e14b8217-9c49-4281-ae13-add4a43bc364"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:01.782008 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.781974    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:01.782008 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.782002    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz6fh\" (UniqueName: \"kubernetes.io/projected/e14b8217-9c49-4281-ae13-add4a43bc364-kube-api-access-lz6fh\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:01.782008 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:01.782012    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14b8217-9c49-4281-ae13-add4a43bc364-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:02.422279 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:02.422197    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4"
Sep 19 10:41:02.422444 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:02.422195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405nwz4" event={"ID":"e14b8217-9c49-4281-ae13-add4a43bc364","Type":"ContainerDied","Data":"a96d95d6c19351d007cf83746ffe77edd0a10fad0ea8783108b3fc615bbd24e4"}
Sep 19 10:41:02.422444 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:02.422321    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a96d95d6c19351d007cf83746ffe77edd0a10fad0ea8783108b3fc615bbd24e4"
Sep 19 10:41:06.549327 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.549288    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"]
Sep 19 10:41:06.549720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.549605    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14b8217-9c49-4281-ae13-add4a43bc364" containerName="util"
Sep 19 10:41:06.549720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.549620    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14b8217-9c49-4281-ae13-add4a43bc364" containerName="util"
Sep 19 10:41:06.549720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.549637    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14b8217-9c49-4281-ae13-add4a43bc364" containerName="extract"
Sep 19 10:41:06.549720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.549645    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14b8217-9c49-4281-ae13-add4a43bc364" containerName="extract"
Sep 19 10:41:06.549720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.549655    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14b8217-9c49-4281-ae13-add4a43bc364" containerName="pull"
Sep 19 10:41:06.549720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.549661    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14b8217-9c49-4281-ae13-add4a43bc364" containerName="pull"
Sep 19 10:41:06.549720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.549721    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14b8217-9c49-4281-ae13-add4a43bc364" containerName="extract"
Sep 19 10:41:06.595667 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.595632    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"]
Sep 19 10:41:06.595833 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.595731    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"
Sep 19 10:41:06.598254 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.598230    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 19 10:41:06.598422 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.598274    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 19 10:41:06.598422 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.598280    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tcbv8\""
Sep 19 10:41:06.724790 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.724752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50df14ff-6409-4a80-8a70-d08f97caeebf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlvwg\" (UID: \"50df14ff-6409-4a80-8a70-d08f97caeebf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"
Sep 19 10:41:06.724967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.724801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwtqd\" (UniqueName: \"kubernetes.io/projected/50df14ff-6409-4a80-8a70-d08f97caeebf-kube-api-access-qwtqd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlvwg\" (UID: \"50df14ff-6409-4a80-8a70-d08f97caeebf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"
Sep 19 10:41:06.826243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.826209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50df14ff-6409-4a80-8a70-d08f97caeebf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlvwg\" (UID: \"50df14ff-6409-4a80-8a70-d08f97caeebf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"
Sep 19 10:41:06.826414 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.826278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwtqd\" (UniqueName: \"kubernetes.io/projected/50df14ff-6409-4a80-8a70-d08f97caeebf-kube-api-access-qwtqd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlvwg\" (UID: \"50df14ff-6409-4a80-8a70-d08f97caeebf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"
Sep 19 10:41:06.826708 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.826682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50df14ff-6409-4a80-8a70-d08f97caeebf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlvwg\" (UID: \"50df14ff-6409-4a80-8a70-d08f97caeebf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"
Sep 19 10:41:06.838948 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.838920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwtqd\" (UniqueName: \"kubernetes.io/projected/50df14ff-6409-4a80-8a70-d08f97caeebf-kube-api-access-qwtqd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlvwg\" (UID: \"50df14ff-6409-4a80-8a70-d08f97caeebf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"
Sep 19 10:41:06.905748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:06.905710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"
Sep 19 10:41:07.200677 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:07.200648    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg"]
Sep 19 10:41:07.202775 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:41:07.202746    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50df14ff_6409_4a80_8a70_d08f97caeebf.slice/crio-b25a650c965d5225ddb1523fcf9d5aed5b62be27fa7d906a2a6e36d5b7bd1241 WatchSource:0}: Error finding container b25a650c965d5225ddb1523fcf9d5aed5b62be27fa7d906a2a6e36d5b7bd1241: Status 404 returned error can't find the container with id b25a650c965d5225ddb1523fcf9d5aed5b62be27fa7d906a2a6e36d5b7bd1241
Sep 19 10:41:07.442259 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:07.442221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg" event={"ID":"50df14ff-6409-4a80-8a70-d08f97caeebf","Type":"ContainerStarted","Data":"b25a650c965d5225ddb1523fcf9d5aed5b62be27fa7d906a2a6e36d5b7bd1241"}
Sep 19 10:41:09.453916 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:09.453820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg" event={"ID":"50df14ff-6409-4a80-8a70-d08f97caeebf","Type":"ContainerStarted","Data":"f49eb5478756d168b36e87876cc02ceade7d8053dbc31487310e9aa48ab1cfb1"}
Sep 19 10:41:09.475681 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:09.475603    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlvwg" podStartSLOduration=1.483412844 podStartE2EDuration="3.475586636s" totalImagesPullingTime="1.992173792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:09.473824923 +0000 UTC m=+273.407531159" watchObservedRunningTime="2026-09-19 10:41:09.475586636 +0000 UTC m=+273.409292850"
Sep 19 10:41:10.283285 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.283249    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"]
Sep 19 10:41:10.307423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.307394    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"]
Sep 19 10:41:10.307626 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.307521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.310611 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.310583    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rtgbv\""
Sep 19 10:41:10.311378 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.311363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 10:41:10.311457 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.311369    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 10:41:10.333268 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.333239    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wg58x"]
Sep 19 10:41:10.355487 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.355458    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wg58x"]
Sep 19 10:41:10.355674 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.355580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:10.357965 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.357939    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 19 10:41:10.358109 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.358003    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-m7wm2\""
Sep 19 10:41:10.358109 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.358003    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 19 10:41:10.456670 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.456638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2h6x\" (UniqueName: \"kubernetes.io/projected/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-kube-api-access-b2h6x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.457084 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.456726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.457084 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.456770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.457084 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.456803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2kql\" (UniqueName: \"kubernetes.io/projected/144b704f-f144-4e38-afed-c3693dfb2aae-kube-api-access-m2kql\") pod \"cert-manager-webhook-6486ffd997-wg58x\" (UID: \"144b704f-f144-4e38-afed-c3693dfb2aae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:10.457084 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.456851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/144b704f-f144-4e38-afed-c3693dfb2aae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wg58x\" (UID: \"144b704f-f144-4e38-afed-c3693dfb2aae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:10.557919 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.557834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2kql\" (UniqueName: \"kubernetes.io/projected/144b704f-f144-4e38-afed-c3693dfb2aae-kube-api-access-m2kql\") pod \"cert-manager-webhook-6486ffd997-wg58x\" (UID: \"144b704f-f144-4e38-afed-c3693dfb2aae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:10.557919 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.557878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/144b704f-f144-4e38-afed-c3693dfb2aae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wg58x\" (UID: \"144b704f-f144-4e38-afed-c3693dfb2aae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:10.557919 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.557908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2h6x\" (UniqueName: \"kubernetes.io/projected/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-kube-api-access-b2h6x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.558186 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.557956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.558186 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.557980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.558404 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.558381    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.558404 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.558399    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.565509 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.565482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/144b704f-f144-4e38-afed-c3693dfb2aae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wg58x\" (UID: \"144b704f-f144-4e38-afed-c3693dfb2aae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:10.565699 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.565681    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2h6x\" (UniqueName: \"kubernetes.io/projected/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-kube-api-access-b2h6x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.565766 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.565705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2kql\" (UniqueName: \"kubernetes.io/projected/144b704f-f144-4e38-afed-c3693dfb2aae-kube-api-access-m2kql\") pod \"cert-manager-webhook-6486ffd997-wg58x\" (UID: \"144b704f-f144-4e38-afed-c3693dfb2aae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:10.616712 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.616673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:10.674339 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.674307    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:10.903919 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.903891    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"]
Sep 19 10:41:10.906455 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:41:10.906431    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f89c9d_7a3d_4a43_a0de_fcd2bcbc9636.slice/crio-2f967cbc2bb45b13b346c5a54e77b3baac8793d5941992609acc450c2ed7b35e WatchSource:0}: Error finding container 2f967cbc2bb45b13b346c5a54e77b3baac8793d5941992609acc450c2ed7b35e: Status 404 returned error can't find the container with id 2f967cbc2bb45b13b346c5a54e77b3baac8793d5941992609acc450c2ed7b35e
Sep 19 10:41:10.964383 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:10.964361    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wg58x"]
Sep 19 10:41:10.966726 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:41:10.966702    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod144b704f_f144_4e38_afed_c3693dfb2aae.slice/crio-e5665563c7bd62649a7cc909df8ef1899f31281720f048eb6e28e4d91802b610 WatchSource:0}: Error finding container e5665563c7bd62649a7cc909df8ef1899f31281720f048eb6e28e4d91802b610: Status 404 returned error can't find the container with id e5665563c7bd62649a7cc909df8ef1899f31281720f048eb6e28e4d91802b610
Sep 19 10:41:11.464772 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:11.464737    2563 generic.go:356] "Generic (PLEG): container finished" podID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerID="bbee6c1796956f69019231dd501152ac69361d4c2c7450db7c1e7c1adbf618a3" exitCode=0
Sep 19 10:41:11.465214 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:11.464836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w" event={"ID":"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636","Type":"ContainerDied","Data":"bbee6c1796956f69019231dd501152ac69361d4c2c7450db7c1e7c1adbf618a3"}
Sep 19 10:41:11.465214 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:11.464895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w" event={"ID":"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636","Type":"ContainerStarted","Data":"2f967cbc2bb45b13b346c5a54e77b3baac8793d5941992609acc450c2ed7b35e"}
Sep 19 10:41:11.466216 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:11.466193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x" event={"ID":"144b704f-f144-4e38-afed-c3693dfb2aae","Type":"ContainerStarted","Data":"e5665563c7bd62649a7cc909df8ef1899f31281720f048eb6e28e4d91802b610"}
Sep 19 10:41:14.481499 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:14.481463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x" event={"ID":"144b704f-f144-4e38-afed-c3693dfb2aae","Type":"ContainerStarted","Data":"09ad3fbf31984b6253201e334fca3364c6559ab34070194c49a77a3fd667a620"}
Sep 19 10:41:14.481965 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:14.481606    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:14.496085 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:14.496031    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x" podStartSLOduration=1.905773426 podStartE2EDuration="4.496012735s" totalImagesPullingTime="2.590239309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:14.49535808 +0000 UTC m=+278.429064296" watchObservedRunningTime="2026-09-19 10:41:14.496012735 +0000 UTC m=+278.429718950"
Sep 19 10:41:18.503001 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:18.502966    2563 generic.go:356] "Generic (PLEG): container finished" podID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerID="49c7bab4ea0ffee1f5b6364a7018294bad336a0250d06c9d5d1d1da715af0832" exitCode=0
Sep 19 10:41:18.503362 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:18.503061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w" event={"ID":"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636","Type":"ContainerDied","Data":"49c7bab4ea0ffee1f5b6364a7018294bad336a0250d06c9d5d1d1da715af0832"}
Sep 19 10:41:19.509572 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:19.509506    2563 generic.go:356] "Generic (PLEG): container finished" podID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerID="60161c9f466f93fd6bf85a85027bce4643c20a406d97bf37d53a84f41e75d9af" exitCode=0
Sep 19 10:41:19.509949 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:19.509595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w" event={"ID":"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636","Type":"ContainerDied","Data":"60161c9f466f93fd6bf85a85027bce4643c20a406d97bf37d53a84f41e75d9af"}
Sep 19 10:41:20.488836 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.488802    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wg58x"
Sep 19 10:41:20.646522 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.646499    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:20.743794 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.743706    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-bundle\") pod \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") "
Sep 19 10:41:20.743794 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.743754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-util\") pod \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") "
Sep 19 10:41:20.744021 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.743799    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2h6x\" (UniqueName: \"kubernetes.io/projected/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-kube-api-access-b2h6x\") pod \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\" (UID: \"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636\") "
Sep 19 10:41:20.744180 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.744157    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-bundle" (OuterVolumeSpecName: "bundle") pod "a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" (UID: "a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:20.746036 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.746011    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-kube-api-access-b2h6x" (OuterVolumeSpecName: "kube-api-access-b2h6x") pod "a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" (UID: "a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636"). InnerVolumeSpecName "kube-api-access-b2h6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:41:20.748245 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.748203    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-util" (OuterVolumeSpecName: "util") pod "a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" (UID: "a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:20.844624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.844587    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2h6x\" (UniqueName: \"kubernetes.io/projected/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-kube-api-access-b2h6x\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:20.844624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.844614    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:20.844624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:20.844626    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:21.520042 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:21.520015    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w"
Sep 19 10:41:21.520042 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:21.520036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjzw9w" event={"ID":"a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636","Type":"ContainerDied","Data":"2f967cbc2bb45b13b346c5a54e77b3baac8793d5941992609acc450c2ed7b35e"}
Sep 19 10:41:21.520256 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:21.520088    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f967cbc2bb45b13b346c5a54e77b3baac8793d5941992609acc450c2ed7b35e"
Sep 19 10:41:22.224453 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.224412    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ktpps"]
Sep 19 10:41:22.224928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.224860    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerName="util"
Sep 19 10:41:22.224928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.224879    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerName="util"
Sep 19 10:41:22.224928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.224906    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerName="extract"
Sep 19 10:41:22.224928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.224914    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerName="extract"
Sep 19 10:41:22.224928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.224928    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerName="pull"
Sep 19 10:41:22.225197 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.224937    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerName="pull"
Sep 19 10:41:22.225197 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.225023    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0f89c9d-7a3d-4a43-a0de-fcd2bcbc9636" containerName="extract"
Sep 19 10:41:22.227080 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.227058    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ktpps"
Sep 19 10:41:22.229218 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.229199    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6qvr2\""
Sep 19 10:41:22.237537 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.237514    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ktpps"]
Sep 19 10:41:22.358636 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.358596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abb711c5-8851-4bdd-a2ec-ac6368f94410-bound-sa-token\") pod \"cert-manager-55b4d954d5-ktpps\" (UID: \"abb711c5-8851-4bdd-a2ec-ac6368f94410\") " pod="cert-manager/cert-manager-55b4d954d5-ktpps"
Sep 19 10:41:22.358816 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.358650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7psmf\" (UniqueName: \"kubernetes.io/projected/abb711c5-8851-4bdd-a2ec-ac6368f94410-kube-api-access-7psmf\") pod \"cert-manager-55b4d954d5-ktpps\" (UID: \"abb711c5-8851-4bdd-a2ec-ac6368f94410\") " pod="cert-manager/cert-manager-55b4d954d5-ktpps"
Sep 19 10:41:22.460053 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.460014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7psmf\" (UniqueName: \"kubernetes.io/projected/abb711c5-8851-4bdd-a2ec-ac6368f94410-kube-api-access-7psmf\") pod \"cert-manager-55b4d954d5-ktpps\" (UID: \"abb711c5-8851-4bdd-a2ec-ac6368f94410\") " pod="cert-manager/cert-manager-55b4d954d5-ktpps"
Sep 19 10:41:22.460213 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.460106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abb711c5-8851-4bdd-a2ec-ac6368f94410-bound-sa-token\") pod \"cert-manager-55b4d954d5-ktpps\" (UID: \"abb711c5-8851-4bdd-a2ec-ac6368f94410\") " pod="cert-manager/cert-manager-55b4d954d5-ktpps"
Sep 19 10:41:22.467883 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.467855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7psmf\" (UniqueName: \"kubernetes.io/projected/abb711c5-8851-4bdd-a2ec-ac6368f94410-kube-api-access-7psmf\") pod \"cert-manager-55b4d954d5-ktpps\" (UID: \"abb711c5-8851-4bdd-a2ec-ac6368f94410\") " pod="cert-manager/cert-manager-55b4d954d5-ktpps"
Sep 19 10:41:22.470761 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.470740    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abb711c5-8851-4bdd-a2ec-ac6368f94410-bound-sa-token\") pod \"cert-manager-55b4d954d5-ktpps\" (UID: \"abb711c5-8851-4bdd-a2ec-ac6368f94410\") " pod="cert-manager/cert-manager-55b4d954d5-ktpps"
Sep 19 10:41:22.536976 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.536877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ktpps"
Sep 19 10:41:22.808375 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:22.807964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ktpps"]
Sep 19 10:41:22.816765 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:41:22.816729    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabb711c5_8851_4bdd_a2ec_ac6368f94410.slice/crio-2b3a36a7f54f3848f672e35c234de99e9e1d6ca29426e4b79d9b021a35fdecda WatchSource:0}: Error finding container 2b3a36a7f54f3848f672e35c234de99e9e1d6ca29426e4b79d9b021a35fdecda: Status 404 returned error can't find the container with id 2b3a36a7f54f3848f672e35c234de99e9e1d6ca29426e4b79d9b021a35fdecda
Sep 19 10:41:23.530686 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:23.530647    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ktpps" event={"ID":"abb711c5-8851-4bdd-a2ec-ac6368f94410","Type":"ContainerStarted","Data":"45a128a5876e0b0f127fa369f84f8e13f74923e89db1b523033cacd54e10e34b"}
Sep 19 10:41:23.530686 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:23.530688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ktpps" event={"ID":"abb711c5-8851-4bdd-a2ec-ac6368f94410","Type":"ContainerStarted","Data":"2b3a36a7f54f3848f672e35c234de99e9e1d6ca29426e4b79d9b021a35fdecda"}
Sep 19 10:41:23.544487 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:23.544441    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ktpps" podStartSLOduration=1.5444272620000001 podStartE2EDuration="1.544427262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:23.544284807 +0000 UTC m=+287.477991032" watchObservedRunningTime="2026-09-19 10:41:23.544427262 +0000 UTC m=+287.478133477"
Sep 19 10:41:35.855817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.853024    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"]
Sep 19 10:41:35.857321 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.857225    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:35.859507 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.859485    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 10:41:35.859653 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.859559    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rtgbv\""
Sep 19 10:41:35.860598 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.860575    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 10:41:35.862771 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.862751    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"]
Sep 19 10:41:35.869736 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.869716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:35.869829 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.869769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlng\" (UniqueName: \"kubernetes.io/projected/db96da39-218e-40be-a578-19f4b7cc60ef-kube-api-access-jwlng\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:35.869829 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.869789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:35.971201 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.971161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:35.971400 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.971246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlng\" (UniqueName: \"kubernetes.io/projected/db96da39-218e-40be-a578-19f4b7cc60ef-kube-api-access-jwlng\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:35.971400 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.971277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:35.971626 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.971601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:35.971701 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.971650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:35.978930 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:35.978892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlng\" (UniqueName: \"kubernetes.io/projected/db96da39-218e-40be-a578-19f4b7cc60ef-kube-api-access-jwlng\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:36.168124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:36.168030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:36.439732 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:36.439694    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"]
Sep 19 10:41:36.442136 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:41:36.442106    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb96da39_218e_40be_a578_19f4b7cc60ef.slice/crio-5ff418b64c682e0be6580dbe2f41948f0bd7d4e4f1a5eab121b8d985410c2b99 WatchSource:0}: Error finding container 5ff418b64c682e0be6580dbe2f41948f0bd7d4e4f1a5eab121b8d985410c2b99: Status 404 returned error can't find the container with id 5ff418b64c682e0be6580dbe2f41948f0bd7d4e4f1a5eab121b8d985410c2b99
Sep 19 10:41:36.587837 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:36.587806    2563 generic.go:356] "Generic (PLEG): container finished" podID="db96da39-218e-40be-a578-19f4b7cc60ef" containerID="c563624893b98993117660c9d07c8eb54af36fdacfd11c1888114ddafbdad121" exitCode=0
Sep 19 10:41:36.588023 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:36.587887    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2" event={"ID":"db96da39-218e-40be-a578-19f4b7cc60ef","Type":"ContainerDied","Data":"c563624893b98993117660c9d07c8eb54af36fdacfd11c1888114ddafbdad121"}
Sep 19 10:41:36.588023 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:36.587940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2" event={"ID":"db96da39-218e-40be-a578-19f4b7cc60ef","Type":"ContainerStarted","Data":"5ff418b64c682e0be6580dbe2f41948f0bd7d4e4f1a5eab121b8d985410c2b99"}
Sep 19 10:41:37.594132 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:37.594094    2563 generic.go:356] "Generic (PLEG): container finished" podID="db96da39-218e-40be-a578-19f4b7cc60ef" containerID="efc13e917dbcc31a0933133a9df24b0c2843e5c1113b221c7a7bd24e64368726" exitCode=0
Sep 19 10:41:37.594514 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:37.594180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2" event={"ID":"db96da39-218e-40be-a578-19f4b7cc60ef","Type":"ContainerDied","Data":"efc13e917dbcc31a0933133a9df24b0c2843e5c1113b221c7a7bd24e64368726"}
Sep 19 10:41:38.034000 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:38.033929    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:41:38.034136 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:38.034071    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:41:38.041209 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:38.041181    2563 kubelet.go:1648] "Image garbage collection succeeded"
Sep 19 10:41:38.600955 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:38.600912    2563 generic.go:356] "Generic (PLEG): container finished" podID="db96da39-218e-40be-a578-19f4b7cc60ef" containerID="63b27f4e64cf4d09b93e8970fbe6296fd7655083098b6aa558c0d98a0fabed00" exitCode=0
Sep 19 10:41:38.602291 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:38.601001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2" event={"ID":"db96da39-218e-40be-a578-19f4b7cc60ef","Type":"ContainerDied","Data":"63b27f4e64cf4d09b93e8970fbe6296fd7655083098b6aa558c0d98a0fabed00"}
Sep 19 10:41:39.731621 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.731587    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:39.804418 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.804373    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-util\") pod \"db96da39-218e-40be-a578-19f4b7cc60ef\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") "
Sep 19 10:41:39.804418 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.804423    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-bundle\") pod \"db96da39-218e-40be-a578-19f4b7cc60ef\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") "
Sep 19 10:41:39.804698 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.804467    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwlng\" (UniqueName: \"kubernetes.io/projected/db96da39-218e-40be-a578-19f4b7cc60ef-kube-api-access-jwlng\") pod \"db96da39-218e-40be-a578-19f4b7cc60ef\" (UID: \"db96da39-218e-40be-a578-19f4b7cc60ef\") "
Sep 19 10:41:39.805119 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.805087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-bundle" (OuterVolumeSpecName: "bundle") pod "db96da39-218e-40be-a578-19f4b7cc60ef" (UID: "db96da39-218e-40be-a578-19f4b7cc60ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:39.806604 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.806518    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db96da39-218e-40be-a578-19f4b7cc60ef-kube-api-access-jwlng" (OuterVolumeSpecName: "kube-api-access-jwlng") pod "db96da39-218e-40be-a578-19f4b7cc60ef" (UID: "db96da39-218e-40be-a578-19f4b7cc60ef"). InnerVolumeSpecName "kube-api-access-jwlng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:41:39.809779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.809736    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-util" (OuterVolumeSpecName: "util") pod "db96da39-218e-40be-a578-19f4b7cc60ef" (UID: "db96da39-218e-40be-a578-19f4b7cc60ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:39.905674 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.905582    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:39.905674 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.905613    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db96da39-218e-40be-a578-19f4b7cc60ef-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:39.905674 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:39.905622    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwlng\" (UniqueName: \"kubernetes.io/projected/db96da39-218e-40be-a578-19f4b7cc60ef-kube-api-access-jwlng\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:40.611268 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:40.611241    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2"
Sep 19 10:41:40.611268 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:40.611254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4gm2" event={"ID":"db96da39-218e-40be-a578-19f4b7cc60ef","Type":"ContainerDied","Data":"5ff418b64c682e0be6580dbe2f41948f0bd7d4e4f1a5eab121b8d985410c2b99"}
Sep 19 10:41:40.611476 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:40.611296    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ff418b64c682e0be6580dbe2f41948f0bd7d4e4f1a5eab121b8d985410c2b99"
Sep 19 10:41:46.058495 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.058458    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"]
Sep 19 10:41:46.058981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.058757    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db96da39-218e-40be-a578-19f4b7cc60ef" containerName="extract"
Sep 19 10:41:46.058981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.058768    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="db96da39-218e-40be-a578-19f4b7cc60ef" containerName="extract"
Sep 19 10:41:46.058981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.058786    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db96da39-218e-40be-a578-19f4b7cc60ef" containerName="pull"
Sep 19 10:41:46.058981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.058792    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="db96da39-218e-40be-a578-19f4b7cc60ef" containerName="pull"
Sep 19 10:41:46.058981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.058802    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db96da39-218e-40be-a578-19f4b7cc60ef" containerName="util"
Sep 19 10:41:46.058981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.058808    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="db96da39-218e-40be-a578-19f4b7cc60ef" containerName="util"
Sep 19 10:41:46.058981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.058868    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="db96da39-218e-40be-a578-19f4b7cc60ef" containerName="extract"
Sep 19 10:41:46.061665 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.061648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.063870 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.063846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rtgbv\""
Sep 19 10:41:46.064003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.063873    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 10:41:46.064752 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.064731    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 10:41:46.073816 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.073793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"]
Sep 19 10:41:46.157515 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.157476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.157727 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.157578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.157727 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.157601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntmpg\" (UniqueName: \"kubernetes.io/projected/03f487b8-2701-4c86-a911-c55d9b8b1f3f-kube-api-access-ntmpg\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.258518 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.258481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.258518 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.258516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntmpg\" (UniqueName: \"kubernetes.io/projected/03f487b8-2701-4c86-a911-c55d9b8b1f3f-kube-api-access-ntmpg\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.258808 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.258583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.258901 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.258883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.258937 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.258912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.266599 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.266567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntmpg\" (UniqueName: \"kubernetes.io/projected/03f487b8-2701-4c86-a911-c55d9b8b1f3f-kube-api-access-ntmpg\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.370964 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.370931    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:46.643436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:46.643414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"]
Sep 19 10:41:46.645228 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:41:46.645198    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f487b8_2701_4c86_a911_c55d9b8b1f3f.slice/crio-447f2cf19ab1f0fbfc23c2efb90547c48dc55dee9f0aa52cfd3354eaaea1178f WatchSource:0}: Error finding container 447f2cf19ab1f0fbfc23c2efb90547c48dc55dee9f0aa52cfd3354eaaea1178f: Status 404 returned error can't find the container with id 447f2cf19ab1f0fbfc23c2efb90547c48dc55dee9f0aa52cfd3354eaaea1178f
Sep 19 10:41:47.648983 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:47.648939    2563 generic.go:356] "Generic (PLEG): container finished" podID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerID="70c0045aa525b9e9ff9b5bcc3ab3cf54557977b6af3b759cd838676554fe1680" exitCode=0
Sep 19 10:41:47.649421 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:47.649039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr" event={"ID":"03f487b8-2701-4c86-a911-c55d9b8b1f3f","Type":"ContainerDied","Data":"70c0045aa525b9e9ff9b5bcc3ab3cf54557977b6af3b759cd838676554fe1680"}
Sep 19 10:41:47.649421 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:47.649099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr" event={"ID":"03f487b8-2701-4c86-a911-c55d9b8b1f3f","Type":"ContainerStarted","Data":"447f2cf19ab1f0fbfc23c2efb90547c48dc55dee9f0aa52cfd3354eaaea1178f"}
Sep 19 10:41:47.649491 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:47.649477    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 10:41:48.286424 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.284308    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"]
Sep 19 10:41:48.289080 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.289055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.292169 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.292147    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zrzqf\""
Sep 19 10:41:48.292451 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.292412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 19 10:41:48.292631 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.292589    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 19 10:41:48.292872 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.292845    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 19 10:41:48.292983 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.292964    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 19 10:41:48.304986 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.304942    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"]
Sep 19 10:41:48.375686 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.375656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.375867 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.375708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-manifests\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.375867 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.375775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.375867 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.375821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74dz4\" (UniqueName: \"kubernetes.io/projected/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-kube-api-access-74dz4\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.375867 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.375843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-tmp\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.476535 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.476439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.476535 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.476498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-manifests\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.476535 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.476529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.476824 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.476574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74dz4\" (UniqueName: \"kubernetes.io/projected/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-kube-api-access-74dz4\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.476824 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.476595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-tmp\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.477118 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.477091    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-manifests\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.478846 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.478824    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-tmp\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.478973 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.478957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.479154 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.479135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.484869 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.484844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74dz4\" (UniqueName: \"kubernetes.io/projected/4a8f1e93-960d-4bf7-8dd9-70a3e20720c0-kube-api-access-74dz4\") pod \"opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4\" (UID: \"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0\") " pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.600700 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.600664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:48.659210 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.659175    2563 generic.go:356] "Generic (PLEG): container finished" podID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerID="d29b5db3d0b6d8e3b659764fa617cda52db3117f55eb46c1c3701b975b7054c1" exitCode=0
Sep 19 10:41:48.659635 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.659250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr" event={"ID":"03f487b8-2701-4c86-a911-c55d9b8b1f3f","Type":"ContainerDied","Data":"d29b5db3d0b6d8e3b659764fa617cda52db3117f55eb46c1c3701b975b7054c1"}
Sep 19 10:41:48.878366 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:48.878333    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"]
Sep 19 10:41:48.881436 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:41:48.881411    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8f1e93_960d_4bf7_8dd9_70a3e20720c0.slice/crio-b7fcb19bbf29e222c7c47012085dde22938be79830b77b2dd86750b1cafc07d0 WatchSource:0}: Error finding container b7fcb19bbf29e222c7c47012085dde22938be79830b77b2dd86750b1cafc07d0: Status 404 returned error can't find the container with id b7fcb19bbf29e222c7c47012085dde22938be79830b77b2dd86750b1cafc07d0
Sep 19 10:41:49.668306 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:49.668226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4" event={"ID":"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0","Type":"ContainerStarted","Data":"b7fcb19bbf29e222c7c47012085dde22938be79830b77b2dd86750b1cafc07d0"}
Sep 19 10:41:49.670993 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:49.670961    2563 generic.go:356] "Generic (PLEG): container finished" podID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerID="1f0d2aba58957177299dce5f67e50b5fa445c4f476b0d0bddcad4b1a8516ccf1" exitCode=0
Sep 19 10:41:49.671152 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:49.671071    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr" event={"ID":"03f487b8-2701-4c86-a911-c55d9b8b1f3f","Type":"ContainerDied","Data":"1f0d2aba58957177299dce5f67e50b5fa445c4f476b0d0bddcad4b1a8516ccf1"}
Sep 19 10:41:51.733667 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.733638    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:51.805856 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.805826    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-bundle\") pod \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") "
Sep 19 10:41:51.805967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.805916    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntmpg\" (UniqueName: \"kubernetes.io/projected/03f487b8-2701-4c86-a911-c55d9b8b1f3f-kube-api-access-ntmpg\") pod \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") "
Sep 19 10:41:51.806010 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.806001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-util\") pod \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\" (UID: \"03f487b8-2701-4c86-a911-c55d9b8b1f3f\") "
Sep 19 10:41:51.806773 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.806743    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-bundle" (OuterVolumeSpecName: "bundle") pod "03f487b8-2701-4c86-a911-c55d9b8b1f3f" (UID: "03f487b8-2701-4c86-a911-c55d9b8b1f3f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:51.808069 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.808036    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03f487b8-2701-4c86-a911-c55d9b8b1f3f-kube-api-access-ntmpg" (OuterVolumeSpecName: "kube-api-access-ntmpg") pod "03f487b8-2701-4c86-a911-c55d9b8b1f3f" (UID: "03f487b8-2701-4c86-a911-c55d9b8b1f3f"). InnerVolumeSpecName "kube-api-access-ntmpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:41:51.811435 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.811414    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-util" (OuterVolumeSpecName: "util") pod "03f487b8-2701-4c86-a911-c55d9b8b1f3f" (UID: "03f487b8-2701-4c86-a911-c55d9b8b1f3f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:51.907146 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.907115    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntmpg\" (UniqueName: \"kubernetes.io/projected/03f487b8-2701-4c86-a911-c55d9b8b1f3f-kube-api-access-ntmpg\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:51.907146 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.907141    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:51.907146 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:51.907152    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03f487b8-2701-4c86-a911-c55d9b8b1f3f-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:41:52.689538 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:52.689504    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr"
Sep 19 10:41:52.689538 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:52.689520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0htjzr" event={"ID":"03f487b8-2701-4c86-a911-c55d9b8b1f3f","Type":"ContainerDied","Data":"447f2cf19ab1f0fbfc23c2efb90547c48dc55dee9f0aa52cfd3354eaaea1178f"}
Sep 19 10:41:52.689793 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:52.689580    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="447f2cf19ab1f0fbfc23c2efb90547c48dc55dee9f0aa52cfd3354eaaea1178f"
Sep 19 10:41:52.691231 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:52.691203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4" event={"ID":"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0","Type":"ContainerStarted","Data":"b7a87ef660edb8c61b4280fc1ec59514f55e5f5714a2ab5b30c1de7587ca77d4"}
Sep 19 10:41:53.700006 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:53.699972    2563 generic.go:356] "Generic (PLEG): container finished" podID="4a8f1e93-960d-4bf7-8dd9-70a3e20720c0" containerID="b7a87ef660edb8c61b4280fc1ec59514f55e5f5714a2ab5b30c1de7587ca77d4" exitCode=0
Sep 19 10:41:53.700413 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:53.700052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4" event={"ID":"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0","Type":"ContainerDied","Data":"b7a87ef660edb8c61b4280fc1ec59514f55e5f5714a2ab5b30c1de7587ca77d4"}
Sep 19 10:41:54.706914 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:54.706878    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4" event={"ID":"4a8f1e93-960d-4bf7-8dd9-70a3e20720c0","Type":"ContainerStarted","Data":"f5751a99a35b79bb88468dfbf939d70818c032fd02f368e52618b5b03d87d2f6"}
Sep 19 10:41:54.707303 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:54.707104    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:41:54.725634 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:41:54.725575    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4" podStartSLOduration=2.431678025 podStartE2EDuration="6.725529483s" totalImagesPullingTime="3.194416661s" totalInitContainerRuntime="1.099434797s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:54.724532094 +0000 UTC m=+318.658238357" watchObservedRunningTime="2026-09-19 10:41:54.725529483 +0000 UTC m=+318.659235697"
Sep 19 10:42:05.713624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:05.713593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4"
Sep 19 10:42:07.806361 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.806306    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"]
Sep 19 10:42:07.806748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.806646    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerName="util"
Sep 19 10:42:07.806748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.806659    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerName="util"
Sep 19 10:42:07.806748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.806671    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerName="pull"
Sep 19 10:42:07.806748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.806677    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerName="pull"
Sep 19 10:42:07.806748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.806689    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerName="extract"
Sep 19 10:42:07.806748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.806697    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerName="extract"
Sep 19 10:42:07.806966 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.806784    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03f487b8-2701-4c86-a911-c55d9b8b1f3f" containerName="extract"
Sep 19 10:42:07.811851 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.811829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:07.814938 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.814914    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 19 10:42:07.814938 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.814927    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sm98g\""
Sep 19 10:42:07.815164 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.814961    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 19 10:42:07.815164 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.814974    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 19 10:42:07.815164 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.814991    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 19 10:42:07.815164 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.814911    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 19 10:42:07.818407 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.818384    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"]
Sep 19 10:42:07.949223 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.949181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-manager-config\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:07.949386 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.949241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-metrics-cert\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:07.949386 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.949278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-cert\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:07.949386 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:07.949336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjddk\" (UniqueName: \"kubernetes.io/projected/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-kube-api-access-hjddk\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.050201 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.050164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjddk\" (UniqueName: \"kubernetes.io/projected/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-kube-api-access-hjddk\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.050201 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.050211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-manager-config\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.050401 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.050337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-metrics-cert\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.050401 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.050383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-cert\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.050878 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.050859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-manager-config\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.052888 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.052867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-metrics-cert\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.052998 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.052950    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-cert\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.057494 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.057453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjddk\" (UniqueName: \"kubernetes.io/projected/bf57dea6-49e2-4b5f-9210-c42f5b283ac2-kube-api-access-hjddk\") pod \"lws-controller-manager-749b85b68c-fgz45\" (UID: \"bf57dea6-49e2-4b5f-9210-c42f5b283ac2\") " pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.122131 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.122103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:08.395008 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.394982    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"]
Sep 19 10:42:08.397774 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:42:08.397737    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf57dea6_49e2_4b5f_9210_c42f5b283ac2.slice/crio-5b91ffe84c302c45dc3b32bcf2382e4cc5224ea08a5d15afde374e26c50a4b02 WatchSource:0}: Error finding container 5b91ffe84c302c45dc3b32bcf2382e4cc5224ea08a5d15afde374e26c50a4b02: Status 404 returned error can't find the container with id 5b91ffe84c302c45dc3b32bcf2382e4cc5224ea08a5d15afde374e26c50a4b02
Sep 19 10:42:08.772614 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:08.772516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45" event={"ID":"bf57dea6-49e2-4b5f-9210-c42f5b283ac2","Type":"ContainerStarted","Data":"5b91ffe84c302c45dc3b32bcf2382e4cc5224ea08a5d15afde374e26c50a4b02"}
Sep 19 10:42:10.783366 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:10.783330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45" event={"ID":"bf57dea6-49e2-4b5f-9210-c42f5b283ac2","Type":"ContainerStarted","Data":"1dd5d8f059938bd4c1304c4d6db60846aa9716c545dd893260891069a918c91d"}
Sep 19 10:42:10.783779 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:10.783465    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:10.799729 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:10.799681    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45" podStartSLOduration=2.415317985 podStartE2EDuration="3.799665758s" totalImagesPullingTime="1.384347773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:10.797609159 +0000 UTC m=+334.731315393" watchObservedRunningTime="2026-09-19 10:42:10.799665758 +0000 UTC m=+334.733372022"
Sep 19 10:42:19.133780 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.133740    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r8wbq"]
Sep 19 10:42:19.139201 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.139171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:19.141540 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.141508    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 19 10:42:19.147418 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.147023    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r8wbq"]
Sep 19 10:42:19.246281 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.246238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsws2\" (UniqueName: \"kubernetes.io/projected/d2f5bb63-eac7-416a-be8f-54a93e97b9d3-kube-api-access-gsws2\") pod \"model-serving-api-54d89bd5fc-r8wbq\" (UID: \"d2f5bb63-eac7-416a-be8f-54a93e97b9d3\") " pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:19.246281 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.246284    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f5bb63-eac7-416a-be8f-54a93e97b9d3-tls-certs\") pod \"model-serving-api-54d89bd5fc-r8wbq\" (UID: \"d2f5bb63-eac7-416a-be8f-54a93e97b9d3\") " pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:19.347639 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.347604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsws2\" (UniqueName: \"kubernetes.io/projected/d2f5bb63-eac7-416a-be8f-54a93e97b9d3-kube-api-access-gsws2\") pod \"model-serving-api-54d89bd5fc-r8wbq\" (UID: \"d2f5bb63-eac7-416a-be8f-54a93e97b9d3\") " pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:19.347817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.347646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f5bb63-eac7-416a-be8f-54a93e97b9d3-tls-certs\") pod \"model-serving-api-54d89bd5fc-r8wbq\" (UID: \"d2f5bb63-eac7-416a-be8f-54a93e97b9d3\") " pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:19.350189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.350165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f5bb63-eac7-416a-be8f-54a93e97b9d3-tls-certs\") pod \"model-serving-api-54d89bd5fc-r8wbq\" (UID: \"d2f5bb63-eac7-416a-be8f-54a93e97b9d3\") " pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:19.355401 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.355376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsws2\" (UniqueName: \"kubernetes.io/projected/d2f5bb63-eac7-416a-be8f-54a93e97b9d3-kube-api-access-gsws2\") pod \"model-serving-api-54d89bd5fc-r8wbq\" (UID: \"d2f5bb63-eac7-416a-be8f-54a93e97b9d3\") " pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:19.451302 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.451186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:19.722803 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.722778    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r8wbq"]
Sep 19 10:42:19.724801 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:42:19.724769    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f5bb63_eac7_416a_be8f_54a93e97b9d3.slice/crio-be6ff8a459c773c480032283b5d37bd6ca864b93f2fe329b29c31538bb8b1c34 WatchSource:0}: Error finding container be6ff8a459c773c480032283b5d37bd6ca864b93f2fe329b29c31538bb8b1c34: Status 404 returned error can't find the container with id be6ff8a459c773c480032283b5d37bd6ca864b93f2fe329b29c31538bb8b1c34
Sep 19 10:42:19.827958 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:19.827924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq" event={"ID":"d2f5bb63-eac7-416a-be8f-54a93e97b9d3","Type":"ContainerStarted","Data":"be6ff8a459c773c480032283b5d37bd6ca864b93f2fe329b29c31538bb8b1c34"}
Sep 19 10:42:21.790536 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:21.790504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-749b85b68c-fgz45"
Sep 19 10:42:22.843647 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:22.843613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq" event={"ID":"d2f5bb63-eac7-416a-be8f-54a93e97b9d3","Type":"ContainerStarted","Data":"ce4f0c6528b13aefdfc32875ae82c7d07eb7b2416a86fb22a4febb4a819f8368"}
Sep 19 10:42:22.844028 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:22.843702    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:22.859232 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:22.859186    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq" podStartSLOduration=1.702605172 podStartE2EDuration="3.859170231s" totalImagesPullingTime="2.156565059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:22.857942635 +0000 UTC m=+346.791648868" watchObservedRunningTime="2026-09-19 10:42:22.859170231 +0000 UTC m=+346.792876445"
Sep 19 10:42:25.328522 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.328489    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"]
Sep 19 10:42:25.334587 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.334564    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.336841 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.336816    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5xwk8\""
Sep 19 10:42:25.337063 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.337036    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 19 10:42:25.337220 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.337049    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 10:42:25.337220 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.337174    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 19 10:42:25.343421 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.343388    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"]
Sep 19 10:42:25.506066 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.506026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.506066 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.506072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.506310 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.506143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.506310 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.506176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.506310 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.506210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.506310 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.506265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.506310 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.506300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.506494 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.506325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmz9k\" (UniqueName: \"kubernetes.io/projected/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-kube-api-access-rmz9k\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.506494 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.506342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607285 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607285 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607285 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607570 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607570 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607570 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607570 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607777 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607834 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmz9k\" (UniqueName: \"kubernetes.io/projected/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-kube-api-access-rmz9k\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607834 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.607834 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.607811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.608048 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.608005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.608048 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.608030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.608253 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.608099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.609857 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.609833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.610103 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.610087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.620843 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.620813    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.622084 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.622065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmz9k\" (UniqueName: \"kubernetes.io/projected/3ed5d46a-9671-4b9b-91ff-5717a3a5adab-kube-api-access-rmz9k\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk\" (UID: \"3ed5d46a-9671-4b9b-91ff-5717a3a5adab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.649277 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.649250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:25.929881 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:25.929792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"]
Sep 19 10:42:25.935181 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:42:25.935149    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed5d46a_9671_4b9b_91ff_5717a3a5adab.slice/crio-cff4aa07a05ab8b1e62025928fcc7b989fe540a375d27373ac95b554df9bdb36 WatchSource:0}: Error finding container cff4aa07a05ab8b1e62025928fcc7b989fe540a375d27373ac95b554df9bdb36: Status 404 returned error can't find the container with id cff4aa07a05ab8b1e62025928fcc7b989fe540a375d27373ac95b554df9bdb36
Sep 19 10:42:26.873214 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:26.873167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk" event={"ID":"3ed5d46a-9671-4b9b-91ff-5717a3a5adab","Type":"ContainerStarted","Data":"cff4aa07a05ab8b1e62025928fcc7b989fe540a375d27373ac95b554df9bdb36"}
Sep 19 10:42:27.103454 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.103412    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"]
Sep 19 10:42:27.105967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.105942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.108420 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.108394    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 19 10:42:27.108587 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.108451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 19 10:42:27.108587 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.108466    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 19 10:42:27.108587 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.108484    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2jqpc\""
Sep 19 10:42:27.118598 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.118566    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"]
Sep 19 10:42:27.222293 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.222211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.222466 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.222336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.222466 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.222383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwqh4\" (UniqueName: \"kubernetes.io/projected/79fee166-4b5a-48b9-8430-535966b8c8bf-kube-api-access-kwqh4\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.222466 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.222414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.222466 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.222449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.222702 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.222518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fee166-4b5a-48b9-8430-535966b8c8bf-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.222702 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.222574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79fee166-4b5a-48b9-8430-535966b8c8bf-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.323438 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.323394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqh4\" (UniqueName: \"kubernetes.io/projected/79fee166-4b5a-48b9-8430-535966b8c8bf-kube-api-access-kwqh4\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.323635 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.323456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.323635 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.323488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.323635 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.323578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fee166-4b5a-48b9-8430-535966b8c8bf-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.323635 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.323607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79fee166-4b5a-48b9-8430-535966b8c8bf-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.323821 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.323673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.323821 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.323752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.324534 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.324504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.326225 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.326172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.326345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.326259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79fee166-4b5a-48b9-8430-535966b8c8bf-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.326345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.326304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fee166-4b5a-48b9-8430-535966b8c8bf-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.326505 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.326484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.331764 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.331743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fee166-4b5a-48b9-8430-535966b8c8bf-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.332122 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.332104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwqh4\" (UniqueName: \"kubernetes.io/projected/79fee166-4b5a-48b9-8430-535966b8c8bf-kube-api-access-kwqh4\") pod \"istiod-openshift-gateway-5677ccb49b-q64nw\" (UID: \"79fee166-4b5a-48b9-8430-535966b8c8bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:27.419115 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:27.419062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:28.331509 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:28.331359    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:42:28.331509 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:28.331458    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:42:28.331509 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:28.331498    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:42:28.561750 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:28.561695    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"]
Sep 19 10:42:28.564119 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:42:28.564088    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fee166_4b5a_48b9_8430_535966b8c8bf.slice/crio-cbce68819fda5240ed99b96adaf75c5a18e17fd22a3014cad744b7f391ca5619 WatchSource:0}: Error finding container cbce68819fda5240ed99b96adaf75c5a18e17fd22a3014cad744b7f391ca5619: Status 404 returned error can't find the container with id cbce68819fda5240ed99b96adaf75c5a18e17fd22a3014cad744b7f391ca5619
Sep 19 10:42:28.887012 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:28.886972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk" event={"ID":"3ed5d46a-9671-4b9b-91ff-5717a3a5adab","Type":"ContainerStarted","Data":"824e0cca91b70895d196f2a03f6bf881dfe6d60cb10391cbd91600fde9ae13f6"}
Sep 19 10:42:28.888312 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:28.888287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw" event={"ID":"79fee166-4b5a-48b9-8430-535966b8c8bf","Type":"ContainerStarted","Data":"cbce68819fda5240ed99b96adaf75c5a18e17fd22a3014cad744b7f391ca5619"}
Sep 19 10:42:28.948490 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:28.948430    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk" podStartSLOduration=1.55490799 podStartE2EDuration="3.948410738s" totalImagesPullingTime="2.393502748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:28.945499574 +0000 UTC m=+352.879205844" watchObservedRunningTime="2026-09-19 10:42:28.948410738 +0000 UTC m=+352.882116952"
Sep 19 10:42:29.649634 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:29.649593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:29.655262 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:29.655220    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:29.893982 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:29.893952    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:29.895210 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:29.895186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk"
Sep 19 10:42:30.971725 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:30.970966    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:42:30.971725 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:30.971048    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:42:31.905625 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:31.905582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw" event={"ID":"79fee166-4b5a-48b9-8430-535966b8c8bf","Type":"ContainerStarted","Data":"35a8244e1946bde9b987b56124526981de2f4151105f28b90ba31b029b56f3cf"}
Sep 19 10:42:31.905805 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:31.905788    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:32.911925 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:32.911896    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw"
Sep 19 10:42:32.963231 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:32.963176    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q64nw" podStartSLOduration=3.559207964 podStartE2EDuration="5.963158068s" totalImagesPullingTime="2.403950104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:31.932167115 +0000 UTC m=+355.865873345" watchObservedRunningTime="2026-09-19 10:42:32.963158068 +0000 UTC m=+356.896864281"
Sep 19 10:42:33.852666 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:33.852633    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-r8wbq"
Sep 19 10:42:58.090573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:42:58.090524    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76c6bfdf4d-w5f5z"]
Sep 19 10:43:22.636328 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.636292    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"]
Sep 19 10:43:22.638959 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.638942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.641397 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.641378    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 10:43:22.641534 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.641415    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 10:43:22.642344 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.642330    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rtgbv\""
Sep 19 10:43:22.647340 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.647318    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"]
Sep 19 10:43:22.721526 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.721492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sph8h\" (UniqueName: \"kubernetes.io/projected/d2ba5cad-fe15-488e-b2e9-42e22af0e344-kube-api-access-sph8h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.721526 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.721530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.721753 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.721635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.736246 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.736215    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"]
Sep 19 10:43:22.738831 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.738811    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.747347 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.747322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"]
Sep 19 10:43:22.822875 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.822844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.823049 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.822891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.823049 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.822971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sph8h\" (UniqueName: \"kubernetes.io/projected/d2ba5cad-fe15-488e-b2e9-42e22af0e344-kube-api-access-sph8h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.823049 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.823005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.823049 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.823038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-kube-api-access-gsg94\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.823195 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.823068    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.823352 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.823337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.823388 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.823372    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.831628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.831602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sph8h\" (UniqueName: \"kubernetes.io/projected/d2ba5cad-fe15-488e-b2e9-42e22af0e344-kube-api-access-sph8h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:22.836268 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.836243    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"]
Sep 19 10:43:22.838977 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.838959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:22.846893 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.846869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"]
Sep 19 10:43:22.923790 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.923706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-kube-api-access-gsg94\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.923790 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.923769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.924012 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.923813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:22.924012 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.923842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:22.924012 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.923875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.924012 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.923937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grsp7\" (UniqueName: \"kubernetes.io/projected/d5ef37cd-cfa6-4393-9c11-99099def0326-kube-api-access-grsp7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:22.924193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.924176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.924235 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.924208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.936201 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.936168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-kube-api-access-gsg94\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:22.937499 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.937479    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"]
Sep 19 10:43:22.940126 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.940111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:22.948440 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.948418    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"]
Sep 19 10:43:22.949227 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:22.949209    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:23.025130 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.024978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.025503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.025221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:23.025503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.025379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:23.025942 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.025622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:23.025942 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.025667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grsp7\" (UniqueName: \"kubernetes.io/projected/d5ef37cd-cfa6-4393-9c11-99099def0326-kube-api-access-grsp7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:23.025942 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.025704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:23.025942 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.025815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.025942 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.025850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqj6b\" (UniqueName: \"kubernetes.io/projected/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-kube-api-access-rqj6b\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.033804 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.033780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grsp7\" (UniqueName: \"kubernetes.io/projected/d5ef37cd-cfa6-4393-9c11-99099def0326-kube-api-access-grsp7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:23.048576 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.048530    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:23.110114 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.110073    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76c6bfdf4d-w5f5z" podUID="1a4f9d9b-1384-4851-ba8d-44e00b7947d8" containerName="console" containerID="cri-o://15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d" gracePeriod=15
Sep 19 10:43:23.127167 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.127140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.127278 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.127173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqj6b\" (UniqueName: \"kubernetes.io/projected/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-kube-api-access-rqj6b\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.127278 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.127197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.127500 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.127485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.127669 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.127534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.136825 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.136797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqj6b\" (UniqueName: \"kubernetes.io/projected/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-kube-api-access-rqj6b\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.149858 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.149833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:23.228863 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.228829    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"]
Sep 19 10:43:23.229405 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:43:23.229379    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ba5cad_fe15_488e_b2e9_42e22af0e344.slice/crio-021ebf6885169052dc54ef5f215e5864935f3f6aed2ca1a7b964a9a0d8ca0547 WatchSource:0}: Error finding container 021ebf6885169052dc54ef5f215e5864935f3f6aed2ca1a7b964a9a0d8ca0547: Status 404 returned error can't find the container with id 021ebf6885169052dc54ef5f215e5864935f3f6aed2ca1a7b964a9a0d8ca0547
Sep 19 10:43:23.252295 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.252264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:23.321028 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.319380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"]
Sep 19 10:43:23.326697 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:43:23.326602    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558dd9f7_fcbc_4ec6_89b3_5a9a163d27a9.slice/crio-8039f9faf3c05613963e80895ae2a764da2a0d62ef71681b61d642d359cccf3e WatchSource:0}: Error finding container 8039f9faf3c05613963e80895ae2a764da2a0d62ef71681b61d642d359cccf3e: Status 404 returned error can't find the container with id 8039f9faf3c05613963e80895ae2a764da2a0d62ef71681b61d642d359cccf3e
Sep 19 10:43:23.399395 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.399370    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:43:23.421309 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.421282    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"]
Sep 19 10:43:23.423717 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:43:23.423690    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ef37cd_cfa6_4393_9c11_99099def0326.slice/crio-cf2c43106c0b9ec2ea54dca52515f7c022d76c22285c7a3869daf4b0cd6f4574 WatchSource:0}: Error finding container cf2c43106c0b9ec2ea54dca52515f7c022d76c22285c7a3869daf4b0cd6f4574: Status 404 returned error can't find the container with id cf2c43106c0b9ec2ea54dca52515f7c022d76c22285c7a3869daf4b0cd6f4574
Sep 19 10:43:23.429386 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.429356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-oauth-serving-cert\") pod \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") "
Sep 19 10:43:23.429458 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.429397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-config\") pod \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") "
Sep 19 10:43:23.429458 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.429438    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-trusted-ca-bundle\") pod \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") "
Sep 19 10:43:23.429604 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.429466    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-serving-cert\") pod \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") "
Sep 19 10:43:23.429604 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.429523    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-service-ca\") pod \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") "
Sep 19 10:43:23.429604 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.429588    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-oauth-config\") pod \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") "
Sep 19 10:43:23.429774 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.429636    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjbg7\" (UniqueName: \"kubernetes.io/projected/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-kube-api-access-bjbg7\") pod \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\" (UID: \"1a4f9d9b-1384-4851-ba8d-44e00b7947d8\") "
Sep 19 10:43:23.430245 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.429836    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1a4f9d9b-1384-4851-ba8d-44e00b7947d8" (UID: "1a4f9d9b-1384-4851-ba8d-44e00b7947d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:43:23.430245 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.429974    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-oauth-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:23.430245 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.430189    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-config" (OuterVolumeSpecName: "console-config") pod "1a4f9d9b-1384-4851-ba8d-44e00b7947d8" (UID: "1a4f9d9b-1384-4851-ba8d-44e00b7947d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:43:23.430663 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.430634    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1a4f9d9b-1384-4851-ba8d-44e00b7947d8" (UID: "1a4f9d9b-1384-4851-ba8d-44e00b7947d8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:43:23.430769 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.430659    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "1a4f9d9b-1384-4851-ba8d-44e00b7947d8" (UID: "1a4f9d9b-1384-4851-ba8d-44e00b7947d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:43:23.432469 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.432424    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1a4f9d9b-1384-4851-ba8d-44e00b7947d8" (UID: "1a4f9d9b-1384-4851-ba8d-44e00b7947d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:43:23.432648 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.432624    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-kube-api-access-bjbg7" (OuterVolumeSpecName: "kube-api-access-bjbg7") pod "1a4f9d9b-1384-4851-ba8d-44e00b7947d8" (UID: "1a4f9d9b-1384-4851-ba8d-44e00b7947d8"). InnerVolumeSpecName "kube-api-access-bjbg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:43:23.432707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.432630    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1a4f9d9b-1384-4851-ba8d-44e00b7947d8" (UID: "1a4f9d9b-1384-4851-ba8d-44e00b7947d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:43:23.530608 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.530581    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:23.530608 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.530606    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-trusted-ca-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:23.530763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.530615    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:23.530763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.530627    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:23.530763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.530636    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-console-oauth-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:23.530763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.530646    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjbg7\" (UniqueName: \"kubernetes.io/projected/1a4f9d9b-1384-4851-ba8d-44e00b7947d8-kube-api-access-bjbg7\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:23.534280 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:23.534253    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"]
Sep 19 10:43:23.571588 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:43:23.571530    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b72e3e_0f9a_4e6a_8e55_0a1bcb7093ac.slice/crio-ea8ed1aec7a80bfda371483db39cd21c78562df70ca61c6e3ee8d49a28c7719d WatchSource:0}: Error finding container ea8ed1aec7a80bfda371483db39cd21c78562df70ca61c6e3ee8d49a28c7719d: Status 404 returned error can't find the container with id ea8ed1aec7a80bfda371483db39cd21c78562df70ca61c6e3ee8d49a28c7719d
Sep 19 10:43:24.155928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.155889    2563 generic.go:356] "Generic (PLEG): container finished" podID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerID="08130f134de720b4a801ee2cb031a248f325bb644721af4b51ff58015568093f" exitCode=0
Sep 19 10:43:24.156391 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.155980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj" event={"ID":"d5ef37cd-cfa6-4393-9c11-99099def0326","Type":"ContainerDied","Data":"08130f134de720b4a801ee2cb031a248f325bb644721af4b51ff58015568093f"}
Sep 19 10:43:24.156391 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.156043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj" event={"ID":"d5ef37cd-cfa6-4393-9c11-99099def0326","Type":"ContainerStarted","Data":"cf2c43106c0b9ec2ea54dca52515f7c022d76c22285c7a3869daf4b0cd6f4574"}
Sep 19 10:43:24.157743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.157717    2563 generic.go:356] "Generic (PLEG): container finished" podID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerID="f3dd851e3067b3c2409fbb782205e81d70c51e3958c6cdf2daf8e33a752fad7f" exitCode=0
Sep 19 10:43:24.157896 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.157754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8" event={"ID":"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac","Type":"ContainerDied","Data":"f3dd851e3067b3c2409fbb782205e81d70c51e3958c6cdf2daf8e33a752fad7f"}
Sep 19 10:43:24.157896 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.157809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8" event={"ID":"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac","Type":"ContainerStarted","Data":"ea8ed1aec7a80bfda371483db39cd21c78562df70ca61c6e3ee8d49a28c7719d"}
Sep 19 10:43:24.159451 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.159431    2563 generic.go:356] "Generic (PLEG): container finished" podID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerID="ac2faa58296dca8a06cd768316a87e6ae7a0901b1a3fd14d3e3e91823926bf32" exitCode=0
Sep 19 10:43:24.159533 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.159515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw" event={"ID":"d2ba5cad-fe15-488e-b2e9-42e22af0e344","Type":"ContainerDied","Data":"ac2faa58296dca8a06cd768316a87e6ae7a0901b1a3fd14d3e3e91823926bf32"}
Sep 19 10:43:24.159605 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.159577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw" event={"ID":"d2ba5cad-fe15-488e-b2e9-42e22af0e344","Type":"ContainerStarted","Data":"021ebf6885169052dc54ef5f215e5864935f3f6aed2ca1a7b964a9a0d8ca0547"}
Sep 19 10:43:24.161034 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.161004    2563 generic.go:356] "Generic (PLEG): container finished" podID="1a4f9d9b-1384-4851-ba8d-44e00b7947d8" containerID="15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d" exitCode=0
Sep 19 10:43:24.161137 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.161068    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c6bfdf4d-w5f5z"
Sep 19 10:43:24.161137 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.161099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c6bfdf4d-w5f5z" event={"ID":"1a4f9d9b-1384-4851-ba8d-44e00b7947d8","Type":"ContainerDied","Data":"15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d"}
Sep 19 10:43:24.161239 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.161157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c6bfdf4d-w5f5z" event={"ID":"1a4f9d9b-1384-4851-ba8d-44e00b7947d8","Type":"ContainerDied","Data":"2165908107d347dde719a41059ffd766fb4230234be3ffdd5d30e9fa10e19a0a"}
Sep 19 10:43:24.161239 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.161197    2563 scope.go:117] "RemoveContainer" containerID="15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d"
Sep 19 10:43:24.163238 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.163215    2563 generic.go:356] "Generic (PLEG): container finished" podID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerID="1293a2fc5b6827fbfbbe6391fb0a6a6916108d8a3b709de93a130727d1d6b346" exitCode=0
Sep 19 10:43:24.163349 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.163331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x" event={"ID":"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9","Type":"ContainerDied","Data":"1293a2fc5b6827fbfbbe6391fb0a6a6916108d8a3b709de93a130727d1d6b346"}
Sep 19 10:43:24.163409 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.163371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x" event={"ID":"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9","Type":"ContainerStarted","Data":"8039f9faf3c05613963e80895ae2a764da2a0d62ef71681b61d642d359cccf3e"}
Sep 19 10:43:24.170900 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.170876    2563 scope.go:117] "RemoveContainer" containerID="15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d"
Sep 19 10:43:24.171191 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:43:24.171170    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d\": container with ID starting with 15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d not found: ID does not exist" containerID="15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d"
Sep 19 10:43:24.171262 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.171204    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d"} err="failed to get container status \"15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d\": rpc error: code = NotFound desc = could not find container \"15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d\": container with ID starting with 15d4b074d51aa6392afdcd981f7991dac2e326c5287799cdd2b1795f9aa2f66d not found: ID does not exist"
Sep 19 10:43:24.219543 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.219508    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76c6bfdf4d-w5f5z"]
Sep 19 10:43:24.225352 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:24.225324    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76c6bfdf4d-w5f5z"]
Sep 19 10:43:25.171176 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:25.171141    2563 generic.go:356] "Generic (PLEG): container finished" podID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerID="0f5a2589b42a41d30be6d101f6f1bad91312315c808d477558dd7b2333048c7d" exitCode=0
Sep 19 10:43:25.171644 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:25.171229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj" event={"ID":"d5ef37cd-cfa6-4393-9c11-99099def0326","Type":"ContainerDied","Data":"0f5a2589b42a41d30be6d101f6f1bad91312315c808d477558dd7b2333048c7d"}
Sep 19 10:43:25.174429 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:25.174403    2563 generic.go:356] "Generic (PLEG): container finished" podID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerID="2e3f99f67367c14582acc4aafa795f145f6706e232bc9142fc4f4dff865d1f9e" exitCode=0
Sep 19 10:43:25.174594 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:25.174445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x" event={"ID":"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9","Type":"ContainerDied","Data":"2e3f99f67367c14582acc4aafa795f145f6706e232bc9142fc4f4dff865d1f9e"}
Sep 19 10:43:26.118313 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:26.118281    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a4f9d9b-1384-4851-ba8d-44e00b7947d8" path="/var/lib/kubelet/pods/1a4f9d9b-1384-4851-ba8d-44e00b7947d8/volumes"
Sep 19 10:43:26.181573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:26.181458    2563 generic.go:356] "Generic (PLEG): container finished" podID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerID="bf5a4dfcb65df5e3254b4c61653c5ef82d6fc08968baab1bc2c9fcaca1aac79e" exitCode=0
Sep 19 10:43:26.181573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:26.181541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x" event={"ID":"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9","Type":"ContainerDied","Data":"bf5a4dfcb65df5e3254b4c61653c5ef82d6fc08968baab1bc2c9fcaca1aac79e"}
Sep 19 10:43:26.183644 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:26.183618    2563 generic.go:356] "Generic (PLEG): container finished" podID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerID="93491d43c23673b08e0fe3b2d0a490d7f05662508739b5bc4db4e64552768ed3" exitCode=0
Sep 19 10:43:26.183775 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:26.183700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj" event={"ID":"d5ef37cd-cfa6-4393-9c11-99099def0326","Type":"ContainerDied","Data":"93491d43c23673b08e0fe3b2d0a490d7f05662508739b5bc4db4e64552768ed3"}
Sep 19 10:43:26.185439 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:26.185416    2563 generic.go:356] "Generic (PLEG): container finished" podID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerID="273cecf56f56a066da24c0dd8796f8cb3db674b73f9612592fd09e4f19be5632" exitCode=0
Sep 19 10:43:26.185573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:26.185493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8" event={"ID":"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac","Type":"ContainerDied","Data":"273cecf56f56a066da24c0dd8796f8cb3db674b73f9612592fd09e4f19be5632"}
Sep 19 10:43:26.187409 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:26.187391    2563 generic.go:356] "Generic (PLEG): container finished" podID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerID="b01ee1ae3f47284e7f47a184d2ab22eeb25c09e30db757e967abdf85de8ee9e4" exitCode=0
Sep 19 10:43:26.187483 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:26.187467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw" event={"ID":"d2ba5cad-fe15-488e-b2e9-42e22af0e344","Type":"ContainerDied","Data":"b01ee1ae3f47284e7f47a184d2ab22eeb25c09e30db757e967abdf85de8ee9e4"}
Sep 19 10:43:27.195831 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.195796    2563 generic.go:356] "Generic (PLEG): container finished" podID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerID="eaa9a80bd476b2e1a77ecd9ca981a3c7d1d0912a09c350a81f197eecfaa5bd09" exitCode=0
Sep 19 10:43:27.196269 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.195885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8" event={"ID":"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac","Type":"ContainerDied","Data":"eaa9a80bd476b2e1a77ecd9ca981a3c7d1d0912a09c350a81f197eecfaa5bd09"}
Sep 19 10:43:27.198049 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.198024    2563 generic.go:356] "Generic (PLEG): container finished" podID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerID="8065cbd02767395fd2f96e298b318b622936b9ca20dafabf57807016e2b88d75" exitCode=0
Sep 19 10:43:27.198179 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.198103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw" event={"ID":"d2ba5cad-fe15-488e-b2e9-42e22af0e344","Type":"ContainerDied","Data":"8065cbd02767395fd2f96e298b318b622936b9ca20dafabf57807016e2b88d75"}
Sep 19 10:43:27.340030 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.340006    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:27.356117 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.356092    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:27.366047 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.366021    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-bundle\") pod \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") "
Sep 19 10:43:27.366183 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.366133    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-util\") pod \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") "
Sep 19 10:43:27.366183 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.366164    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-kube-api-access-gsg94\") pod \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\" (UID: \"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9\") "
Sep 19 10:43:27.366812 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.366785    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-bundle" (OuterVolumeSpecName: "bundle") pod "558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" (UID: "558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:43:27.368296 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.368274    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-kube-api-access-gsg94" (OuterVolumeSpecName: "kube-api-access-gsg94") pod "558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" (UID: "558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9"). InnerVolumeSpecName "kube-api-access-gsg94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:43:27.372054 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.372033    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-util" (OuterVolumeSpecName: "util") pod "558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" (UID: "558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:43:27.466932 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.466844    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-util\") pod \"d5ef37cd-cfa6-4393-9c11-99099def0326\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") "
Sep 19 10:43:27.466932 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.466906    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grsp7\" (UniqueName: \"kubernetes.io/projected/d5ef37cd-cfa6-4393-9c11-99099def0326-kube-api-access-grsp7\") pod \"d5ef37cd-cfa6-4393-9c11-99099def0326\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") "
Sep 19 10:43:27.467160 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.466947    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-bundle\") pod \"d5ef37cd-cfa6-4393-9c11-99099def0326\" (UID: \"d5ef37cd-cfa6-4393-9c11-99099def0326\") "
Sep 19 10:43:27.467160 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.467100    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:27.467160 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.467114    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-kube-api-access-gsg94\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:27.467160 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.467124    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:27.467462 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.467437    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-bundle" (OuterVolumeSpecName: "bundle") pod "d5ef37cd-cfa6-4393-9c11-99099def0326" (UID: "d5ef37cd-cfa6-4393-9c11-99099def0326"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:43:27.469144 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.469117    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5ef37cd-cfa6-4393-9c11-99099def0326-kube-api-access-grsp7" (OuterVolumeSpecName: "kube-api-access-grsp7") pod "d5ef37cd-cfa6-4393-9c11-99099def0326" (UID: "d5ef37cd-cfa6-4393-9c11-99099def0326"). InnerVolumeSpecName "kube-api-access-grsp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:43:27.472007 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.471986    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-util" (OuterVolumeSpecName: "util") pod "d5ef37cd-cfa6-4393-9c11-99099def0326" (UID: "d5ef37cd-cfa6-4393-9c11-99099def0326"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:43:27.567573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.567524    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:27.567573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.567572    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grsp7\" (UniqueName: \"kubernetes.io/projected/d5ef37cd-cfa6-4393-9c11-99099def0326-kube-api-access-grsp7\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:27.567765 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:27.567588    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5ef37cd-cfa6-4393-9c11-99099def0326-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:28.204216 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.204186    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj"
Sep 19 10:43:28.204216 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.204206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7hjhvj" event={"ID":"d5ef37cd-cfa6-4393-9c11-99099def0326","Type":"ContainerDied","Data":"cf2c43106c0b9ec2ea54dca52515f7c022d76c22285c7a3869daf4b0cd6f4574"}
Sep 19 10:43:28.204695 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.204255    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf2c43106c0b9ec2ea54dca52515f7c022d76c22285c7a3869daf4b0cd6f4574"
Sep 19 10:43:28.206393 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.206362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x" event={"ID":"558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9","Type":"ContainerDied","Data":"8039f9faf3c05613963e80895ae2a764da2a0d62ef71681b61d642d359cccf3e"}
Sep 19 10:43:28.206531 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.206414    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8039f9faf3c05613963e80895ae2a764da2a0d62ef71681b61d642d359cccf3e"
Sep 19 10:43:28.207323 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.206807    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adbz6x"
Sep 19 10:43:28.364039 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.363883    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:28.396428 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.396364    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:28.474157 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.474120    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-util\") pod \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") "
Sep 19 10:43:28.474157 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.474159    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqj6b\" (UniqueName: \"kubernetes.io/projected/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-kube-api-access-rqj6b\") pod \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") "
Sep 19 10:43:28.474359 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.474201    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-bundle\") pod \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") "
Sep 19 10:43:28.474359 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.474248    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sph8h\" (UniqueName: \"kubernetes.io/projected/d2ba5cad-fe15-488e-b2e9-42e22af0e344-kube-api-access-sph8h\") pod \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\" (UID: \"d2ba5cad-fe15-488e-b2e9-42e22af0e344\") "
Sep 19 10:43:28.474359 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.474286    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-bundle\") pod \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") "
Sep 19 10:43:28.474359 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.474345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-util\") pod \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\" (UID: \"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac\") "
Sep 19 10:43:28.474841 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.474806    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-bundle" (OuterVolumeSpecName: "bundle") pod "d2ba5cad-fe15-488e-b2e9-42e22af0e344" (UID: "d2ba5cad-fe15-488e-b2e9-42e22af0e344"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:43:28.474958 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.474935    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-bundle" (OuterVolumeSpecName: "bundle") pod "22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" (UID: "22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:43:28.476392 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.476368    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ba5cad-fe15-488e-b2e9-42e22af0e344-kube-api-access-sph8h" (OuterVolumeSpecName: "kube-api-access-sph8h") pod "d2ba5cad-fe15-488e-b2e9-42e22af0e344" (UID: "d2ba5cad-fe15-488e-b2e9-42e22af0e344"). InnerVolumeSpecName "kube-api-access-sph8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:43:28.476392 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.476386    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-kube-api-access-rqj6b" (OuterVolumeSpecName: "kube-api-access-rqj6b") pod "22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" (UID: "22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac"). InnerVolumeSpecName "kube-api-access-rqj6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:43:28.479648 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.479609    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-util" (OuterVolumeSpecName: "util") pod "22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" (UID: "22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:43:28.495692 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.495666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-util" (OuterVolumeSpecName: "util") pod "d2ba5cad-fe15-488e-b2e9-42e22af0e344" (UID: "d2ba5cad-fe15-488e-b2e9-42e22af0e344"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:43:28.575790 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.575756    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:28.575790 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.575784    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sph8h\" (UniqueName: \"kubernetes.io/projected/d2ba5cad-fe15-488e-b2e9-42e22af0e344-kube-api-access-sph8h\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:28.575790 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.575794    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:28.576006 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.575804    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:28.576006 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.575811    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2ba5cad-fe15-488e-b2e9-42e22af0e344-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:28.576006 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:28.575819    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqj6b\" (UniqueName: \"kubernetes.io/projected/22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac-kube-api-access-rqj6b\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:43:29.214150 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:29.214105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8" event={"ID":"22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac","Type":"ContainerDied","Data":"ea8ed1aec7a80bfda371483db39cd21c78562df70ca61c6e3ee8d49a28c7719d"}
Sep 19 10:43:29.214669 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:29.214162    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea8ed1aec7a80bfda371483db39cd21c78562df70ca61c6e3ee8d49a28c7719d"
Sep 19 10:43:29.214669 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:29.214122    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmgkt8"
Sep 19 10:43:29.216332 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:29.216312    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw"
Sep 19 10:43:29.216480 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:29.216334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fcwtw" event={"ID":"d2ba5cad-fe15-488e-b2e9-42e22af0e344","Type":"ContainerDied","Data":"021ebf6885169052dc54ef5f215e5864935f3f6aed2ca1a7b964a9a0d8ca0547"}
Sep 19 10:43:29.216480 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:43:29.216371    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="021ebf6885169052dc54ef5f215e5864935f3f6aed2ca1a7b964a9a0d8ca0547"
Sep 19 10:44:33.723346 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723308    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"]
Sep 19 10:44:33.723869 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723827    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerName="extract"
Sep 19 10:44:33.723869 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723843    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerName="extract"
Sep 19 10:44:33.723869 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723859    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerName="pull"
Sep 19 10:44:33.723869 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723868    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerName="pull"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723882    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerName="pull"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723891    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerName="pull"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723908    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerName="util"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723915    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerName="util"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723924    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerName="extract"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723932    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerName="extract"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723942    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerName="util"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723950    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerName="util"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723959    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerName="extract"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723967    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerName="extract"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723978    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerName="pull"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723986    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerName="pull"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.723994    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerName="pull"
Sep 19 10:44:33.724003 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724002    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerName="pull"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724010    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerName="extract"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724018    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerName="extract"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724038    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerName="util"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724048    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerName="util"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724056    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerName="util"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724064    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerName="util"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724076    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a4f9d9b-1384-4851-ba8d-44e00b7947d8" containerName="console"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724084    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a4f9d9b-1384-4851-ba8d-44e00b7947d8" containerName="console"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724159    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a4f9d9b-1384-4851-ba8d-44e00b7947d8" containerName="console"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724171    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5ef37cd-cfa6-4393-9c11-99099def0326" containerName="extract"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724180    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2ba5cad-fe15-488e-b2e9-42e22af0e344" containerName="extract"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724185    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="22b72e3e-0f9a-4e6a-8e55-0a1bcb7093ac" containerName="extract"
Sep 19 10:44:33.724436 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.724192    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="558dd9f7-fcbc-4ec6-89b3-5a9a163d27a9" containerName="extract"
Sep 19 10:44:33.727099 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.727080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.729746 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.729720    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2mdk8\""
Sep 19 10:44:33.736477 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.736440    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"]
Sep 19 10:44:33.811407 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.811360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4facec1d-b9d5-4820-b551-ba291778cd05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.811407 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.811405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.811672 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.811516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4facec1d-b9d5-4820-b551-ba291778cd05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.811672 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.811579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.811672 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.811627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.811672 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.811656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.811830 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.811709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.811830 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.811790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4facec1d-b9d5-4820-b551-ba291778cd05-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.811908 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.811834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-867hv\" (UniqueName: \"kubernetes.io/projected/4facec1d-b9d5-4820-b551-ba291778cd05-kube-api-access-867hv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.912712 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.912670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.912712 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.912718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.912986 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.912763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.912986 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.912804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4facec1d-b9d5-4820-b551-ba291778cd05-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.912986 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.912832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-867hv\" (UniqueName: \"kubernetes.io/projected/4facec1d-b9d5-4820-b551-ba291778cd05-kube-api-access-867hv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.912986 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.912886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4facec1d-b9d5-4820-b551-ba291778cd05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.912986 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.912922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.912986 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.912953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4facec1d-b9d5-4820-b551-ba291778cd05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.912986 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.912985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.913338 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.913223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.913402 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.913336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.913442 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.913394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.913506 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.913486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.913984 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.913960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4facec1d-b9d5-4820-b551-ba291778cd05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.915381 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.915347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4facec1d-b9d5-4820-b551-ba291778cd05-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.915631 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.915612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4facec1d-b9d5-4820-b551-ba291778cd05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.920456 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.920423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4facec1d-b9d5-4820-b551-ba291778cd05-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:33.920643 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:33.920622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-867hv\" (UniqueName: \"kubernetes.io/projected/4facec1d-b9d5-4820-b551-ba291778cd05-kube-api-access-867hv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lrkbf\" (UID: \"4facec1d-b9d5-4820-b551-ba291778cd05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:34.039634 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:34.039511    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:34.315800 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:34.315765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"]
Sep 19 10:44:34.317764 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:44:34.317739    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4facec1d_b9d5_4820_b551_ba291778cd05.slice/crio-53d3913e249d37cff81c234f21ce4857d10fb03b78bb0c3dcc6ad197c58336e5 WatchSource:0}: Error finding container 53d3913e249d37cff81c234f21ce4857d10fb03b78bb0c3dcc6ad197c58336e5: Status 404 returned error can't find the container with id 53d3913e249d37cff81c234f21ce4857d10fb03b78bb0c3dcc6ad197c58336e5
Sep 19 10:44:34.319841 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:34.319808    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:44:34.319948 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:34.319876    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:44:34.319948 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:34.319900    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:44:34.564919 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:34.564790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" event={"ID":"4facec1d-b9d5-4820-b551-ba291778cd05","Type":"ContainerStarted","Data":"46284eeadf460b57ddb43e612f83754de257504745fcbaa4b0f508f90a36f61d"}
Sep 19 10:44:34.564919 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:34.564863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" event={"ID":"4facec1d-b9d5-4820-b551-ba291778cd05","Type":"ContainerStarted","Data":"53d3913e249d37cff81c234f21ce4857d10fb03b78bb0c3dcc6ad197c58336e5"}
Sep 19 10:44:34.583980 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:34.583922    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" podStartSLOduration=1.583904639 podStartE2EDuration="1.583904639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:44:34.581159234 +0000 UTC m=+478.514865497" watchObservedRunningTime="2026-09-19 10:44:34.583904639 +0000 UTC m=+478.517610853"
Sep 19 10:44:35.039752 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:35.039711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:35.044819 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:35.044794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:35.570636 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:35.570605    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:44:35.571589 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:44:35.571566    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:46:03.505006 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.504965    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"]
Sep 19 10:46:03.508269 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.508247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:03.510734 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.510711    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pkkm7\""
Sep 19 10:46:03.511048 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.511033    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 19 10:46:03.516820 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.516798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"]
Sep 19 10:46:03.596121 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.596011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/606edbe1-4a74-4ff6-923f-5b7c2be0a58c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-cmmq2\" (UID: \"606edbe1-4a74-4ff6-923f-5b7c2be0a58c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:03.596338 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.596141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh6zc\" (UniqueName: \"kubernetes.io/projected/606edbe1-4a74-4ff6-923f-5b7c2be0a58c-kube-api-access-dh6zc\") pod \"payload-processing-5b54b7fbb7-cmmq2\" (UID: \"606edbe1-4a74-4ff6-923f-5b7c2be0a58c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:03.696984 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.696951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/606edbe1-4a74-4ff6-923f-5b7c2be0a58c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-cmmq2\" (UID: \"606edbe1-4a74-4ff6-923f-5b7c2be0a58c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:03.697172 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.697009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh6zc\" (UniqueName: \"kubernetes.io/projected/606edbe1-4a74-4ff6-923f-5b7c2be0a58c-kube-api-access-dh6zc\") pod \"payload-processing-5b54b7fbb7-cmmq2\" (UID: \"606edbe1-4a74-4ff6-923f-5b7c2be0a58c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:03.697917 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.697890    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/606edbe1-4a74-4ff6-923f-5b7c2be0a58c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-cmmq2\" (UID: \"606edbe1-4a74-4ff6-923f-5b7c2be0a58c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:03.708344 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.708317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh6zc\" (UniqueName: \"kubernetes.io/projected/606edbe1-4a74-4ff6-923f-5b7c2be0a58c-kube-api-access-dh6zc\") pod \"payload-processing-5b54b7fbb7-cmmq2\" (UID: \"606edbe1-4a74-4ff6-923f-5b7c2be0a58c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:03.819031 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:03.818925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:04.092275 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:04.092244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"]
Sep 19 10:46:04.094733 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:46:04.094703    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606edbe1_4a74_4ff6_923f_5b7c2be0a58c.slice/crio-1ddc5e2135270fa1f2680df3754c09b321568f810a453cd04599fce86167a8ce WatchSource:0}: Error finding container 1ddc5e2135270fa1f2680df3754c09b321568f810a453cd04599fce86167a8ce: Status 404 returned error can't find the container with id 1ddc5e2135270fa1f2680df3754c09b321568f810a453cd04599fce86167a8ce
Sep 19 10:46:05.042598 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:05.042537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2" event={"ID":"606edbe1-4a74-4ff6-923f-5b7c2be0a58c","Type":"ContainerStarted","Data":"1ddc5e2135270fa1f2680df3754c09b321568f810a453cd04599fce86167a8ce"}
Sep 19 10:46:06.050095 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:06.050060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2" event={"ID":"606edbe1-4a74-4ff6-923f-5b7c2be0a58c","Type":"ContainerStarted","Data":"fb383fb70a7f175ce6d760f5b7191162422b3743851540ae3215231cf71232eb"}
Sep 19 10:46:06.050540 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:06.050314    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:06.067354 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:06.067308    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2" podStartSLOduration=1.778932891 podStartE2EDuration="3.067293549s" totalImagesPullingTime="1.288360658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:46:06.065796288 +0000 UTC m=+569.999502529" watchObservedRunningTime="2026-09-19 10:46:06.067293549 +0000 UTC m=+570.000999764"
Sep 19 10:46:13.092672 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:13.092636    2563 generic.go:356] "Generic (PLEG): container finished" podID="4facec1d-b9d5-4820-b551-ba291778cd05" containerID="46284eeadf460b57ddb43e612f83754de257504745fcbaa4b0f508f90a36f61d" exitCode=0
Sep 19 10:46:13.093199 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:13.092712    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" event={"ID":"4facec1d-b9d5-4820-b551-ba291778cd05","Type":"ContainerDied","Data":"46284eeadf460b57ddb43e612f83754de257504745fcbaa4b0f508f90a36f61d"}
Sep 19 10:46:13.093266 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:13.093217    2563 scope.go:117] "RemoveContainer" containerID="46284eeadf460b57ddb43e612f83754de257504745fcbaa4b0f508f90a36f61d"
Sep 19 10:46:13.094235 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:13.094211    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:46:13.094300 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:13.094277    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:46:13.094338 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:13.094307    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:46:14.100151 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:14.100116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" event={"ID":"4facec1d-b9d5-4820-b551-ba291778cd05","Type":"ContainerStarted","Data":"70b939658c35e08efcf18a704493de14f506580b92f731a59f0a157b6ab60ae9"}
Sep 19 10:46:15.040005 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:15.039955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:46:15.040234 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:15.040201    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lrkbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 10:46:15.040310 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:15.040282    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" podUID="4facec1d-b9d5-4820-b551-ba291778cd05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 10:46:16.040638 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:16.040592    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lrkbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 10:46:16.041068 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:16.040685    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" podUID="4facec1d-b9d5-4820-b551-ba291778cd05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 10:46:17.040817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:17.040777    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lrkbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 10:46:17.041254 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:17.040850    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" podUID="4facec1d-b9d5-4820-b551-ba291778cd05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 10:46:17.057448 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:17.057417    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-cmmq2"
Sep 19 10:46:18.039994 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:18.039949    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lrkbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 10:46:18.040183 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:18.040017    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" podUID="4facec1d-b9d5-4820-b551-ba291778cd05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 10:46:19.040790 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:19.040745    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lrkbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 10:46:19.041205 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:19.040822    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf" podUID="4facec1d-b9d5-4820-b551-ba291778cd05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 10:46:20.046093 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:20.046052    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:46:20.047591 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:20.047563    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:46:20.048165 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:20.048137    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lrkbf"
Sep 19 10:46:22.917470 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.917434    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"]
Sep 19 10:46:22.921009 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.920985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:22.925791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.925742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 19 10:46:22.925791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.925786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 19 10:46:22.925992 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.925742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 19 10:46:22.926051 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.926004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-prjcd\""
Sep 19 10:46:22.930869 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.930848    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"]
Sep 19 10:46:22.991918 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.991878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:22.992134 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.991963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:22.992134 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.992066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:22.992134 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.992122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhh6p\" (UniqueName: \"kubernetes.io/projected/8afe6e78-2089-4c67-b2da-a7cabde4c126-kube-api-access-rhh6p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:22.992320 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.992176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:22.992320 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:22.992216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8afe6e78-2089-4c67-b2da-a7cabde4c126-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.092906 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.092863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.093091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.092919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.093091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.092943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhh6p\" (UniqueName: \"kubernetes.io/projected/8afe6e78-2089-4c67-b2da-a7cabde4c126-kube-api-access-rhh6p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.093091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.092974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.093091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.092999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8afe6e78-2089-4c67-b2da-a7cabde4c126-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.093091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.093020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.093452 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.093412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.093569 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.093469    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.093569 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.093492    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.095281 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.095262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8afe6e78-2089-4c67-b2da-a7cabde4c126-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.095698 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.095678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8afe6e78-2089-4c67-b2da-a7cabde4c126-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.101507 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.101486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhh6p\" (UniqueName: \"kubernetes.io/projected/8afe6e78-2089-4c67-b2da-a7cabde4c126-kube-api-access-rhh6p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2fwvj\" (UID: \"8afe6e78-2089-4c67-b2da-a7cabde4c126\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.233023 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.232926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:23.507527 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:23.507497    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"]
Sep 19 10:46:23.508997 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:46:23.508972    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afe6e78_2089_4c67_b2da_a7cabde4c126.slice/crio-cf9f1d427e9923d33a8e52834406a546527d979c7e5671b57e7be3e0db464b17 WatchSource:0}: Error finding container cf9f1d427e9923d33a8e52834406a546527d979c7e5671b57e7be3e0db464b17: Status 404 returned error can't find the container with id cf9f1d427e9923d33a8e52834406a546527d979c7e5671b57e7be3e0db464b17
Sep 19 10:46:24.173051 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:24.173007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj" event={"ID":"8afe6e78-2089-4c67-b2da-a7cabde4c126","Type":"ContainerStarted","Data":"cf9f1d427e9923d33a8e52834406a546527d979c7e5671b57e7be3e0db464b17"}
Sep 19 10:46:25.179652 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:25.179606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj" event={"ID":"8afe6e78-2089-4c67-b2da-a7cabde4c126","Type":"ContainerStarted","Data":"6f625ea739634c5f2412a4a922d7242a507af17b36a7ddcd115bd044c12b7327"}
Sep 19 10:46:25.197300 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:25.197242    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj" podStartSLOduration=2.217578347 podStartE2EDuration="3.197223223s" totalImagesPullingTime="979.644876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:46:25.194540402 +0000 UTC m=+589.128246645" watchObservedRunningTime="2026-09-19 10:46:25.197223223 +0000 UTC m=+589.130929439"
Sep 19 10:46:33.233923 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:33.233883    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:33.234319 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:33.234175    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:33.247079 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:33.247049    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:34.237211 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:34.237183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2fwvj"
Sep 19 10:46:38.072039 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:38.072012    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:46:38.072573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:38.072512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:46:51.017525 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.017418    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"]
Sep 19 10:46:51.021197 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.021174    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.023422 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.023395    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 19 10:46:51.031155 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.031128    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"]
Sep 19 10:46:51.145192 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.145157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b8fafe9-b6d3-4b56-850c-dc69786eb862-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.145375 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.145216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.145375 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.145276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.145375 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.145332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvwx4\" (UniqueName: \"kubernetes.io/projected/8b8fafe9-b6d3-4b56-850c-dc69786eb862-kube-api-access-xvwx4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.145375 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.145356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.145515 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.145415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.246523 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.246462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.246523 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.246532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvwx4\" (UniqueName: \"kubernetes.io/projected/8b8fafe9-b6d3-4b56-850c-dc69786eb862-kube-api-access-xvwx4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.246782 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.246591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.246782 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.246667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.246782 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.246725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b8fafe9-b6d3-4b56-850c-dc69786eb862-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.246923 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.246794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.247022 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.246999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.247088 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.247007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.247143 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.247134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.248912 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.248889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b8fafe9-b6d3-4b56-850c-dc69786eb862-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.249194 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.249173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b8fafe9-b6d3-4b56-850c-dc69786eb862-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.258574 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.255054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvwx4\" (UniqueName: \"kubernetes.io/projected/8b8fafe9-b6d3-4b56-850c-dc69786eb862-kube-api-access-xvwx4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vghlg\" (UID: \"8b8fafe9-b6d3-4b56-850c-dc69786eb862\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.333833 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.333783    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:46:51.609517 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.609487    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"]
Sep 19 10:46:51.610952 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:46:51.610923    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8fafe9_b6d3_4b56_850c_dc69786eb862.slice/crio-fad15d88867569db48c31ca695c3aa7550dfdfb4d8e878771a7698ddeac86513 WatchSource:0}: Error finding container fad15d88867569db48c31ca695c3aa7550dfdfb4d8e878771a7698ddeac86513: Status 404 returned error can't find the container with id fad15d88867569db48c31ca695c3aa7550dfdfb4d8e878771a7698ddeac86513
Sep 19 10:46:51.612241 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:51.612222    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 10:46:52.322235 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:52.322195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg" event={"ID":"8b8fafe9-b6d3-4b56-850c-dc69786eb862","Type":"ContainerStarted","Data":"5738fd0bab4e6a728c3b50434a19b1f9f2a515c1296e794b9720f368d38bad5c"}
Sep 19 10:46:52.322664 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:52.322260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg" event={"ID":"8b8fafe9-b6d3-4b56-850c-dc69786eb862","Type":"ContainerStarted","Data":"fad15d88867569db48c31ca695c3aa7550dfdfb4d8e878771a7698ddeac86513"}
Sep 19 10:46:52.339091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:46:52.339035    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg" podStartSLOduration=2.167132884 podStartE2EDuration="2.339015691s" totalImagesPullingTime="171.882807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:46:52.337095068 +0000 UTC m=+616.270801322" watchObservedRunningTime="2026-09-19 10:46:52.339015691 +0000 UTC m=+616.272721905"
Sep 19 10:47:00.799085 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.799039    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"]
Sep 19 10:47:00.803097 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.803073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:00.805301 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.805272    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 19 10:47:00.815382 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.814285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"]
Sep 19 10:47:00.942617 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.942579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:00.942820 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.942627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:00.942820 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.942671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:00.942820 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.942699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:00.942820 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.942783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:00.942996 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:00.942891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh7fc\" (UniqueName: \"kubernetes.io/projected/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-kube-api-access-wh7fc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.043675 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.043633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh7fc\" (UniqueName: \"kubernetes.io/projected/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-kube-api-access-wh7fc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.043675 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.043681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.043945 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.043719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.043945 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.043743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.043945 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.043771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.043945 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.043810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.044242 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.044218    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.044297 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.044230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.044297 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.044267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.046057 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.046037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.046347 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.046328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.051253 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.051201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh7fc\" (UniqueName: \"kubernetes.io/projected/002f6ba7-ec6f-42bd-b1af-eaccca4126ce-kube-api-access-wh7fc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qr299\" (UID: \"002f6ba7-ec6f-42bd-b1af-eaccca4126ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.116287 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.116251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:01.334580 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.334528    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:47:01.334761 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.334614    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:47:01.347711 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.347681    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:47:01.382014 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.381986    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vghlg"
Sep 19 10:47:01.392224 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:01.392198    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"]
Sep 19 10:47:01.398150 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:47:01.398122    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002f6ba7_ec6f_42bd_b1af_eaccca4126ce.slice/crio-2f6e32af7c40b04714888bd8ad9a2fc87e7c8042ab6c0ee131689ee499d3803c WatchSource:0}: Error finding container 2f6e32af7c40b04714888bd8ad9a2fc87e7c8042ab6c0ee131689ee499d3803c: Status 404 returned error can't find the container with id 2f6e32af7c40b04714888bd8ad9a2fc87e7c8042ab6c0ee131689ee499d3803c
Sep 19 10:47:02.376483 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:02.376442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299" event={"ID":"002f6ba7-ec6f-42bd-b1af-eaccca4126ce","Type":"ContainerStarted","Data":"d4dfc0a7b4964fcc28568a865eaa46c219d1010136f7e5282f479773ed871cb5"}
Sep 19 10:47:02.376985 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:02.376512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299" event={"ID":"002f6ba7-ec6f-42bd-b1af-eaccca4126ce","Type":"ContainerStarted","Data":"2f6e32af7c40b04714888bd8ad9a2fc87e7c8042ab6c0ee131689ee499d3803c"}
Sep 19 10:47:02.393720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:02.393671    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299" podStartSLOduration=2.217385963 podStartE2EDuration="2.393656046s" totalImagesPullingTime="176.270083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:02.391804633 +0000 UTC m=+626.325510868" watchObservedRunningTime="2026-09-19 10:47:02.393656046 +0000 UTC m=+626.327362320"
Sep 19 10:47:11.116964 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:11.116923    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:11.117614 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:11.116991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:11.129418 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:11.129393    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:47:11.435662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:47:11.435584    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qr299"
Sep 19 10:48:39.318477 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.318438    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"]
Sep 19 10:48:39.322648 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.322624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.324960 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.324932    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-5116ec-openshift-default-dockercfg-mhc9r\""
Sep 19 10:48:39.333917 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.333883    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"]
Sep 19 10:48:39.335503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.334052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-certs\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.335503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.334102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb9qn\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-kube-api-access-hb9qn\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.335503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.334163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-envoy\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.335503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.334199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-socket\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.335503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.334284    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-data\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.335503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.334387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-credential-socket\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.335503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.334449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61ba681-ce00-4c89-964e-7019aa80608c-istiod-ca-cert\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.335503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.334475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61ba681-ce00-4c89-964e-7019aa80608c-istio-podinfo\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.335503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.334524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-istio-token\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.435643 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.435593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-certs\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.435874 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.435655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb9qn\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-kube-api-access-hb9qn\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.435874 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.435700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-envoy\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.435874 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.435730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-socket\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.435874 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.435760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-data\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.435874 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.435810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-credential-socket\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.435874 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.435851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61ba681-ce00-4c89-964e-7019aa80608c-istiod-ca-cert\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.435874 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.435877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61ba681-ce00-4c89-964e-7019aa80608c-istio-podinfo\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.436250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.435906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-istio-token\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.436250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.436074    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-certs\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.436250 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.436115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-socket\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.436411 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.436338    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-data\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.436521 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.436498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-credential-socket\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.437252 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.437227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61ba681-ce00-4c89-964e-7019aa80608c-istiod-ca-cert\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.438644 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.438618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-envoy\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.438793 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.438774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61ba681-ce00-4c89-964e-7019aa80608c-istio-podinfo\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.443814 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.443790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-istio-token\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.444136 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.444116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb9qn\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-kube-api-access-hb9qn\") pod \"e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") " pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.638815 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.638767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:39.920179 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.920155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"]
Sep 19 10:48:39.922292 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:48:39.922253    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61ba681_ce00_4c89_964e_7019aa80608c.slice/crio-89237236511ec41ae1cc978875cdb4d920fe94c65d53eeedf5a918540781c49f WatchSource:0}: Error finding container 89237236511ec41ae1cc978875cdb4d920fe94c65d53eeedf5a918540781c49f: Status 404 returned error can't find the container with id 89237236511ec41ae1cc978875cdb4d920fe94c65d53eeedf5a918540781c49f
Sep 19 10:48:39.924747 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.924716    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:48:39.924820 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.924791    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:48:39.924871 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:39.924820    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:48:40.910754 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:40.910719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" event={"ID":"e61ba681-ce00-4c89-964e-7019aa80608c","Type":"ContainerStarted","Data":"0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78"}
Sep 19 10:48:40.911278 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:40.910780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" event={"ID":"e61ba681-ce00-4c89-964e-7019aa80608c","Type":"ContainerStarted","Data":"89237236511ec41ae1cc978875cdb4d920fe94c65d53eeedf5a918540781c49f"}
Sep 19 10:48:40.932063 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:40.932012    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" podStartSLOduration=1.931996243 podStartE2EDuration="1.931996243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:48:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:48:40.929340635 +0000 UTC m=+724.863046870" watchObservedRunningTime="2026-09-19 10:48:40.931996243 +0000 UTC m=+724.865702457"
Sep 19 10:48:41.640140 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:41.640105    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:41.645445 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:41.645417    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:41.915797 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:41.915711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:41.916770 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:41.916748    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:48:44.848396 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.848353    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"]
Sep 19 10:48:44.852374 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.852349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:44.854736 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.854704    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-5116ec\""
Sep 19 10:48:44.854879 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.854794    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-5116ec-dockercfg-56fb5\""
Sep 19 10:48:44.861570 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.861530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"]
Sep 19 10:48:44.889903 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.889864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68abc6a1-6824-4794-b65d-8849b22e06c2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8\" (UID: \"68abc6a1-6824-4794-b65d-8849b22e06c2\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:44.889903 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.889904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c84w\" (UniqueName: \"kubernetes.io/projected/68abc6a1-6824-4794-b65d-8849b22e06c2-kube-api-access-9c84w\") pod \"payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8\" (UID: \"68abc6a1-6824-4794-b65d-8849b22e06c2\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:44.991155 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.991117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68abc6a1-6824-4794-b65d-8849b22e06c2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8\" (UID: \"68abc6a1-6824-4794-b65d-8849b22e06c2\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:44.991155 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.991159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c84w\" (UniqueName: \"kubernetes.io/projected/68abc6a1-6824-4794-b65d-8849b22e06c2-kube-api-access-9c84w\") pod \"payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8\" (UID: \"68abc6a1-6824-4794-b65d-8849b22e06c2\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:44.991970 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.991935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68abc6a1-6824-4794-b65d-8849b22e06c2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8\" (UID: \"68abc6a1-6824-4794-b65d-8849b22e06c2\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:44.999638 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:44.999604    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c84w\" (UniqueName: \"kubernetes.io/projected/68abc6a1-6824-4794-b65d-8849b22e06c2-kube-api-access-9c84w\") pod \"payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8\" (UID: \"68abc6a1-6824-4794-b65d-8849b22e06c2\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:45.166662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.166581    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:45.440942 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.440867    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"]
Sep 19 10:48:45.446319 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:48:45.446294    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68abc6a1_6824_4794_b65d_8849b22e06c2.slice/crio-0ddcdde7cb5b603abb51d707f4dfa8d2a9b32d22e4dee01efad5a3b78da6dd7f WatchSource:0}: Error finding container 0ddcdde7cb5b603abb51d707f4dfa8d2a9b32d22e4dee01efad5a3b78da6dd7f: Status 404 returned error can't find the container with id 0ddcdde7cb5b603abb51d707f4dfa8d2a9b32d22e4dee01efad5a3b78da6dd7f
Sep 19 10:48:45.610924 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.610888    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"]
Sep 19 10:48:45.615598 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.615571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.618024 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.617993    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-7bcaa9-openshift-default-dockercfg-vcfj5\""
Sep 19 10:48:45.626736 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.626709    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"]
Sep 19 10:48:45.697939 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.697834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-socket\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.697939 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.697900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-credential-socket\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.698182 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.697980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-podinfo\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.698182 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.698071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-envoy\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.698182 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.698104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-token\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.698182 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.698135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bhh8\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-kube-api-access-5bhh8\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.698182 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.698163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ba6c81-becd-447e-879f-6fbb6ba500a5-istiod-ca-cert\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.698462 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.698220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-certs\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.698462 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.698251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-data\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.799542 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.799491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-socket\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.799542 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.799542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-credential-socket\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.799802 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.799632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-podinfo\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.799802 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.799683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-envoy\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.799802 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.799708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-token\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.800150 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.800125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bhh8\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-kube-api-access-5bhh8\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.800243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.800175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ba6c81-becd-447e-879f-6fbb6ba500a5-istiod-ca-cert\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.800243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.800202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-credential-socket\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.800344 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.800254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-socket\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.800344 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.800263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-certs\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.800344 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.800297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-data\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.800531 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.800508    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-certs\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.800628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.800608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-data\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.800897 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.800872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ba6c81-becd-447e-879f-6fbb6ba500a5-istiod-ca-cert\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.802215 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.802197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-envoy\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.802972 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.802953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-podinfo\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.807476 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.807447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-token\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.807917 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.807893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bhh8\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-kube-api-access-5bhh8\") pod \"e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") " pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.929643 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.929602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:45.943284 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.943255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8" event={"ID":"68abc6a1-6824-4794-b65d-8849b22e06c2","Type":"ContainerStarted","Data":"10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b"}
Sep 19 10:48:45.943407 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.943308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8" event={"ID":"68abc6a1-6824-4794-b65d-8849b22e06c2","Type":"ContainerStarted","Data":"0ddcdde7cb5b603abb51d707f4dfa8d2a9b32d22e4dee01efad5a3b78da6dd7f"}
Sep 19 10:48:45.943407 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.943341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:45.960868 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:45.960767    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8" podStartSLOduration=1.9607509730000001 podStartE2EDuration="1.960750973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:48:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:48:45.958725037 +0000 UTC m=+729.892431254" watchObservedRunningTime="2026-09-19 10:48:45.960750973 +0000 UTC m=+729.894457186"
Sep 19 10:48:46.217340 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:46.217108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"]
Sep 19 10:48:46.219798 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:48:46.219765    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ba6c81_becd_447e_879f_6fbb6ba500a5.slice/crio-6280ac657a8fc286701add81e6df5db5ebfcbaeb651c41c030d5ec825d841010 WatchSource:0}: Error finding container 6280ac657a8fc286701add81e6df5db5ebfcbaeb651c41c030d5ec825d841010: Status 404 returned error can't find the container with id 6280ac657a8fc286701add81e6df5db5ebfcbaeb651c41c030d5ec825d841010
Sep 19 10:48:46.222375 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:46.222330    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:48:46.222490 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:46.222420    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:48:46.222490 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:46.222466    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:48:46.955055 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:46.955021    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" event={"ID":"76ba6c81-becd-447e-879f-6fbb6ba500a5","Type":"ContainerStarted","Data":"c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104"}
Sep 19 10:48:46.955499 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:46.955077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" event={"ID":"76ba6c81-becd-447e-879f-6fbb6ba500a5","Type":"ContainerStarted","Data":"6280ac657a8fc286701add81e6df5db5ebfcbaeb651c41c030d5ec825d841010"}
Sep 19 10:48:46.991985 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:46.988809    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" podStartSLOduration=1.9887860819999998 podStartE2EDuration="1.988786082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:48:46.985979811 +0000 UTC m=+730.919686051" watchObservedRunningTime="2026-09-19 10:48:46.988786082 +0000 UTC m=+730.922492301"
Sep 19 10:48:47.930053 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:47.930011    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:47.936711 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:47.936685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:47.961920 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:47.961890    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:47.963008 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:47.962987    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:48:49.984094 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:49.984063    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"]
Sep 19 10:48:49.987648 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:49.987623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:48:49.990343 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:49.990315    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-6a0d36\""
Sep 19 10:48:49.991714 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:49.991695    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-6a0d36-dockercfg-flv44\""
Sep 19 10:48:49.997306 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:49.997283    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"]
Sep 19 10:48:50.046781 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.046738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2d55\" (UniqueName: \"kubernetes.io/projected/5c964ba2-5f78-44d7-be36-d1e6dbce403b-kube-api-access-d2d55\") pod \"payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x\" (UID: \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:48:50.046961 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.046926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c964ba2-5f78-44d7-be36-d1e6dbce403b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x\" (UID: \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:48:50.095374 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.095334    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"]
Sep 19 10:48:50.098878 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.098859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:48:50.109757 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.109728    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"]
Sep 19 10:48:50.147473 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.147435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2d55\" (UniqueName: \"kubernetes.io/projected/5c964ba2-5f78-44d7-be36-d1e6dbce403b-kube-api-access-d2d55\") pod \"payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x\" (UID: \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:48:50.147677 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.147485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85zn\" (UniqueName: \"kubernetes.io/projected/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-kube-api-access-v85zn\") pod \"payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn\" (UID: \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:48:50.147677 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.147508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c964ba2-5f78-44d7-be36-d1e6dbce403b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x\" (UID: \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:48:50.147677 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.147597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn\" (UID: \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:48:50.148223 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.148202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c964ba2-5f78-44d7-be36-d1e6dbce403b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x\" (UID: \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:48:50.157651 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.157619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2d55\" (UniqueName: \"kubernetes.io/projected/5c964ba2-5f78-44d7-be36-d1e6dbce403b-kube-api-access-d2d55\") pod \"payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x\" (UID: \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:48:50.249175 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.249083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85zn\" (UniqueName: \"kubernetes.io/projected/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-kube-api-access-v85zn\") pod \"payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn\" (UID: \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:48:50.249175 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.249145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn\" (UID: \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:48:50.249965 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.249945    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn\" (UID: \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:48:50.256464 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.256438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85zn\" (UniqueName: \"kubernetes.io/projected/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-kube-api-access-v85zn\") pod \"payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn\" (UID: \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:48:50.300355 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.300314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:48:50.410539 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.410494    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:48:50.579425 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.579397    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"]
Sep 19 10:48:50.581017 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:48:50.580991    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c964ba2_5f78_44d7_be36_d1e6dbce403b.slice/crio-e891d5146406299689681042ac07eecec1e8d14832c7987a1db9a47289068c6c WatchSource:0}: Error finding container e891d5146406299689681042ac07eecec1e8d14832c7987a1db9a47289068c6c: Status 404 returned error can't find the container with id e891d5146406299689681042ac07eecec1e8d14832c7987a1db9a47289068c6c
Sep 19 10:48:50.689357 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.689333    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"]
Sep 19 10:48:50.691215 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:48:50.691193    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff8042b_6c88_4c50_a93c_ff9d198c93e8.slice/crio-c2ac533d6f6d41da8130147563635c2d9b0122a1a98594ccc0a74f4023669c00 WatchSource:0}: Error finding container c2ac533d6f6d41da8130147563635c2d9b0122a1a98594ccc0a74f4023669c00: Status 404 returned error can't find the container with id c2ac533d6f6d41da8130147563635c2d9b0122a1a98594ccc0a74f4023669c00
Sep 19 10:48:50.980649 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.980535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn" event={"ID":"6ff8042b-6c88-4c50-a93c-ff9d198c93e8","Type":"ContainerStarted","Data":"40f5cc0c7362b2ef8dbd9ac7317d1f07b00f6aaf6f641879982d358e15db96d9"}
Sep 19 10:48:50.980649 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.980648    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:48:50.980890 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.980674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn" event={"ID":"6ff8042b-6c88-4c50-a93c-ff9d198c93e8","Type":"ContainerStarted","Data":"c2ac533d6f6d41da8130147563635c2d9b0122a1a98594ccc0a74f4023669c00"}
Sep 19 10:48:50.982391 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.982332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x" event={"ID":"5c964ba2-5f78-44d7-be36-d1e6dbce403b","Type":"ContainerStarted","Data":"6bfd2dab02546c134880cc13eccf4a137779d2042f9a5ea899c5b622f91d362a"}
Sep 19 10:48:50.982530 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.982422    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:48:50.982530 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:50.982448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x" event={"ID":"5c964ba2-5f78-44d7-be36-d1e6dbce403b","Type":"ContainerStarted","Data":"e891d5146406299689681042ac07eecec1e8d14832c7987a1db9a47289068c6c"}
Sep 19 10:48:51.004955 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.004903    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn" podStartSLOduration=1.004887112 podStartE2EDuration="1.004887112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:48:51.003278355 +0000 UTC m=+734.936984590" watchObservedRunningTime="2026-09-19 10:48:51.004887112 +0000 UTC m=+734.938593326"
Sep 19 10:48:51.031608 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.031526    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x" podStartSLOduration=2.031503494 podStartE2EDuration="2.031503494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:48:51.030474608 +0000 UTC m=+734.964180842" watchObservedRunningTime="2026-09-19 10:48:51.031503494 +0000 UTC m=+734.965209709"
Sep 19 10:48:51.167761 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.167723    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"]
Sep 19 10:48:51.172042 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.172019    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:48:51.174245 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.174224    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-7bcaa9-dockercfg-cd5r4\""
Sep 19 10:48:51.174412 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.174392    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-7bcaa9\""
Sep 19 10:48:51.180121 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.180097    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"]
Sep 19 10:48:51.260940 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.260832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzpd2\" (UniqueName: \"kubernetes.io/projected/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-kube-api-access-xzpd2\") pod \"payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27\" (UID: \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\") " pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:48:51.260940 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.260895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-plugins-config-volume\") pod \"payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27\" (UID: \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\") " pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:48:51.362498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.362465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzpd2\" (UniqueName: \"kubernetes.io/projected/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-kube-api-access-xzpd2\") pod \"payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27\" (UID: \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\") " pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:48:51.362498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.362506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-plugins-config-volume\") pod \"payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27\" (UID: \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\") " pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:48:51.363298 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.363271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-plugins-config-volume\") pod \"payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27\" (UID: \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\") " pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:48:51.370100 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.370064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzpd2\" (UniqueName: \"kubernetes.io/projected/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-kube-api-access-xzpd2\") pod \"payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27\" (UID: \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\") " pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:48:51.484327 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.484295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:48:51.766917 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.766889    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"]
Sep 19 10:48:51.769769 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:48:51.769739    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f03adb_67ed_4663_b1a0_b30d7f4c8b48.slice/crio-3f8ab693510b89513a13e4ad1d0453ee49bd243ce9c909d6f0ab5f3521510bef WatchSource:0}: Error finding container 3f8ab693510b89513a13e4ad1d0453ee49bd243ce9c909d6f0ab5f3521510bef: Status 404 returned error can't find the container with id 3f8ab693510b89513a13e4ad1d0453ee49bd243ce9c909d6f0ab5f3521510bef
Sep 19 10:48:51.994914 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.994752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27" event={"ID":"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48","Type":"ContainerStarted","Data":"1af8fc09674939ff2f1b728950d08fe684749daa2aff6fb0636b5cc53f87beea"}
Sep 19 10:48:51.994914 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.994819    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27" event={"ID":"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48","Type":"ContainerStarted","Data":"3f8ab693510b89513a13e4ad1d0453ee49bd243ce9c909d6f0ab5f3521510bef"}
Sep 19 10:48:51.995480 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:51.995434    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:48:52.012466 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:52.012412    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27" podStartSLOduration=1.012395282 podStartE2EDuration="1.012395282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:48:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:48:52.008940962 +0000 UTC m=+735.942647199" watchObservedRunningTime="2026-09-19 10:48:52.012395282 +0000 UTC m=+735.946101497"
Sep 19 10:48:56.957708 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:56.957678    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 10:48:58.645912 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.645874    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"]
Sep 19 10:48:58.649569 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.649532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:48:58.653070 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.653046    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c152d119-dockercfg-pzmxt\""
Sep 19 10:48:58.653381 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.653361    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c152d119\""
Sep 19 10:48:58.670541 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.670511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"]
Sep 19 10:48:58.749187 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.749146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-plugins-config-volume\") pod \"payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8\" (UID: \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\") " pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:48:58.749378 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.749195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq2v4\" (UniqueName: \"kubernetes.io/projected/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-kube-api-access-bq2v4\") pod \"payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8\" (UID: \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\") " pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:48:58.850208 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.850162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-plugins-config-volume\") pod \"payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8\" (UID: \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\") " pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:48:58.850423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.850230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2v4\" (UniqueName: \"kubernetes.io/projected/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-kube-api-access-bq2v4\") pod \"payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8\" (UID: \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\") " pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:48:58.851261 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.851230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-plugins-config-volume\") pod \"payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8\" (UID: \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\") " pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:48:58.865292 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.865259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq2v4\" (UniqueName: \"kubernetes.io/projected/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-kube-api-access-bq2v4\") pod \"payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8\" (UID: \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\") " pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:48:58.963606 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:58.963483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:48:59.267723 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:48:59.267666    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"]
Sep 19 10:48:59.269988 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:48:59.269957    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bc5c52_7a68_4d46_848d_8142b1c2ba5a.slice/crio-2b9c3242168f2baa370bf703b2587f08669a15185509a800019631d8349724ab WatchSource:0}: Error finding container 2b9c3242168f2baa370bf703b2587f08669a15185509a800019631d8349724ab: Status 404 returned error can't find the container with id 2b9c3242168f2baa370bf703b2587f08669a15185509a800019631d8349724ab
Sep 19 10:49:00.064437 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:00.064385    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8" event={"ID":"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a","Type":"ContainerStarted","Data":"02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010"}
Sep 19 10:49:00.064964 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:00.064769    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:49:00.064964 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:00.064801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8" event={"ID":"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a","Type":"ContainerStarted","Data":"2b9c3242168f2baa370bf703b2587f08669a15185509a800019631d8349724ab"}
Sep 19 10:49:01.997238 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:01.997205    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:49:01.997759 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:01.997593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:49:02.012383 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:02.012322    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8" podStartSLOduration=4.012301949 podStartE2EDuration="4.012301949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:49:00.083119765 +0000 UTC m=+744.016825983" watchObservedRunningTime="2026-09-19 10:49:02.012301949 +0000 UTC m=+745.946008164"
Sep 19 10:49:04.008512 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:04.008484    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:49:04.090507 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:04.090476    2563 generic.go:356] "Generic (PLEG): container finished" podID="e61ba681-ce00-4c89-964e-7019aa80608c" containerID="0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78" exitCode=0
Sep 19 10:49:04.090691 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:04.090559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" event={"ID":"e61ba681-ce00-4c89-964e-7019aa80608c","Type":"ContainerDied","Data":"0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78"}
Sep 19 10:49:04.091000 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:04.090986    2563 scope.go:117] "RemoveContainer" containerID="0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78"
Sep 19 10:49:04.092136 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:04.092107    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:49:04.092256 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:04.092196    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:49:04.092256 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:04.092245    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:49:05.099502 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:05.099468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" event={"ID":"e61ba681-ce00-4c89-964e-7019aa80608c","Type":"ContainerStarted","Data":"4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f"}
Sep 19 10:49:05.640686 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:05.640647    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:49:05.641394 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:05.641018    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 19 10:49:05.641636 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:05.641594    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 19 10:49:06.639822 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:06.639770    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 19 10:49:06.640346 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:06.639847    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 19 10:49:07.639769 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:07.639724    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 19 10:49:07.639957 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:07.639819    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 19 10:49:08.640603 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:08.640565    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 19 10:49:08.641707 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:08.641253    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 19 10:49:09.639783 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.639739    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 19 10:49:09.641289 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.639809    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 19 10:49:09.840113 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.840007    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"]
Sep 19 10:49:09.842923 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.842900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"
Sep 19 10:49:09.845171 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.845150    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:49:09.845278 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.845156    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:49:09.850392 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.850362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"]
Sep 19 10:49:09.880163 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.880126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29fa977-34de-4404-8d89-aefb591f2d41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c152d119-8bd7n\" (UID: \"f29fa977-34de-4404-8d89-aefb591f2d41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"
Sep 19 10:49:09.981585 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.981482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29fa977-34de-4404-8d89-aefb591f2d41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c152d119-8bd7n\" (UID: \"f29fa977-34de-4404-8d89-aefb591f2d41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"
Sep 19 10:49:09.982168 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:09.982145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29fa977-34de-4404-8d89-aefb591f2d41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c152d119-8bd7n\" (UID: \"f29fa977-34de-4404-8d89-aefb591f2d41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"
Sep 19 10:49:10.146580 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.146528    2563 generic.go:356] "Generic (PLEG): container finished" podID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerID="c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104" exitCode=0
Sep 19 10:49:10.146755 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.146581    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" event={"ID":"76ba6c81-becd-447e-879f-6fbb6ba500a5","Type":"ContainerDied","Data":"c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104"}
Sep 19 10:49:10.147180 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.147161    2563 scope.go:117] "RemoveContainer" containerID="c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104"
Sep 19 10:49:10.148581 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.148540    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:49:10.148687 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.148637    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:49:10.148687 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.148674    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:49:10.156569 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.156540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"
Sep 19 10:49:10.468730 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.468706    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"]
Sep 19 10:49:10.470273 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:49:10.470236    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29fa977_34de_4404_8d89_aefb591f2d41.slice/crio-dcda0a718e08312a8ebd726b7fb39ec7f79691de3f929a749e9e64732d46dfa3 WatchSource:0}: Error finding container dcda0a718e08312a8ebd726b7fb39ec7f79691de3f929a749e9e64732d46dfa3: Status 404 returned error can't find the container with id dcda0a718e08312a8ebd726b7fb39ec7f79691de3f929a749e9e64732d46dfa3
Sep 19 10:49:10.640104 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.640064    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 19 10:49:10.640284 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:10.640135    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 19 10:49:11.072601 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:11.072539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:49:11.157834 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:11.157799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n" event={"ID":"f29fa977-34de-4404-8d89-aefb591f2d41","Type":"ContainerStarted","Data":"dcda0a718e08312a8ebd726b7fb39ec7f79691de3f929a749e9e64732d46dfa3"}
Sep 19 10:49:11.159862 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:11.159835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" event={"ID":"76ba6c81-becd-447e-879f-6fbb6ba500a5","Type":"ContainerStarted","Data":"cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697"}
Sep 19 10:49:11.644954 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:11.644913    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:49:11.645460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:11.645400    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:49:11.646327 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:11.646305    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 10:49:11.932599 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:11.931993    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:49:11.932599 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:11.932121    2563 patch_prober.go:28] interesting pod/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 19 10:49:11.932599 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:11.932166    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 19 10:49:12.935573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:12.932004    2563 patch_prober.go:28] interesting pod/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 19 10:49:12.935573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:12.932071    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 19 10:49:13.739721 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.739687    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"]
Sep 19 10:49:13.745978 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.745945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:13.748388 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.748360    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-df95e5-dockercfg-47wrb\""
Sep 19 10:49:13.748388 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.748373    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-df95e5\""
Sep 19 10:49:13.754105 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.754071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"]
Sep 19 10:49:13.760314 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.760280    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"]
Sep 19 10:49:13.764072 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.764048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:13.779396 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.779033    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"]
Sep 19 10:49:13.847791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.847726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn52l\" (UniqueName: \"kubernetes.io/projected/dd1c5874-23e7-4b19-b3ed-668173e9589c-kube-api-access-qn52l\") pod \"payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld\" (UID: \"dd1c5874-23e7-4b19-b3ed-668173e9589c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:13.848013 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.847804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1c5874-23e7-4b19-b3ed-668173e9589c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld\" (UID: \"dd1c5874-23e7-4b19-b3ed-668173e9589c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:13.848013 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.847838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl448\" (UniqueName: \"kubernetes.io/projected/9ff253a2-96a4-461f-8c9a-57945f45fb35-kube-api-access-rl448\") pod \"payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx\" (UID: \"9ff253a2-96a4-461f-8c9a-57945f45fb35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:13.848013 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.847971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ff253a2-96a4-461f-8c9a-57945f45fb35-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx\" (UID: \"9ff253a2-96a4-461f-8c9a-57945f45fb35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:13.930526 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.930477    2563 patch_prober.go:28] interesting pod/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 19 10:49:13.930759 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.930571    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 19 10:49:13.949179 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.949140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ff253a2-96a4-461f-8c9a-57945f45fb35-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx\" (UID: \"9ff253a2-96a4-461f-8c9a-57945f45fb35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:13.949616 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.949211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn52l\" (UniqueName: \"kubernetes.io/projected/dd1c5874-23e7-4b19-b3ed-668173e9589c-kube-api-access-qn52l\") pod \"payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld\" (UID: \"dd1c5874-23e7-4b19-b3ed-668173e9589c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:13.949616 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.949248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1c5874-23e7-4b19-b3ed-668173e9589c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld\" (UID: \"dd1c5874-23e7-4b19-b3ed-668173e9589c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:13.949616 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.949267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl448\" (UniqueName: \"kubernetes.io/projected/9ff253a2-96a4-461f-8c9a-57945f45fb35-kube-api-access-rl448\") pod \"payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx\" (UID: \"9ff253a2-96a4-461f-8c9a-57945f45fb35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:13.949928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.949906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ff253a2-96a4-461f-8c9a-57945f45fb35-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx\" (UID: \"9ff253a2-96a4-461f-8c9a-57945f45fb35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:13.950053 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.950035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1c5874-23e7-4b19-b3ed-668173e9589c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld\" (UID: \"dd1c5874-23e7-4b19-b3ed-668173e9589c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:13.957619 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.957589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn52l\" (UniqueName: \"kubernetes.io/projected/dd1c5874-23e7-4b19-b3ed-668173e9589c-kube-api-access-qn52l\") pod \"payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld\" (UID: \"dd1c5874-23e7-4b19-b3ed-668173e9589c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:13.957744 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:13.957591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl448\" (UniqueName: \"kubernetes.io/projected/9ff253a2-96a4-461f-8c9a-57945f45fb35-kube-api-access-rl448\") pod \"payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx\" (UID: \"9ff253a2-96a4-461f-8c9a-57945f45fb35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:14.058877 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:14.058833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:14.079753 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:14.079719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:14.185747 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:14.185680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n" event={"ID":"f29fa977-34de-4404-8d89-aefb591f2d41","Type":"ContainerStarted","Data":"fa1906f389e52c4996dad7d7cbdc7f6d5532c8d9807917472e3989e2adf12f35"}
Sep 19 10:49:14.206877 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:14.204867    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n" podStartSLOduration=2.41310125 podStartE2EDuration="5.20475531s" totalImagesPullingTime="2.79165406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:49:14.202165599 +0000 UTC m=+758.135871825" watchObservedRunningTime="2026-09-19 10:49:14.20475531 +0000 UTC m=+758.138461526"
Sep 19 10:49:14.367319 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:14.367288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"]
Sep 19 10:49:14.368266 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:49:14.368238    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff253a2_96a4_461f_8c9a_57945f45fb35.slice/crio-658c4876bb63f553e79bc57b1a5c3d7d241d38b15d4fbd909a81fac8c2bb79c5 WatchSource:0}: Error finding container 658c4876bb63f553e79bc57b1a5c3d7d241d38b15d4fbd909a81fac8c2bb79c5: Status 404 returned error can't find the container with id 658c4876bb63f553e79bc57b1a5c3d7d241d38b15d4fbd909a81fac8c2bb79c5
Sep 19 10:49:14.392665 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:14.392638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"]
Sep 19 10:49:14.394903 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:49:14.394797    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1c5874_23e7_4b19_b3ed_668173e9589c.slice/crio-ef0faeb6be0581a20db5bbd4797facd4ad19e58c986315c7d07090b3406045bd WatchSource:0}: Error finding container ef0faeb6be0581a20db5bbd4797facd4ad19e58c986315c7d07090b3406045bd: Status 404 returned error can't find the container with id ef0faeb6be0581a20db5bbd4797facd4ad19e58c986315c7d07090b3406045bd
Sep 19 10:49:14.930151 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:14.930101    2563 patch_prober.go:28] interesting pod/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 19 10:49:14.930367 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:14.930172    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 19 10:49:15.193607 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.193497    2563 generic.go:356] "Generic (PLEG): container finished" podID="f29fa977-34de-4404-8d89-aefb591f2d41" containerID="fa1906f389e52c4996dad7d7cbdc7f6d5532c8d9807917472e3989e2adf12f35" exitCode=0
Sep 19 10:49:15.193607 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.193562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n" event={"ID":"f29fa977-34de-4404-8d89-aefb591f2d41","Type":"ContainerDied","Data":"fa1906f389e52c4996dad7d7cbdc7f6d5532c8d9807917472e3989e2adf12f35"}
Sep 19 10:49:15.195259 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.195226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld" event={"ID":"dd1c5874-23e7-4b19-b3ed-668173e9589c","Type":"ContainerStarted","Data":"4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7"}
Sep 19 10:49:15.195396 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.195301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld" event={"ID":"dd1c5874-23e7-4b19-b3ed-668173e9589c","Type":"ContainerStarted","Data":"ef0faeb6be0581a20db5bbd4797facd4ad19e58c986315c7d07090b3406045bd"}
Sep 19 10:49:15.195396 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.195324    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:15.196679 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.196657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx" event={"ID":"9ff253a2-96a4-461f-8c9a-57945f45fb35","Type":"ContainerStarted","Data":"bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c"}
Sep 19 10:49:15.196780 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.196693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx" event={"ID":"9ff253a2-96a4-461f-8c9a-57945f45fb35","Type":"ContainerStarted","Data":"658c4876bb63f553e79bc57b1a5c3d7d241d38b15d4fbd909a81fac8c2bb79c5"}
Sep 19 10:49:15.196828 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.196809    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:15.249001 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.248331    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx" podStartSLOduration=2.248307667 podStartE2EDuration="2.248307667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:49:15.229600649 +0000 UTC m=+759.163306887" watchObservedRunningTime="2026-09-19 10:49:15.248307667 +0000 UTC m=+759.182013885"
Sep 19 10:49:15.249225 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.249011    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld" podStartSLOduration=2.248999108 podStartE2EDuration="2.248999108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:49:15.24404067 +0000 UTC m=+759.177746913" watchObservedRunningTime="2026-09-19 10:49:15.248999108 +0000 UTC m=+759.182705323"
Sep 19 10:49:15.930951 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.930911    2563 patch_prober.go:28] interesting pod/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 19 10:49:15.931253 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:15.931217    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 19 10:49:16.404002 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:16.403965    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"
Sep 19 10:49:16.473812 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:16.473720    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29fa977-34de-4404-8d89-aefb591f2d41-maas-api-service-ca\") pod \"f29fa977-34de-4404-8d89-aefb591f2d41\" (UID: \"f29fa977-34de-4404-8d89-aefb591f2d41\") "
Sep 19 10:49:16.474082 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:16.474060    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f29fa977-34de-4404-8d89-aefb591f2d41-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f29fa977-34de-4404-8d89-aefb591f2d41" (UID: "f29fa977-34de-4404-8d89-aefb591f2d41"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:49:16.575505 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:16.575471    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f29fa977-34de-4404-8d89-aefb591f2d41-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:49:16.930929 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:16.930892    2563 patch_prober.go:28] interesting pod/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 19 10:49:16.931237 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:16.931206    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 19 10:49:17.211504 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:17.211421    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"
Sep 19 10:49:17.211696 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:17.211418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n" event={"ID":"f29fa977-34de-4404-8d89-aefb591f2d41","Type":"ContainerDied","Data":"dcda0a718e08312a8ebd726b7fb39ec7f79691de3f929a749e9e64732d46dfa3"}
Sep 19 10:49:17.211696 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:17.211581    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcda0a718e08312a8ebd726b7fb39ec7f79691de3f929a749e9e64732d46dfa3"
Sep 19 10:49:17.934967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:17.934933    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:49:17.935435 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:17.935352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:49:17.936322 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:17.936300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:49:20.298493 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.298458    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"]
Sep 19 10:49:20.298995 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.298691    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8" podUID="f9bc5c52-7a68-4d46-848d-8142b1c2ba5a" containerName="payload-processing" containerID="cri-o://02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010" gracePeriod=30
Sep 19 10:49:20.468991 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.468733    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"]
Sep 19 10:49:20.482360 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.478957    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c152d119-8bd7n"]
Sep 19 10:49:20.578061 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.578019    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:49:20.715985 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.715948    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-plugins-config-volume\") pod \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\" (UID: \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\") "
Sep 19 10:49:20.715985 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.715984    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq2v4\" (UniqueName: \"kubernetes.io/projected/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-kube-api-access-bq2v4\") pod \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\" (UID: \"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a\") "
Sep 19 10:49:20.716353 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.716330    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9bc5c52-7a68-4d46-848d-8142b1c2ba5a" (UID: "f9bc5c52-7a68-4d46-848d-8142b1c2ba5a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:49:20.718219 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.718185    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-kube-api-access-bq2v4" (OuterVolumeSpecName: "kube-api-access-bq2v4") pod "f9bc5c52-7a68-4d46-848d-8142b1c2ba5a" (UID: "f9bc5c52-7a68-4d46-848d-8142b1c2ba5a"). InnerVolumeSpecName "kube-api-access-bq2v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:49:20.816777 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.816690    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:49:20.816777 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:20.816720    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq2v4\" (UniqueName: \"kubernetes.io/projected/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a-kube-api-access-bq2v4\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:49:21.241538 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:21.241502    2563 generic.go:356] "Generic (PLEG): container finished" podID="f9bc5c52-7a68-4d46-848d-8142b1c2ba5a" containerID="02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010" exitCode=0
Sep 19 10:49:21.241762 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:21.241567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8" event={"ID":"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a","Type":"ContainerDied","Data":"02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010"}
Sep 19 10:49:21.241762 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:21.241582    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"
Sep 19 10:49:21.241762 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:21.241620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8" event={"ID":"f9bc5c52-7a68-4d46-848d-8142b1c2ba5a","Type":"ContainerDied","Data":"2b9c3242168f2baa370bf703b2587f08669a15185509a800019631d8349724ab"}
Sep 19 10:49:21.241762 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:21.241644    2563 scope.go:117] "RemoveContainer" containerID="02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010"
Sep 19 10:49:21.251083 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:21.251065    2563 scope.go:117] "RemoveContainer" containerID="02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010"
Sep 19 10:49:21.251359 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:49:21.251337    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010\": container with ID starting with 02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010 not found: ID does not exist" containerID="02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010"
Sep 19 10:49:21.251415 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:21.251369    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010"} err="failed to get container status \"02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010\": rpc error: code = NotFound desc = could not find container \"02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010\": container with ID starting with 02eb04e1ab9b1319a36ed74873781c880c02fcc93d58282ee1804e2562a19010 not found: ID does not exist"
Sep 19 10:49:21.264434 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:21.264402    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"]
Sep 19 10:49:21.268147 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:21.268124    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c152d119-77d7c4c5cf-sdth8"]
Sep 19 10:49:22.119339 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:22.119308    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f29fa977-34de-4404-8d89-aefb591f2d41" path="/var/lib/kubelet/pods/f29fa977-34de-4404-8d89-aefb591f2d41/volumes"
Sep 19 10:49:22.119744 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:22.119713    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9bc5c52-7a68-4d46-848d-8142b1c2ba5a" path="/var/lib/kubelet/pods/f9bc5c52-7a68-4d46-848d-8142b1c2ba5a/volumes"
Sep 19 10:49:26.205017 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.204985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:49:26.205401 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.205067    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:49:26.554716 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.554634    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"]
Sep 19 10:49:26.555121 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.555107    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f29fa977-34de-4404-8d89-aefb591f2d41" containerName="revoke-keys"
Sep 19 10:49:26.555174 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.555124    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f29fa977-34de-4404-8d89-aefb591f2d41" containerName="revoke-keys"
Sep 19 10:49:26.555174 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.555146    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9bc5c52-7a68-4d46-848d-8142b1c2ba5a" containerName="payload-processing"
Sep 19 10:49:26.555174 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.555152    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9bc5c52-7a68-4d46-848d-8142b1c2ba5a" containerName="payload-processing"
Sep 19 10:49:26.555275 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.555236    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f29fa977-34de-4404-8d89-aefb591f2d41" containerName="revoke-keys"
Sep 19 10:49:26.555275 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.555247    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9bc5c52-7a68-4d46-848d-8142b1c2ba5a" containerName="payload-processing"
Sep 19 10:49:26.557520 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.557504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:26.560128 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.560108    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-18e8cec5\""
Sep 19 10:49:26.560128 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.560117    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-18e8cec5-dockercfg-52bpl\""
Sep 19 10:49:26.574138 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.574109    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"]
Sep 19 10:49:26.590217 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.590188    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"]
Sep 19 10:49:26.592925 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.592908    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:26.603530 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.603505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"]
Sep 19 10:49:26.678169 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.678114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfmhm\" (UniqueName: \"kubernetes.io/projected/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-kube-api-access-kfmhm\") pod \"payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh\" (UID: \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\") " pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:26.678345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.678200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-plugins-config-volume\") pod \"payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh\" (UID: \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\") " pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:26.678345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.678304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlqtc\" (UniqueName: \"kubernetes.io/projected/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-kube-api-access-wlqtc\") pod \"payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8\" (UID: \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:26.678472 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.678436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8\" (UID: \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:26.779334 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.779290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8\" (UID: \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:26.779509 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.779367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfmhm\" (UniqueName: \"kubernetes.io/projected/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-kube-api-access-kfmhm\") pod \"payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh\" (UID: \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\") " pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:26.779509 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.779403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-plugins-config-volume\") pod \"payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh\" (UID: \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\") " pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:26.779509 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.779428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqtc\" (UniqueName: \"kubernetes.io/projected/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-kube-api-access-wlqtc\") pod \"payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8\" (UID: \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:26.780104 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.780085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8\" (UID: \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:26.780193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.780174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-plugins-config-volume\") pod \"payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh\" (UID: \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\") " pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:26.786807 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.786782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlqtc\" (UniqueName: \"kubernetes.io/projected/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-kube-api-access-wlqtc\") pod \"payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8\" (UID: \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:26.786928 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.786873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfmhm\" (UniqueName: \"kubernetes.io/projected/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-kube-api-access-kfmhm\") pod \"payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh\" (UID: \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\") " pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:26.875473 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.875439    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:26.903941 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:26.903901    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:27.157245 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.157213    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"]
Sep 19 10:49:27.158341 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:49:27.158312    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c53f02_fd2e_4d2f_bfe0_5dd8910aaa19.slice/crio-f9ee65eb33630a03b6a6d94c203f8ef031a21bc1f0646b6fe6e9066a4a726007 WatchSource:0}: Error finding container f9ee65eb33630a03b6a6d94c203f8ef031a21bc1f0646b6fe6e9066a4a726007: Status 404 returned error can't find the container with id f9ee65eb33630a03b6a6d94c203f8ef031a21bc1f0646b6fe6e9066a4a726007
Sep 19 10:49:27.188474 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.188443    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"]
Sep 19 10:49:27.190711 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:49:27.190683    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c84ca54_6045_49ec_8cb1_ea29d0e540c5.slice/crio-990f2654c7a8fe171aa817e0118aaad78071ca83c8f605e357fc9d5aba58198d WatchSource:0}: Error finding container 990f2654c7a8fe171aa817e0118aaad78071ca83c8f605e357fc9d5aba58198d: Status 404 returned error can't find the container with id 990f2654c7a8fe171aa817e0118aaad78071ca83c8f605e357fc9d5aba58198d
Sep 19 10:49:27.279204 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.279160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh" event={"ID":"7c84ca54-6045-49ec-8cb1-ea29d0e540c5","Type":"ContainerStarted","Data":"cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a"}
Sep 19 10:49:27.279683 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.279219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh" event={"ID":"7c84ca54-6045-49ec-8cb1-ea29d0e540c5","Type":"ContainerStarted","Data":"990f2654c7a8fe171aa817e0118aaad78071ca83c8f605e357fc9d5aba58198d"}
Sep 19 10:49:27.279683 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.279249    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:27.281287 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.281259    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8" event={"ID":"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19","Type":"ContainerStarted","Data":"6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb"}
Sep 19 10:49:27.281419 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.281306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8" event={"ID":"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19","Type":"ContainerStarted","Data":"f9ee65eb33630a03b6a6d94c203f8ef031a21bc1f0646b6fe6e9066a4a726007"}
Sep 19 10:49:27.281419 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.281363    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:27.298947 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.298887    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh" podStartSLOduration=1.298840258 podStartE2EDuration="1.298840258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:49:27.294951933 +0000 UTC m=+771.228658179" watchObservedRunningTime="2026-09-19 10:49:27.298840258 +0000 UTC m=+771.232546473"
Sep 19 10:49:27.313825 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:27.313766    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8" podStartSLOduration=1.3137462580000001 podStartE2EDuration="1.313746258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:49:27.309979723 +0000 UTC m=+771.243685959" watchObservedRunningTime="2026-09-19 10:49:27.313746258 +0000 UTC m=+771.247452480"
Sep 19 10:49:38.290493 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:38.290457    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:38.290896 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:38.290610    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:48.798131 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:48.798096    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"]
Sep 19 10:49:48.807584 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:48.807530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"]
Sep 19 10:49:48.807768 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:48.807673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"
Sep 19 10:49:48.809911 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:48.809890    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:49:48.810057 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:48.809890    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:49:48.903995 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:48.903014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/584a28b9-e38f-44d2-ac66-8838e3254206-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb\" (UID: \"584a28b9-e38f-44d2-ac66-8838e3254206\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"
Sep 19 10:49:49.004246 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:49.004210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/584a28b9-e38f-44d2-ac66-8838e3254206-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb\" (UID: \"584a28b9-e38f-44d2-ac66-8838e3254206\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"
Sep 19 10:49:49.004919 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:49.004897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/584a28b9-e38f-44d2-ac66-8838e3254206-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb\" (UID: \"584a28b9-e38f-44d2-ac66-8838e3254206\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"
Sep 19 10:49:49.121309 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:49.121266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"
Sep 19 10:49:49.392662 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:49.392632    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"]
Sep 19 10:49:49.393878 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:49:49.393842    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584a28b9_e38f_44d2_ac66_8838e3254206.slice/crio-9f93eeeab4b9572007001774e711d6d32657463fd0a58dcd205a4991a7f3b08b WatchSource:0}: Error finding container 9f93eeeab4b9572007001774e711d6d32657463fd0a58dcd205a4991a7f3b08b: Status 404 returned error can't find the container with id 9f93eeeab4b9572007001774e711d6d32657463fd0a58dcd205a4991a7f3b08b
Sep 19 10:49:49.414611 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:49.414577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb" event={"ID":"584a28b9-e38f-44d2-ac66-8838e3254206","Type":"ContainerStarted","Data":"9f93eeeab4b9572007001774e711d6d32657463fd0a58dcd205a4991a7f3b08b"}
Sep 19 10:49:50.422046 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:50.421962    2563 generic.go:356] "Generic (PLEG): container finished" podID="584a28b9-e38f-44d2-ac66-8838e3254206" containerID="7c03358d94c1204f4e3b96bfc627dfe892c9c5df1df6f6df9da65ed7a5eea17f" exitCode=0
Sep 19 10:49:50.422419 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:50.422044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb" event={"ID":"584a28b9-e38f-44d2-ac66-8838e3254206","Type":"ContainerDied","Data":"7c03358d94c1204f4e3b96bfc627dfe892c9c5df1df6f6df9da65ed7a5eea17f"}
Sep 19 10:49:51.569130 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:51.569104    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"
Sep 19 10:49:51.639882 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:51.639847    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/584a28b9-e38f-44d2-ac66-8838e3254206-maas-api-service-ca\") pod \"584a28b9-e38f-44d2-ac66-8838e3254206\" (UID: \"584a28b9-e38f-44d2-ac66-8838e3254206\") "
Sep 19 10:49:51.640268 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:51.640243    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/584a28b9-e38f-44d2-ac66-8838e3254206-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "584a28b9-e38f-44d2-ac66-8838e3254206" (UID: "584a28b9-e38f-44d2-ac66-8838e3254206"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:49:51.741055 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:51.740961    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/584a28b9-e38f-44d2-ac66-8838e3254206-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:49:52.436857 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:52.436764    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"
Sep 19 10:49:52.436857 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:52.436772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb" event={"ID":"584a28b9-e38f-44d2-ac66-8838e3254206","Type":"ContainerDied","Data":"9f93eeeab4b9572007001774e711d6d32657463fd0a58dcd205a4991a7f3b08b"}
Sep 19 10:49:52.436857 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:52.436837    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f93eeeab4b9572007001774e711d6d32657463fd0a58dcd205a4991a7f3b08b"
Sep 19 10:49:55.573655 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.573624    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"]
Sep 19 10:49:55.574276 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.573931    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh" podUID="7c84ca54-6045-49ec-8cb1-ea29d0e540c5" containerName="payload-processing" containerID="cri-o://cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a" gracePeriod=30
Sep 19 10:49:55.580277 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.580192    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"]
Sep 19 10:49:55.581091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.580455    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8" podUID="e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19" containerName="payload-pre-processing" containerID="cri-o://6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb" gracePeriod=30
Sep 19 10:49:55.728701 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.728626    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"]
Sep 19 10:49:55.732717 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.732684    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18e8cec5-zr5tb"]
Sep 19 10:49:55.902361 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.902334    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:55.905233 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.905209    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:55.990822 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.990788    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-plugins-config-volume\") pod \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\" (UID: \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\") "
Sep 19 10:49:55.990822 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.990828    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-plugins-config-volume\") pod \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\" (UID: \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\") "
Sep 19 10:49:55.991056 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.990965    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfmhm\" (UniqueName: \"kubernetes.io/projected/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-kube-api-access-kfmhm\") pod \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\" (UID: \"7c84ca54-6045-49ec-8cb1-ea29d0e540c5\") "
Sep 19 10:49:55.991056 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.991001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlqtc\" (UniqueName: \"kubernetes.io/projected/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-kube-api-access-wlqtc\") pod \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\" (UID: \"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19\") "
Sep 19 10:49:55.991144 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.991111    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c84ca54-6045-49ec-8cb1-ea29d0e540c5" (UID: "7c84ca54-6045-49ec-8cb1-ea29d0e540c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:49:55.991183 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.991149    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19" (UID: "e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:49:55.991329 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.991305    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:49:55.991329 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.991327    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:49:55.993121 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.993099    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-kube-api-access-kfmhm" (OuterVolumeSpecName: "kube-api-access-kfmhm") pod "7c84ca54-6045-49ec-8cb1-ea29d0e540c5" (UID: "7c84ca54-6045-49ec-8cb1-ea29d0e540c5"). InnerVolumeSpecName "kube-api-access-kfmhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:49:55.993177 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:55.993121    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-kube-api-access-wlqtc" (OuterVolumeSpecName: "kube-api-access-wlqtc") pod "e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19" (UID: "e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19"). InnerVolumeSpecName "kube-api-access-wlqtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:49:56.092048 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.092011    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfmhm\" (UniqueName: \"kubernetes.io/projected/7c84ca54-6045-49ec-8cb1-ea29d0e540c5-kube-api-access-kfmhm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:49:56.092048 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.092042    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlqtc\" (UniqueName: \"kubernetes.io/projected/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19-kube-api-access-wlqtc\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:49:56.119703 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.119630    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="584a28b9-e38f-44d2-ac66-8838e3254206" path="/var/lib/kubelet/pods/584a28b9-e38f-44d2-ac66-8838e3254206/volumes"
Sep 19 10:49:56.464350 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.464257    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19" containerID="6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb" exitCode=0
Sep 19 10:49:56.464350 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.464316    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"
Sep 19 10:49:56.464596 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.464348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8" event={"ID":"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19","Type":"ContainerDied","Data":"6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb"}
Sep 19 10:49:56.464596 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.464437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8" event={"ID":"e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19","Type":"ContainerDied","Data":"f9ee65eb33630a03b6a6d94c203f8ef031a21bc1f0646b6fe6e9066a4a726007"}
Sep 19 10:49:56.464596 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.464469    2563 scope.go:117] "RemoveContainer" containerID="6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb"
Sep 19 10:49:56.465851 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.465830    2563 generic.go:356] "Generic (PLEG): container finished" podID="7c84ca54-6045-49ec-8cb1-ea29d0e540c5" containerID="cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a" exitCode=0
Sep 19 10:49:56.465977 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.465875    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"
Sep 19 10:49:56.465977 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.465919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh" event={"ID":"7c84ca54-6045-49ec-8cb1-ea29d0e540c5","Type":"ContainerDied","Data":"cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a"}
Sep 19 10:49:56.466094 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.465979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh" event={"ID":"7c84ca54-6045-49ec-8cb1-ea29d0e540c5","Type":"ContainerDied","Data":"990f2654c7a8fe171aa817e0118aaad78071ca83c8f605e357fc9d5aba58198d"}
Sep 19 10:49:56.474475 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.474458    2563 scope.go:117] "RemoveContainer" containerID="6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb"
Sep 19 10:49:56.474751 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:49:56.474727    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb\": container with ID starting with 6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb not found: ID does not exist" containerID="6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb"
Sep 19 10:49:56.474798 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.474756    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb"} err="failed to get container status \"6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb\": rpc error: code = NotFound desc = could not find container \"6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb\": container with ID starting with 6070240bf695f87393a08ae3050bb7fb92066f68730b8d9e511955a7707da4fb not found: ID does not exist"
Sep 19 10:49:56.474798 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.474773    2563 scope.go:117] "RemoveContainer" containerID="cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a"
Sep 19 10:49:56.484439 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.484424    2563 scope.go:117] "RemoveContainer" containerID="cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a"
Sep 19 10:49:56.484750 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:49:56.484732    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a\": container with ID starting with cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a not found: ID does not exist" containerID="cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a"
Sep 19 10:49:56.484817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.484757    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a"} err="failed to get container status \"cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a\": rpc error: code = NotFound desc = could not find container \"cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a\": container with ID starting with cf4840ed35e771d02faf16ad173d9db3f385c1e8dd651f7f5d49a4c812fdc64a not found: ID does not exist"
Sep 19 10:49:56.486634 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.486616    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"]
Sep 19 10:49:56.491097 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.491077    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-18e8cec5-58fb79dfbb-sczhh"]
Sep 19 10:49:56.506275 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.506254    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"]
Sep 19 10:49:56.514709 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:56.514686    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-18e8cec5-6c48d955bb-cprx8"]
Sep 19 10:49:58.119529 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:58.119495    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c84ca54-6045-49ec-8cb1-ea29d0e540c5" path="/var/lib/kubelet/pods/7c84ca54-6045-49ec-8cb1-ea29d0e540c5/volumes"
Sep 19 10:49:58.119935 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:49:58.119899    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19" path="/var/lib/kubelet/pods/e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19/volumes"
Sep 19 10:50:24.742673 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.742633    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"]
Sep 19 10:50:24.743161 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.743088    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19" containerName="payload-pre-processing"
Sep 19 10:50:24.743161 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.743098    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19" containerName="payload-pre-processing"
Sep 19 10:50:24.743161 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.743108    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="584a28b9-e38f-44d2-ac66-8838e3254206" containerName="revoke-keys"
Sep 19 10:50:24.743161 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.743114    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="584a28b9-e38f-44d2-ac66-8838e3254206" containerName="revoke-keys"
Sep 19 10:50:24.743161 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.743129    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c84ca54-6045-49ec-8cb1-ea29d0e540c5" containerName="payload-processing"
Sep 19 10:50:24.743161 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.743135    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c84ca54-6045-49ec-8cb1-ea29d0e540c5" containerName="payload-processing"
Sep 19 10:50:24.743361 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.743206    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c84ca54-6045-49ec-8cb1-ea29d0e540c5" containerName="payload-processing"
Sep 19 10:50:24.743361 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.743216    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="584a28b9-e38f-44d2-ac66-8838e3254206" containerName="revoke-keys"
Sep 19 10:50:24.743361 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.743224    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1c53f02-fd2e-4d2f-bfe0-5dd8910aaa19" containerName="payload-pre-processing"
Sep 19 10:50:24.746332 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.746315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"
Sep 19 10:50:24.748755 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.748732    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:50:24.749070 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.748920    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:50:24.752714 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.752689    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"]
Sep 19 10:50:24.786727 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.786689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40450875-dbbf-49b0-b329-4e5349c2b409-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d303059f-gh7kp\" (UID: \"40450875-dbbf-49b0-b329-4e5349c2b409\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"
Sep 19 10:50:24.887806 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.887769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40450875-dbbf-49b0-b329-4e5349c2b409-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d303059f-gh7kp\" (UID: \"40450875-dbbf-49b0-b329-4e5349c2b409\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"
Sep 19 10:50:24.888719 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:24.888692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40450875-dbbf-49b0-b329-4e5349c2b409-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d303059f-gh7kp\" (UID: \"40450875-dbbf-49b0-b329-4e5349c2b409\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"
Sep 19 10:50:25.058695 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:25.058604    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"
Sep 19 10:50:25.339421 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:50:25.339392    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40450875_dbbf_49b0_b329_4e5349c2b409.slice/crio-e1172dfc90810fb06961d9670cdef2d2bf802fe8ef3f45f8e15d7536113ec43b WatchSource:0}: Error finding container e1172dfc90810fb06961d9670cdef2d2bf802fe8ef3f45f8e15d7536113ec43b: Status 404 returned error can't find the container with id e1172dfc90810fb06961d9670cdef2d2bf802fe8ef3f45f8e15d7536113ec43b
Sep 19 10:50:25.339421 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:25.339397    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"]
Sep 19 10:50:25.641378 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:25.641337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp" event={"ID":"40450875-dbbf-49b0-b329-4e5349c2b409","Type":"ContainerStarted","Data":"bfb16f6bf3d7414c4afec565d56d71a282e9a8be33ff482102352b2ae9992240"}
Sep 19 10:50:25.641625 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:25.641401    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp" event={"ID":"40450875-dbbf-49b0-b329-4e5349c2b409","Type":"ContainerStarted","Data":"e1172dfc90810fb06961d9670cdef2d2bf802fe8ef3f45f8e15d7536113ec43b"}
Sep 19 10:50:25.658092 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:25.658038    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp" podStartSLOduration=1.658021457 podStartE2EDuration="1.658021457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:50:25.655705627 +0000 UTC m=+829.589411842" watchObservedRunningTime="2026-09-19 10:50:25.658021457 +0000 UTC m=+829.591727671"
Sep 19 10:50:26.648763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:26.648730    2563 generic.go:356] "Generic (PLEG): container finished" podID="40450875-dbbf-49b0-b329-4e5349c2b409" containerID="bfb16f6bf3d7414c4afec565d56d71a282e9a8be33ff482102352b2ae9992240" exitCode=0
Sep 19 10:50:26.649129 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:26.648816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp" event={"ID":"40450875-dbbf-49b0-b329-4e5349c2b409","Type":"ContainerDied","Data":"bfb16f6bf3d7414c4afec565d56d71a282e9a8be33ff482102352b2ae9992240"}
Sep 19 10:50:27.798397 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:27.798371    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"
Sep 19 10:50:27.921504 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:27.921413    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40450875-dbbf-49b0-b329-4e5349c2b409-maas-api-service-ca\") pod \"40450875-dbbf-49b0-b329-4e5349c2b409\" (UID: \"40450875-dbbf-49b0-b329-4e5349c2b409\") "
Sep 19 10:50:27.921846 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:27.921820    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40450875-dbbf-49b0-b329-4e5349c2b409-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40450875-dbbf-49b0-b329-4e5349c2b409" (UID: "40450875-dbbf-49b0-b329-4e5349c2b409"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:50:28.022161 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:28.022125    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40450875-dbbf-49b0-b329-4e5349c2b409-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:50:28.662870 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:28.662838    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"
Sep 19 10:50:28.662870 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:28.662860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp" event={"ID":"40450875-dbbf-49b0-b329-4e5349c2b409","Type":"ContainerDied","Data":"e1172dfc90810fb06961d9670cdef2d2bf802fe8ef3f45f8e15d7536113ec43b"}
Sep 19 10:50:28.663102 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:28.662931    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1172dfc90810fb06961d9670cdef2d2bf802fe8ef3f45f8e15d7536113ec43b"
Sep 19 10:50:31.123525 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:31.123494    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"]
Sep 19 10:50:31.125871 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:31.125851    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d303059f-gh7kp"]
Sep 19 10:50:32.119431 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:50:32.119394    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40450875-dbbf-49b0-b329-4e5349c2b409" path="/var/lib/kubelet/pods/40450875-dbbf-49b0-b329-4e5349c2b409/volumes"
Sep 19 10:51:05.282291 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.282255    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"]
Sep 19 10:51:05.282823 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.282708    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40450875-dbbf-49b0-b329-4e5349c2b409" containerName="revoke-keys"
Sep 19 10:51:05.282823 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.282719    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40450875-dbbf-49b0-b329-4e5349c2b409" containerName="revoke-keys"
Sep 19 10:51:05.282823 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.282796    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="40450875-dbbf-49b0-b329-4e5349c2b409" containerName="revoke-keys"
Sep 19 10:51:05.285945 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.285928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"
Sep 19 10:51:05.288268 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.288245    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:51:05.288268 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.288253    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:51:05.293136 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.293114    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"]
Sep 19 10:51:05.389501 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.389462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e7379c4-71f5-49d4-9a8f-046fbb247648-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn\" (UID: \"9e7379c4-71f5-49d4-9a8f-046fbb247648\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"
Sep 19 10:51:05.490243 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.490211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e7379c4-71f5-49d4-9a8f-046fbb247648-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn\" (UID: \"9e7379c4-71f5-49d4-9a8f-046fbb247648\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"
Sep 19 10:51:05.490860 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.490843    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e7379c4-71f5-49d4-9a8f-046fbb247648-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn\" (UID: \"9e7379c4-71f5-49d4-9a8f-046fbb247648\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"
Sep 19 10:51:05.598415 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.598386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"
Sep 19 10:51:05.876499 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.876467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"]
Sep 19 10:51:05.886587 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:05.886562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn" event={"ID":"9e7379c4-71f5-49d4-9a8f-046fbb247648","Type":"ContainerStarted","Data":"3f7e3061e52620c9053b47af7594a2bcf4ca23171adb395c25aa8602de8e28fd"}
Sep 19 10:51:06.893748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:06.893656    2563 generic.go:356] "Generic (PLEG): container finished" podID="9e7379c4-71f5-49d4-9a8f-046fbb247648" containerID="432931f88d0d7a83ab3991a349b5988c475ed1ba01e7f4fbbc4d8a99db0a591b" exitCode=0
Sep 19 10:51:06.893748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:06.893721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn" event={"ID":"9e7379c4-71f5-49d4-9a8f-046fbb247648","Type":"ContainerDied","Data":"432931f88d0d7a83ab3991a349b5988c475ed1ba01e7f4fbbc4d8a99db0a591b"}
Sep 19 10:51:08.030646 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:08.030620    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"
Sep 19 10:51:08.114992 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:08.114951    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e7379c4-71f5-49d4-9a8f-046fbb247648-maas-api-service-ca\") pod \"9e7379c4-71f5-49d4-9a8f-046fbb247648\" (UID: \"9e7379c4-71f5-49d4-9a8f-046fbb247648\") "
Sep 19 10:51:08.115290 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:08.115264    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e7379c4-71f5-49d4-9a8f-046fbb247648-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9e7379c4-71f5-49d4-9a8f-046fbb247648" (UID: "9e7379c4-71f5-49d4-9a8f-046fbb247648"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:51:08.216511 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:08.216421    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e7379c4-71f5-49d4-9a8f-046fbb247648-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:51:08.907620 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:08.907591    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"
Sep 19 10:51:08.907620 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:08.907617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn" event={"ID":"9e7379c4-71f5-49d4-9a8f-046fbb247648","Type":"ContainerDied","Data":"3f7e3061e52620c9053b47af7594a2bcf4ca23171adb395c25aa8602de8e28fd"}
Sep 19 10:51:08.907851 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:08.907670    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f7e3061e52620c9053b47af7594a2bcf4ca23171adb395c25aa8602de8e28fd"
Sep 19 10:51:17.164979 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:17.164935    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"]
Sep 19 10:51:17.168528 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:17.168500    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3ee7a92b-xmxkn"]
Sep 19 10:51:18.119123 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:18.119086    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e7379c4-71f5-49d4-9a8f-046fbb247648" path="/var/lib/kubelet/pods/9e7379c4-71f5-49d4-9a8f-046fbb247648/volumes"
Sep 19 10:51:38.113907 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:38.113875    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:51:38.116142 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:38.116118    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:51:43.459911 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.459874    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"]
Sep 19 10:51:43.461355 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.461325    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7379c4-71f5-49d4-9a8f-046fbb247648" containerName="revoke-keys"
Sep 19 10:51:43.461521 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.461510    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7379c4-71f5-49d4-9a8f-046fbb247648" containerName="revoke-keys"
Sep 19 10:51:43.462343 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.462320    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e7379c4-71f5-49d4-9a8f-046fbb247648" containerName="revoke-keys"
Sep 19 10:51:43.467944 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.467912    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"
Sep 19 10:51:43.468948 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.468924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"]
Sep 19 10:51:43.470410 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.470389    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:51:43.470525 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.470392    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:51:43.566833 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.566807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e31f0b2f-0583-47e4-a1b2-47664a5b906c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v\" (UID: \"e31f0b2f-0583-47e4-a1b2-47664a5b906c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"
Sep 19 10:51:43.668018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.667989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e31f0b2f-0583-47e4-a1b2-47664a5b906c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v\" (UID: \"e31f0b2f-0583-47e4-a1b2-47664a5b906c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"
Sep 19 10:51:43.668608 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.668590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e31f0b2f-0583-47e4-a1b2-47664a5b906c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v\" (UID: \"e31f0b2f-0583-47e4-a1b2-47664a5b906c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"
Sep 19 10:51:43.779177 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:43.779083    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"
Sep 19 10:51:44.058887 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:44.058852    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"]
Sep 19 10:51:44.060361 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:51:44.060333    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31f0b2f_0583_47e4_a1b2_47664a5b906c.slice/crio-117feab1cd209db98f842a2fe945002e0da34cbcd367c08d0fd75bc0abe144a8 WatchSource:0}: Error finding container 117feab1cd209db98f842a2fe945002e0da34cbcd367c08d0fd75bc0abe144a8: Status 404 returned error can't find the container with id 117feab1cd209db98f842a2fe945002e0da34cbcd367c08d0fd75bc0abe144a8
Sep 19 10:51:44.125512 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:44.125479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v" event={"ID":"e31f0b2f-0583-47e4-a1b2-47664a5b906c","Type":"ContainerStarted","Data":"117feab1cd209db98f842a2fe945002e0da34cbcd367c08d0fd75bc0abe144a8"}
Sep 19 10:51:45.133131 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:45.133094    2563 generic.go:356] "Generic (PLEG): container finished" podID="e31f0b2f-0583-47e4-a1b2-47664a5b906c" containerID="b5480f5c2a6a611a923286b5388b9132f3804ce00d43cc0bc463c1cdd84dbb08" exitCode=0
Sep 19 10:51:45.133596 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:45.133182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v" event={"ID":"e31f0b2f-0583-47e4-a1b2-47664a5b906c","Type":"ContainerDied","Data":"b5480f5c2a6a611a923286b5388b9132f3804ce00d43cc0bc463c1cdd84dbb08"}
Sep 19 10:51:46.271715 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:46.271687    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"
Sep 19 10:51:46.396162 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:46.396075    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e31f0b2f-0583-47e4-a1b2-47664a5b906c-maas-api-service-ca\") pod \"e31f0b2f-0583-47e4-a1b2-47664a5b906c\" (UID: \"e31f0b2f-0583-47e4-a1b2-47664a5b906c\") "
Sep 19 10:51:46.396392 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:46.396370    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e31f0b2f-0583-47e4-a1b2-47664a5b906c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e31f0b2f-0583-47e4-a1b2-47664a5b906c" (UID: "e31f0b2f-0583-47e4-a1b2-47664a5b906c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:51:46.497691 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:46.497657    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e31f0b2f-0583-47e4-a1b2-47664a5b906c-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:51:47.146537 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:47.146500    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v" event={"ID":"e31f0b2f-0583-47e4-a1b2-47664a5b906c","Type":"ContainerDied","Data":"117feab1cd209db98f842a2fe945002e0da34cbcd367c08d0fd75bc0abe144a8"}
Sep 19 10:51:47.146740 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:47.146587    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="117feab1cd209db98f842a2fe945002e0da34cbcd367c08d0fd75bc0abe144a8"
Sep 19 10:51:47.146740 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:47.146510    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"
Sep 19 10:51:53.917777 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:53.917737    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"]
Sep 19 10:51:53.918241 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:53.917992    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27" podUID="f2f03adb-67ed-4663-b1a0-b30d7f4c8b48" containerName="payload-processing" containerID="cri-o://1af8fc09674939ff2f1b728950d08fe684749daa2aff6fb0636b5cc53f87beea" gracePeriod=30
Sep 19 10:51:54.007622 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.007575    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27" podUID="f2f03adb-67ed-4663-b1a0-b30d7f4c8b48" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.49:9004: connect: connection refused"
Sep 19 10:51:54.076681 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.076647    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"]
Sep 19 10:51:54.081384 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.081349    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7bcaa9-lk49v"]
Sep 19 10:51:54.122313 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.122277    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e31f0b2f-0583-47e4-a1b2-47664a5b906c" path="/var/lib/kubelet/pods/e31f0b2f-0583-47e4-a1b2-47664a5b906c/volumes"
Sep 19 10:51:54.190766 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.190737    2563 generic.go:356] "Generic (PLEG): container finished" podID="f2f03adb-67ed-4663-b1a0-b30d7f4c8b48" containerID="1af8fc09674939ff2f1b728950d08fe684749daa2aff6fb0636b5cc53f87beea" exitCode=0
Sep 19 10:51:54.190897 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.190819    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27" event={"ID":"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48","Type":"ContainerDied","Data":"1af8fc09674939ff2f1b728950d08fe684749daa2aff6fb0636b5cc53f87beea"}
Sep 19 10:51:54.190897 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.190873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27" event={"ID":"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48","Type":"ContainerDied","Data":"3f8ab693510b89513a13e4ad1d0453ee49bd243ce9c909d6f0ab5f3521510bef"}
Sep 19 10:51:54.190897 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.190892    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f8ab693510b89513a13e4ad1d0453ee49bd243ce9c909d6f0ab5f3521510bef"
Sep 19 10:51:54.192990 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.192960    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:51:54.273334 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.273297    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-plugins-config-volume\") pod \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\" (UID: \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\") "
Sep 19 10:51:54.273517 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.273437    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzpd2\" (UniqueName: \"kubernetes.io/projected/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-kube-api-access-xzpd2\") pod \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\" (UID: \"f2f03adb-67ed-4663-b1a0-b30d7f4c8b48\") "
Sep 19 10:51:54.273733 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.273706    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2f03adb-67ed-4663-b1a0-b30d7f4c8b48" (UID: "f2f03adb-67ed-4663-b1a0-b30d7f4c8b48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:51:54.275573 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.275529    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-kube-api-access-xzpd2" (OuterVolumeSpecName: "kube-api-access-xzpd2") pod "f2f03adb-67ed-4663-b1a0-b30d7f4c8b48" (UID: "f2f03adb-67ed-4663-b1a0-b30d7f4c8b48"). InnerVolumeSpecName "kube-api-access-xzpd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:51:54.374653 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.374607    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzpd2\" (UniqueName: \"kubernetes.io/projected/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-kube-api-access-xzpd2\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:51:54.374653 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:54.374641    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:51:55.196725 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:55.196687    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"
Sep 19 10:51:55.220097 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:55.220053    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"]
Sep 19 10:51:55.225841 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:55.225808    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7bcaa9-d4b86d787-k4r27"]
Sep 19 10:51:56.118600 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:51:56.118536    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2f03adb-67ed-4663-b1a0-b30d7f4c8b48" path="/var/lib/kubelet/pods/f2f03adb-67ed-4663-b1a0-b30d7f4c8b48/volumes"
Sep 19 10:52:05.364833 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:05.364795    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"]
Sep 19 10:52:05.365313 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:05.365034    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy" containerID="cri-o://cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697" gracePeriod=30
Sep 19 10:52:10.645819 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.645791    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:52:10.730993 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.730957    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bhh8\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-kube-api-access-5bhh8\") pod \"76ba6c81-becd-447e-879f-6fbb6ba500a5\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") "
Sep 19 10:52:10.731193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731016    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-certs\") pod \"76ba6c81-becd-447e-879f-6fbb6ba500a5\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") "
Sep 19 10:52:10.731193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731051    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-credential-socket\") pod \"76ba6c81-becd-447e-879f-6fbb6ba500a5\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") "
Sep 19 10:52:10.731193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731098    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ba6c81-becd-447e-879f-6fbb6ba500a5-istiod-ca-cert\") pod \"76ba6c81-becd-447e-879f-6fbb6ba500a5\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") "
Sep 19 10:52:10.731193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731152    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-socket\") pod \"76ba6c81-becd-447e-879f-6fbb6ba500a5\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") "
Sep 19 10:52:10.731193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731191    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-podinfo\") pod \"76ba6c81-becd-447e-879f-6fbb6ba500a5\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") "
Sep 19 10:52:10.731460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731213    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-data\") pod \"76ba6c81-becd-447e-879f-6fbb6ba500a5\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") "
Sep 19 10:52:10.731460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731237    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-token\") pod \"76ba6c81-becd-447e-879f-6fbb6ba500a5\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") "
Sep 19 10:52:10.731460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731296    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-envoy\") pod \"76ba6c81-becd-447e-879f-6fbb6ba500a5\" (UID: \"76ba6c81-becd-447e-879f-6fbb6ba500a5\") "
Sep 19 10:52:10.731460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731373    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76ba6c81-becd-447e-879f-6fbb6ba500a5" (UID: "76ba6c81-becd-447e-879f-6fbb6ba500a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:52:10.731460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731392    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76ba6c81-becd-447e-879f-6fbb6ba500a5" (UID: "76ba6c81-becd-447e-879f-6fbb6ba500a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:52:10.731780 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731489    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "76ba6c81-becd-447e-879f-6fbb6ba500a5" (UID: "76ba6c81-becd-447e-879f-6fbb6ba500a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:52:10.731780 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731690    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:52:10.731780 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731701    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76ba6c81-becd-447e-879f-6fbb6ba500a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76ba6c81-becd-447e-879f-6fbb6ba500a5" (UID: "76ba6c81-becd-447e-879f-6fbb6ba500a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:52:10.731780 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731718    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:52:10.731780 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731735    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:52:10.732040 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.731795    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76ba6c81-becd-447e-879f-6fbb6ba500a5" (UID: "76ba6c81-becd-447e-879f-6fbb6ba500a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:52:10.733392 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.733361    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-kube-api-access-5bhh8" (OuterVolumeSpecName: "kube-api-access-5bhh8") pod "76ba6c81-becd-447e-879f-6fbb6ba500a5" (UID: "76ba6c81-becd-447e-879f-6fbb6ba500a5"). InnerVolumeSpecName "kube-api-access-5bhh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:52:10.733514 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.733437    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76ba6c81-becd-447e-879f-6fbb6ba500a5" (UID: "76ba6c81-becd-447e-879f-6fbb6ba500a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:52:10.733514 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.733427    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76ba6c81-becd-447e-879f-6fbb6ba500a5" (UID: "76ba6c81-becd-447e-879f-6fbb6ba500a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 10:52:10.733514 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.733462    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "76ba6c81-becd-447e-879f-6fbb6ba500a5" (UID: "76ba6c81-becd-447e-879f-6fbb6ba500a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:52:10.832934 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.832899    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:52:10.832934 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.832926    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:52:10.832934 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.832937    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:52:10.833177 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.832949    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bhh8\" (UniqueName: \"kubernetes.io/projected/76ba6c81-becd-447e-879f-6fbb6ba500a5-kube-api-access-5bhh8\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:52:10.833177 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.832960    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ba6c81-becd-447e-879f-6fbb6ba500a5-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:52:10.833177 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:10.832977    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ba6c81-becd-447e-879f-6fbb6ba500a5-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:52:11.297457 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.297424    2563 generic.go:356] "Generic (PLEG): container finished" podID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerID="cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697" exitCode=0
Sep 19 10:52:11.297667 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.297473    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"
Sep 19 10:52:11.297667 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.297509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" event={"ID":"76ba6c81-becd-447e-879f-6fbb6ba500a5","Type":"ContainerDied","Data":"cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697"}
Sep 19 10:52:11.297667 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.297581    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46" event={"ID":"76ba6c81-becd-447e-879f-6fbb6ba500a5","Type":"ContainerDied","Data":"6280ac657a8fc286701add81e6df5db5ebfcbaeb651c41c030d5ec825d841010"}
Sep 19 10:52:11.297667 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.297607    2563 scope.go:117] "RemoveContainer" containerID="cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697"
Sep 19 10:52:11.308692 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.308675    2563 scope.go:117] "RemoveContainer" containerID="c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104"
Sep 19 10:52:11.316998 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.316967    2563 scope.go:117] "RemoveContainer" containerID="cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697"
Sep 19 10:52:11.317385 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:52:11.317338    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697\": container with ID starting with cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697 not found: ID does not exist" containerID="cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697"
Sep 19 10:52:11.317484 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.317380    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697"} err="failed to get container status \"cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697\": rpc error: code = NotFound desc = could not find container \"cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697\": container with ID starting with cafa821d933cb9f91e7d04974185cf72aef379a2a7d36f29b5fbad4363ad8697 not found: ID does not exist"
Sep 19 10:52:11.317484 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.317403    2563 scope.go:117] "RemoveContainer" containerID="c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104"
Sep 19 10:52:11.317958 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:52:11.317932    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104\": container with ID starting with c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104 not found: ID does not exist" containerID="c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104"
Sep 19 10:52:11.318053 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.317966    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104"} err="failed to get container status \"c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104\": rpc error: code = NotFound desc = could not find container \"c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104\": container with ID starting with c0c22a2442f9ae1578db2623b202ccb37236db3d7f1054599b227c11cd900104 not found: ID does not exist"
Sep 19 10:52:11.320504 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.320487    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"]
Sep 19 10:52:11.325850 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:11.325830    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-7bcaa9-openshift-default-797b8cdd5b-4jn46"]
Sep 19 10:52:12.119199 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.119166    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" path="/var/lib/kubelet/pods/76ba6c81-becd-447e-879f-6fbb6ba500a5/volumes"
Sep 19 10:52:12.337075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337037    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"]
Sep 19 10:52:12.337451 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337438    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31f0b2f-0583-47e4-a1b2-47664a5b906c" containerName="revoke-keys"
Sep 19 10:52:12.337451 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337452    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31f0b2f-0583-47e4-a1b2-47664a5b906c" containerName="revoke-keys"
Sep 19 10:52:12.337565 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337460    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy"
Sep 19 10:52:12.337565 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337466    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy"
Sep 19 10:52:12.337565 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337478    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2f03adb-67ed-4663-b1a0-b30d7f4c8b48" containerName="payload-processing"
Sep 19 10:52:12.337565 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337484    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2f03adb-67ed-4663-b1a0-b30d7f4c8b48" containerName="payload-processing"
Sep 19 10:52:12.337565 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337567    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy"
Sep 19 10:52:12.337746 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337577    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy"
Sep 19 10:52:12.337746 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337585    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2f03adb-67ed-4663-b1a0-b30d7f4c8b48" containerName="payload-processing"
Sep 19 10:52:12.337746 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.337592    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e31f0b2f-0583-47e4-a1b2-47664a5b906c" containerName="revoke-keys"
Sep 19 10:52:12.341955 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.341937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:12.344407 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.344385    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-e898f8\""
Sep 19 10:52:12.344799 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.344782    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-e898f8-dockercfg-nwc6j\""
Sep 19 10:52:12.347933 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.347914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wf9g\" (UniqueName: \"kubernetes.io/projected/9a39086c-fb0f-4e94-ba67-83877139e04a-kube-api-access-7wf9g\") pod \"payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d\" (UID: \"9a39086c-fb0f-4e94-ba67-83877139e04a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:12.348014 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.347972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a39086c-fb0f-4e94-ba67-83877139e04a-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d\" (UID: \"9a39086c-fb0f-4e94-ba67-83877139e04a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:12.352772 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.352753    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"]
Sep 19 10:52:12.449324 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.449242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a39086c-fb0f-4e94-ba67-83877139e04a-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d\" (UID: \"9a39086c-fb0f-4e94-ba67-83877139e04a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:12.449478 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.449391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wf9g\" (UniqueName: \"kubernetes.io/projected/9a39086c-fb0f-4e94-ba67-83877139e04a-kube-api-access-7wf9g\") pod \"payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d\" (UID: \"9a39086c-fb0f-4e94-ba67-83877139e04a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:12.450013 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.449994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a39086c-fb0f-4e94-ba67-83877139e04a-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d\" (UID: \"9a39086c-fb0f-4e94-ba67-83877139e04a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:12.456920 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.456894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wf9g\" (UniqueName: \"kubernetes.io/projected/9a39086c-fb0f-4e94-ba67-83877139e04a-kube-api-access-7wf9g\") pod \"payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d\" (UID: \"9a39086c-fb0f-4e94-ba67-83877139e04a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:12.653068 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.653029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:12.924913 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:12.924879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"]
Sep 19 10:52:12.925983 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:52:12.925944    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a39086c_fb0f_4e94_ba67_83877139e04a.slice/crio-a7845b55c1769c1c8baf3d3b9d5bd1e44d33782c38cfc8677433162f0ef8ede0 WatchSource:0}: Error finding container a7845b55c1769c1c8baf3d3b9d5bd1e44d33782c38cfc8677433162f0ef8ede0: Status 404 returned error can't find the container with id a7845b55c1769c1c8baf3d3b9d5bd1e44d33782c38cfc8677433162f0ef8ede0
Sep 19 10:52:13.313892 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:13.313798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d" event={"ID":"9a39086c-fb0f-4e94-ba67-83877139e04a","Type":"ContainerStarted","Data":"8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498"}
Sep 19 10:52:13.313892 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:13.313850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d" event={"ID":"9a39086c-fb0f-4e94-ba67-83877139e04a","Type":"ContainerStarted","Data":"a7845b55c1769c1c8baf3d3b9d5bd1e44d33782c38cfc8677433162f0ef8ede0"}
Sep 19 10:52:13.314296 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:13.313972    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:13.329831 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:13.329786    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d" podStartSLOduration=1.329768394 podStartE2EDuration="1.329768394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:52:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:52:13.327770182 +0000 UTC m=+937.261476394" watchObservedRunningTime="2026-09-19 10:52:13.329768394 +0000 UTC m=+937.263474609"
Sep 19 10:52:21.717099 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.717062    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"]
Sep 19 10:52:21.717601 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.717519    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy"
Sep 19 10:52:21.717601 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.717531    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ba6c81-becd-447e-879f-6fbb6ba500a5" containerName="istio-proxy"
Sep 19 10:52:21.720999 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.720978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.724281 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.724260    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5116ec\"/\"default-dockercfg-ghbth\""
Sep 19 10:52:21.724420 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.724311    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5116ec\"/\"premium-w4-5116ec-kserve-self-signed-certs\""
Sep 19 10:52:21.724420 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.724410    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5116ec\"/\"kube-root-ca.crt\""
Sep 19 10:52:21.724567 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.724269    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5116ec\"/\"openshift-service-ca.crt\""
Sep 19 10:52:21.729123 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.729101    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"]
Sep 19 10:52:21.839961 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.839926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-home\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.839961 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.839964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-model-cache\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.840185 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.839996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ce4712-0a58-4950-af99-a67e31c8109e-tls-certs\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.840185 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.840018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89fgs\" (UniqueName: \"kubernetes.io/projected/69ce4712-0a58-4950-af99-a67e31c8109e-kube-api-access-89fgs\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.840185 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.840106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-tmp-dir\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.840283 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.840201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-dshm\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.940939 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.940902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ce4712-0a58-4950-af99-a67e31c8109e-tls-certs\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.941124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.940947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89fgs\" (UniqueName: \"kubernetes.io/projected/69ce4712-0a58-4950-af99-a67e31c8109e-kube-api-access-89fgs\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.941124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.941004    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-tmp-dir\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.941124 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.941070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-dshm\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.941288 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.941128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-home\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.941288 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.941158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-model-cache\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.941502 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.941477    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-tmp-dir\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.941601 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.941487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-home\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.941601 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.941534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-model-cache\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.943323 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.943284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-dshm\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.943500 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.943481    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ce4712-0a58-4950-af99-a67e31c8109e-tls-certs\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:21.947819 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:21.947797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89fgs\" (UniqueName: \"kubernetes.io/projected/69ce4712-0a58-4950-af99-a67e31c8109e-kube-api-access-89fgs\") pod \"premium-w4-5116ec-kserve-6c66f85d8c-76vkf\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") " pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:22.032543 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:22.032462    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:22.303279 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:22.303246    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"]
Sep 19 10:52:22.304416 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:52:22.304394    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69ce4712_0a58_4950_af99_a67e31c8109e.slice/crio-1af66fe989a78b1897b3bea41fe4f59043f00a21d7812f9826c041d5ae57f76d WatchSource:0}: Error finding container 1af66fe989a78b1897b3bea41fe4f59043f00a21d7812f9826c041d5ae57f76d: Status 404 returned error can't find the container with id 1af66fe989a78b1897b3bea41fe4f59043f00a21d7812f9826c041d5ae57f76d
Sep 19 10:52:22.368059 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:22.368025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf" event={"ID":"69ce4712-0a58-4950-af99-a67e31c8109e","Type":"ContainerStarted","Data":"cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95"}
Sep 19 10:52:22.368194 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:22.368075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf" event={"ID":"69ce4712-0a58-4950-af99-a67e31c8109e","Type":"ContainerStarted","Data":"1af66fe989a78b1897b3bea41fe4f59043f00a21d7812f9826c041d5ae57f76d"}
Sep 19 10:52:22.383498 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:22.383440    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf" podStartSLOduration=1.383417561 podStartE2EDuration="1.383417561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:52:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:52:22.381988577 +0000 UTC m=+946.315694817" watchObservedRunningTime="2026-09-19 10:52:22.383417561 +0000 UTC m=+946.317123776"
Sep 19 10:52:24.322760 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:24.322727    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:52:32.032629 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:32.032589    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:32.032629 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:32.032638    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:32.045298 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:32.045270    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:52:32.438313 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:52:32.438284    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 10:53:02.314065 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.313987    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"]
Sep 19 10:53:02.317719 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.317698    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:02.320063 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.320043    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-18444f28\""
Sep 19 10:53:02.326303 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.326280    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"]
Sep 19 10:53:02.328857 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.328834    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"]
Sep 19 10:53:02.332471 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.332389    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:02.334507 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.334487    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-18444f28-dockercfg-pljnd\""
Sep 19 10:53:02.340066 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.340043    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"]
Sep 19 10:53:02.431599 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.431562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn\" (UID: \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:02.431797 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.431608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb468\" (UniqueName: \"kubernetes.io/projected/aabb2bb3-7769-46f6-bea8-d2392ed84cca-kube-api-access-mb468\") pod \"payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn\" (UID: \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\") " pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:02.431797 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.431665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6mc6\" (UniqueName: \"kubernetes.io/projected/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-kube-api-access-s6mc6\") pod \"payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn\" (UID: \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:02.431797 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.431723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aabb2bb3-7769-46f6-bea8-d2392ed84cca-plugins-config-volume\") pod \"payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn\" (UID: \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\") " pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:02.532520 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.532486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn\" (UID: \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:02.532520 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.532523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb468\" (UniqueName: \"kubernetes.io/projected/aabb2bb3-7769-46f6-bea8-d2392ed84cca-kube-api-access-mb468\") pod \"payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn\" (UID: \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\") " pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:02.532740 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.532608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6mc6\" (UniqueName: \"kubernetes.io/projected/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-kube-api-access-s6mc6\") pod \"payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn\" (UID: \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:02.532740 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.532689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aabb2bb3-7769-46f6-bea8-d2392ed84cca-plugins-config-volume\") pod \"payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn\" (UID: \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\") " pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:02.533462 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.533436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn\" (UID: \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:02.533503 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.533460    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aabb2bb3-7769-46f6-bea8-d2392ed84cca-plugins-config-volume\") pod \"payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn\" (UID: \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\") " pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:02.540316 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.540292    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6mc6\" (UniqueName: \"kubernetes.io/projected/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-kube-api-access-s6mc6\") pod \"payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn\" (UID: \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:02.540429 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.540360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb468\" (UniqueName: \"kubernetes.io/projected/aabb2bb3-7769-46f6-bea8-d2392ed84cca-kube-api-access-mb468\") pod \"payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn\" (UID: \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\") " pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:02.629882 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.629851    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:02.644324 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.644297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:02.909307 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.909279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"]
Sep 19 10:53:02.910110 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:53:02.910083    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794d4e41_7f68_4f27_9fbf_50c22b9c28a2.slice/crio-69c3c01912e1315fa455c7e34375cd4c2371b9d65a1e26a430e509e24c46a566 WatchSource:0}: Error finding container 69c3c01912e1315fa455c7e34375cd4c2371b9d65a1e26a430e509e24c46a566: Status 404 returned error can't find the container with id 69c3c01912e1315fa455c7e34375cd4c2371b9d65a1e26a430e509e24c46a566
Sep 19 10:53:02.920463 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:02.920425    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"]
Sep 19 10:53:02.920801 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:53:02.920774    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaabb2bb3_7769_46f6_bea8_d2392ed84cca.slice/crio-049782f11aed6d253c1e3b148499b5f781e3a579452a934dd2b4466aded622fa WatchSource:0}: Error finding container 049782f11aed6d253c1e3b148499b5f781e3a579452a934dd2b4466aded622fa: Status 404 returned error can't find the container with id 049782f11aed6d253c1e3b148499b5f781e3a579452a934dd2b4466aded622fa
Sep 19 10:53:03.628339 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:03.628283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn" event={"ID":"aabb2bb3-7769-46f6-bea8-d2392ed84cca","Type":"ContainerStarted","Data":"c94f8a1f61f92e0665f093a5aacde1ca6f444868fc8946b49bc65de64b84a388"}
Sep 19 10:53:03.628821 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:03.628358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn" event={"ID":"aabb2bb3-7769-46f6-bea8-d2392ed84cca","Type":"ContainerStarted","Data":"049782f11aed6d253c1e3b148499b5f781e3a579452a934dd2b4466aded622fa"}
Sep 19 10:53:03.628821 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:03.628389    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:03.630150 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:03.630117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn" event={"ID":"794d4e41-7f68-4f27-9fbf-50c22b9c28a2","Type":"ContainerStarted","Data":"e04acf3a730351d4b8414df1288307880ab2204d8df2768c15b0527de26990e5"}
Sep 19 10:53:03.630261 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:03.630158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn" event={"ID":"794d4e41-7f68-4f27-9fbf-50c22b9c28a2","Type":"ContainerStarted","Data":"69c3c01912e1315fa455c7e34375cd4c2371b9d65a1e26a430e509e24c46a566"}
Sep 19 10:53:03.630261 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:03.630178    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:03.645097 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:03.645043    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn" podStartSLOduration=1.645026367 podStartE2EDuration="1.645026367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:53:03.644177734 +0000 UTC m=+987.577883972" watchObservedRunningTime="2026-09-19 10:53:03.645026367 +0000 UTC m=+987.578732580"
Sep 19 10:53:03.660416 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:03.660368    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn" podStartSLOduration=1.6603542519999999 podStartE2EDuration="1.660354252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:53:03.65901417 +0000 UTC m=+987.592720404" watchObservedRunningTime="2026-09-19 10:53:03.660354252 +0000 UTC m=+987.594060514"
Sep 19 10:53:14.638232 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:14.638194    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:14.638720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:14.638397    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:34.943293 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:34.943253    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"]
Sep 19 10:53:34.946983 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:34.946963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"
Sep 19 10:53:34.949374 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:34.949349    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:53:34.949492 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:34.949358    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:53:34.952851 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:34.952820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f88c40e-0283-46f0-acb3-eb47ab5d96df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-18444f28-962d4\" (UID: \"7f88c40e-0283-46f0-acb3-eb47ab5d96df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"
Sep 19 10:53:34.954041 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:34.954017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"]
Sep 19 10:53:35.053961 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:35.053928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f88c40e-0283-46f0-acb3-eb47ab5d96df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-18444f28-962d4\" (UID: \"7f88c40e-0283-46f0-acb3-eb47ab5d96df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"
Sep 19 10:53:35.054611 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:35.054591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f88c40e-0283-46f0-acb3-eb47ab5d96df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-18444f28-962d4\" (UID: \"7f88c40e-0283-46f0-acb3-eb47ab5d96df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"
Sep 19 10:53:35.260628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:35.260534    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"
Sep 19 10:53:35.531162 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:35.531137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"]
Sep 19 10:53:35.532421 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:53:35.532394    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f88c40e_0283_46f0_acb3_eb47ab5d96df.slice/crio-d5fb1a475de9c9613bc32f1a3cca7fd74c36d2d22b937ac3ec0d9a27099e3ec0 WatchSource:0}: Error finding container d5fb1a475de9c9613bc32f1a3cca7fd74c36d2d22b937ac3ec0d9a27099e3ec0: Status 404 returned error can't find the container with id d5fb1a475de9c9613bc32f1a3cca7fd74c36d2d22b937ac3ec0d9a27099e3ec0
Sep 19 10:53:35.839258 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:35.839230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4" event={"ID":"7f88c40e-0283-46f0-acb3-eb47ab5d96df","Type":"ContainerStarted","Data":"f8e3f0ab5e18609554458d000bb5aa9cf00b1f4911126f2952cbb237173a881d"}
Sep 19 10:53:35.839628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:35.839281    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4" event={"ID":"7f88c40e-0283-46f0-acb3-eb47ab5d96df","Type":"ContainerStarted","Data":"d5fb1a475de9c9613bc32f1a3cca7fd74c36d2d22b937ac3ec0d9a27099e3ec0"}
Sep 19 10:53:35.853579 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:35.853520    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4" podStartSLOduration=1.853504594 podStartE2EDuration="1.853504594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:53:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:53:35.851769238 +0000 UTC m=+1019.785475473" watchObservedRunningTime="2026-09-19 10:53:35.853504594 +0000 UTC m=+1019.787210808"
Sep 19 10:53:36.848088 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:36.848055    2563 generic.go:356] "Generic (PLEG): container finished" podID="7f88c40e-0283-46f0-acb3-eb47ab5d96df" containerID="f8e3f0ab5e18609554458d000bb5aa9cf00b1f4911126f2952cbb237173a881d" exitCode=0
Sep 19 10:53:36.848474 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:36.848146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4" event={"ID":"7f88c40e-0283-46f0-acb3-eb47ab5d96df","Type":"ContainerDied","Data":"f8e3f0ab5e18609554458d000bb5aa9cf00b1f4911126f2952cbb237173a881d"}
Sep 19 10:53:37.988594 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:37.988572    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"
Sep 19 10:53:38.180576 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:38.180459    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f88c40e-0283-46f0-acb3-eb47ab5d96df-maas-api-service-ca\") pod \"7f88c40e-0283-46f0-acb3-eb47ab5d96df\" (UID: \"7f88c40e-0283-46f0-acb3-eb47ab5d96df\") "
Sep 19 10:53:38.180856 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:38.180831    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f88c40e-0283-46f0-acb3-eb47ab5d96df-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7f88c40e-0283-46f0-acb3-eb47ab5d96df" (UID: "7f88c40e-0283-46f0-acb3-eb47ab5d96df"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:53:38.281286 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:38.281244    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f88c40e-0283-46f0-acb3-eb47ab5d96df-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:53:38.862733 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:38.862706    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"
Sep 19 10:53:38.862920 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:38.862753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4" event={"ID":"7f88c40e-0283-46f0-acb3-eb47ab5d96df","Type":"ContainerDied","Data":"d5fb1a475de9c9613bc32f1a3cca7fd74c36d2d22b937ac3ec0d9a27099e3ec0"}
Sep 19 10:53:38.862920 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:38.862797    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5fb1a475de9c9613bc32f1a3cca7fd74c36d2d22b937ac3ec0d9a27099e3ec0"
Sep 19 10:53:45.627388 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.627356    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"]
Sep 19 10:53:45.627993 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.627586    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn" podUID="aabb2bb3-7769-46f6-bea8-d2392ed84cca" containerName="payload-processing" containerID="cri-o://c94f8a1f61f92e0665f093a5aacde1ca6f444868fc8946b49bc65de64b84a388" gracePeriod=30
Sep 19 10:53:45.636102 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.635847    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"]
Sep 19 10:53:45.636227 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.636202    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn" podUID="794d4e41-7f68-4f27-9fbf-50c22b9c28a2" containerName="payload-pre-processing" containerID="cri-o://e04acf3a730351d4b8414df1288307880ab2204d8df2768c15b0527de26990e5" gracePeriod=30
Sep 19 10:53:45.786639 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.786601    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"]
Sep 19 10:53:45.789461 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.789431    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18444f28-962d4"]
Sep 19 10:53:45.912665 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.912630    2563 generic.go:356] "Generic (PLEG): container finished" podID="aabb2bb3-7769-46f6-bea8-d2392ed84cca" containerID="c94f8a1f61f92e0665f093a5aacde1ca6f444868fc8946b49bc65de64b84a388" exitCode=0
Sep 19 10:53:45.912798 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.912697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn" event={"ID":"aabb2bb3-7769-46f6-bea8-d2392ed84cca","Type":"ContainerDied","Data":"c94f8a1f61f92e0665f093a5aacde1ca6f444868fc8946b49bc65de64b84a388"}
Sep 19 10:53:45.914749 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.914727    2563 generic.go:356] "Generic (PLEG): container finished" podID="794d4e41-7f68-4f27-9fbf-50c22b9c28a2" containerID="e04acf3a730351d4b8414df1288307880ab2204d8df2768c15b0527de26990e5" exitCode=0
Sep 19 10:53:45.914841 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.914776    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn" event={"ID":"794d4e41-7f68-4f27-9fbf-50c22b9c28a2","Type":"ContainerDied","Data":"e04acf3a730351d4b8414df1288307880ab2204d8df2768c15b0527de26990e5"}
Sep 19 10:53:45.937083 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.936782    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:45.940527 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.940509    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:45.949882 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.949862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb468\" (UniqueName: \"kubernetes.io/projected/aabb2bb3-7769-46f6-bea8-d2392ed84cca-kube-api-access-mb468\") pod \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\" (UID: \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\") "
Sep 19 10:53:45.949967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.949909    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aabb2bb3-7769-46f6-bea8-d2392ed84cca-plugins-config-volume\") pod \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\" (UID: \"aabb2bb3-7769-46f6-bea8-d2392ed84cca\") "
Sep 19 10:53:45.950305 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.950278    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aabb2bb3-7769-46f6-bea8-d2392ed84cca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aabb2bb3-7769-46f6-bea8-d2392ed84cca" (UID: "aabb2bb3-7769-46f6-bea8-d2392ed84cca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:53:45.952005 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:45.951974    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aabb2bb3-7769-46f6-bea8-d2392ed84cca-kube-api-access-mb468" (OuterVolumeSpecName: "kube-api-access-mb468") pod "aabb2bb3-7769-46f6-bea8-d2392ed84cca" (UID: "aabb2bb3-7769-46f6-bea8-d2392ed84cca"). InnerVolumeSpecName "kube-api-access-mb468". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:53:46.053319 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.051702    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-plugins-config-volume\") pod \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\" (UID: \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\") "
Sep 19 10:53:46.053319 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.051752    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6mc6\" (UniqueName: \"kubernetes.io/projected/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-kube-api-access-s6mc6\") pod \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\" (UID: \"794d4e41-7f68-4f27-9fbf-50c22b9c28a2\") "
Sep 19 10:53:46.053319 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.052308    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "794d4e41-7f68-4f27-9fbf-50c22b9c28a2" (UID: "794d4e41-7f68-4f27-9fbf-50c22b9c28a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:53:46.053319 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.052693    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aabb2bb3-7769-46f6-bea8-d2392ed84cca-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:53:46.053319 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.052713    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:53:46.053319 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.052728    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb468\" (UniqueName: \"kubernetes.io/projected/aabb2bb3-7769-46f6-bea8-d2392ed84cca-kube-api-access-mb468\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:53:46.055234 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.055209    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-kube-api-access-s6mc6" (OuterVolumeSpecName: "kube-api-access-s6mc6") pod "794d4e41-7f68-4f27-9fbf-50c22b9c28a2" (UID: "794d4e41-7f68-4f27-9fbf-50c22b9c28a2"). InnerVolumeSpecName "kube-api-access-s6mc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:53:46.118998 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.118968    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f88c40e-0283-46f0-acb3-eb47ab5d96df" path="/var/lib/kubelet/pods/7f88c40e-0283-46f0-acb3-eb47ab5d96df/volumes"
Sep 19 10:53:46.153966 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.153936    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6mc6\" (UniqueName: \"kubernetes.io/projected/794d4e41-7f68-4f27-9fbf-50c22b9c28a2-kube-api-access-s6mc6\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:53:46.922338 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.922233    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"
Sep 19 10:53:46.922338 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.922256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn" event={"ID":"794d4e41-7f68-4f27-9fbf-50c22b9c28a2","Type":"ContainerDied","Data":"69c3c01912e1315fa455c7e34375cd4c2371b9d65a1e26a430e509e24c46a566"}
Sep 19 10:53:46.922893 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.922394    2563 scope.go:117] "RemoveContainer" containerID="e04acf3a730351d4b8414df1288307880ab2204d8df2768c15b0527de26990e5"
Sep 19 10:53:46.923890 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.923876    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"
Sep 19 10:53:46.923967 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.923898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn" event={"ID":"aabb2bb3-7769-46f6-bea8-d2392ed84cca","Type":"ContainerDied","Data":"049782f11aed6d253c1e3b148499b5f781e3a579452a934dd2b4466aded622fa"}
Sep 19 10:53:46.932005 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.931990    2563 scope.go:117] "RemoveContainer" containerID="c94f8a1f61f92e0665f093a5aacde1ca6f444868fc8946b49bc65de64b84a388"
Sep 19 10:53:46.940679 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.940654    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"]
Sep 19 10:53:46.944851 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.944831    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-18444f28-589884d5c7-cs9gn"]
Sep 19 10:53:46.957173 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.957149    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"]
Sep 19 10:53:46.960882 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:46.960858    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-18444f28-f477db99d-qxcfn"]
Sep 19 10:53:48.118903 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:48.118869    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="794d4e41-7f68-4f27-9fbf-50c22b9c28a2" path="/var/lib/kubelet/pods/794d4e41-7f68-4f27-9fbf-50c22b9c28a2/volumes"
Sep 19 10:53:48.119279 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:53:48.119243    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aabb2bb3-7769-46f6-bea8-d2392ed84cca" path="/var/lib/kubelet/pods/aabb2bb3-7769-46f6-bea8-d2392ed84cca/volumes"
Sep 19 10:54:12.694149 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694110    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"]
Sep 19 10:54:12.696200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694723    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f88c40e-0283-46f0-acb3-eb47ab5d96df" containerName="revoke-keys"
Sep 19 10:54:12.696200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694740    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f88c40e-0283-46f0-acb3-eb47ab5d96df" containerName="revoke-keys"
Sep 19 10:54:12.696200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694755    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794d4e41-7f68-4f27-9fbf-50c22b9c28a2" containerName="payload-pre-processing"
Sep 19 10:54:12.696200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694760    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="794d4e41-7f68-4f27-9fbf-50c22b9c28a2" containerName="payload-pre-processing"
Sep 19 10:54:12.696200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694773    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aabb2bb3-7769-46f6-bea8-d2392ed84cca" containerName="payload-processing"
Sep 19 10:54:12.696200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694779    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aabb2bb3-7769-46f6-bea8-d2392ed84cca" containerName="payload-processing"
Sep 19 10:54:12.696200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694852    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f88c40e-0283-46f0-acb3-eb47ab5d96df" containerName="revoke-keys"
Sep 19 10:54:12.696200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694863    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="794d4e41-7f68-4f27-9fbf-50c22b9c28a2" containerName="payload-pre-processing"
Sep 19 10:54:12.696200 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.694870    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aabb2bb3-7769-46f6-bea8-d2392ed84cca" containerName="payload-processing"
Sep 19 10:54:12.698005 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.697987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:12.700353 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.700331    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-20c8d9\""
Sep 19 10:54:12.700522 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.700332    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-20c8d9-dockercfg-r9t4k\""
Sep 19 10:54:12.708375 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.708353    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"]
Sep 19 10:54:12.728534 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.728501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z85xq\" (UniqueName: \"kubernetes.io/projected/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-kube-api-access-z85xq\") pod \"payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l\" (UID: \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:12.728713 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.728674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l\" (UID: \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:12.734468 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.734434    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"]
Sep 19 10:54:12.738109 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.738090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:12.748624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.748603    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"]
Sep 19 10:54:12.829434 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.829396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xhrr\" (UniqueName: \"kubernetes.io/projected/7305aaf3-a146-490b-ad41-81564c21efcd-kube-api-access-8xhrr\") pod \"payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8\" (UID: \"7305aaf3-a146-490b-ad41-81564c21efcd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:12.829647 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.829457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7305aaf3-a146-490b-ad41-81564c21efcd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8\" (UID: \"7305aaf3-a146-490b-ad41-81564c21efcd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:12.829647 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.829509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l\" (UID: \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:12.829647 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.829599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z85xq\" (UniqueName: \"kubernetes.io/projected/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-kube-api-access-z85xq\") pod \"payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l\" (UID: \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:12.830257 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.830238    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l\" (UID: \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:12.837189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.837164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z85xq\" (UniqueName: \"kubernetes.io/projected/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-kube-api-access-z85xq\") pod \"payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l\" (UID: \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:12.930501 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.930463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7305aaf3-a146-490b-ad41-81564c21efcd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8\" (UID: \"7305aaf3-a146-490b-ad41-81564c21efcd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:12.930715 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.930587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xhrr\" (UniqueName: \"kubernetes.io/projected/7305aaf3-a146-490b-ad41-81564c21efcd-kube-api-access-8xhrr\") pod \"payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8\" (UID: \"7305aaf3-a146-490b-ad41-81564c21efcd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:12.931252 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.931224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7305aaf3-a146-490b-ad41-81564c21efcd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8\" (UID: \"7305aaf3-a146-490b-ad41-81564c21efcd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:12.938379 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:12.938356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xhrr\" (UniqueName: \"kubernetes.io/projected/7305aaf3-a146-490b-ad41-81564c21efcd-kube-api-access-8xhrr\") pod \"payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8\" (UID: \"7305aaf3-a146-490b-ad41-81564c21efcd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:13.010105 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:13.010013    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:13.050640 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:13.050321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:13.282313 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:13.282285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"]
Sep 19 10:54:13.283398 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:54:13.283374    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc735ded_ec6c_4cc2_b3a0_5cba0b5000e0.slice/crio-45fe07daa3654017d021225ee2f6d9d4e0c256d052a68308a1f52c3544ad966e WatchSource:0}: Error finding container 45fe07daa3654017d021225ee2f6d9d4e0c256d052a68308a1f52c3544ad966e: Status 404 returned error can't find the container with id 45fe07daa3654017d021225ee2f6d9d4e0c256d052a68308a1f52c3544ad966e
Sep 19 10:54:13.332233 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:13.332204    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"]
Sep 19 10:54:13.334644 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:54:13.334616    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7305aaf3_a146_490b_ad41_81564c21efcd.slice/crio-e9744d317be8f440ea2d8578a2bd26c3c4a6ce1029a86b9a71565e78a0a465b0 WatchSource:0}: Error finding container e9744d317be8f440ea2d8578a2bd26c3c4a6ce1029a86b9a71565e78a0a465b0: Status 404 returned error can't find the container with id e9744d317be8f440ea2d8578a2bd26c3c4a6ce1029a86b9a71565e78a0a465b0
Sep 19 10:54:14.095682 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:14.095648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8" event={"ID":"7305aaf3-a146-490b-ad41-81564c21efcd","Type":"ContainerStarted","Data":"16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0"}
Sep 19 10:54:14.096189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:14.095699    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8" event={"ID":"7305aaf3-a146-490b-ad41-81564c21efcd","Type":"ContainerStarted","Data":"e9744d317be8f440ea2d8578a2bd26c3c4a6ce1029a86b9a71565e78a0a465b0"}
Sep 19 10:54:14.096189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:14.095751    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:14.097450 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:14.097427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l" event={"ID":"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0","Type":"ContainerStarted","Data":"f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18"}
Sep 19 10:54:14.097602 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:14.097472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l" event={"ID":"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0","Type":"ContainerStarted","Data":"45fe07daa3654017d021225ee2f6d9d4e0c256d052a68308a1f52c3544ad966e"}
Sep 19 10:54:14.097602 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:14.097564    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:14.115010 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:14.114955    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8" podStartSLOduration=2.114937659 podStartE2EDuration="2.114937659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:54:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:54:14.112064712 +0000 UTC m=+1058.045770951" watchObservedRunningTime="2026-09-19 10:54:14.114937659 +0000 UTC m=+1058.048643879"
Sep 19 10:54:14.129118 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:14.129069    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l" podStartSLOduration=2.129053196 podStartE2EDuration="2.129053196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:54:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:54:14.127754655 +0000 UTC m=+1058.061460912" watchObservedRunningTime="2026-09-19 10:54:14.129053196 +0000 UTC m=+1058.062759409"
Sep 19 10:54:16.736958 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:16.736906    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"]
Sep 19 10:54:16.742423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:16.742388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"
Sep 19 10:54:16.744006 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:16.743982    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"]
Sep 19 10:54:16.744748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:16.744725    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:54:16.744748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:16.744741    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:54:16.761564 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:16.761520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7403103b-d637-403c-b424-b55b73a80d4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-e898f8-5btf6\" (UID: \"7403103b-d637-403c-b424-b55b73a80d4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"
Sep 19 10:54:16.862640 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:16.862606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7403103b-d637-403c-b424-b55b73a80d4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-e898f8-5btf6\" (UID: \"7403103b-d637-403c-b424-b55b73a80d4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"
Sep 19 10:54:16.863236 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:16.863215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7403103b-d637-403c-b424-b55b73a80d4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-e898f8-5btf6\" (UID: \"7403103b-d637-403c-b424-b55b73a80d4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"
Sep 19 10:54:17.054776 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:17.054693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"
Sep 19 10:54:17.323581 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:17.323497    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"]
Sep 19 10:54:17.325957 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:54:17.325926    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7403103b_d637_403c_b424_b55b73a80d4c.slice/crio-3bfacd70218c6e2f902d787e6a8672aa5971f8fcebdd0c79fdec64b52ad3acee WatchSource:0}: Error finding container 3bfacd70218c6e2f902d787e6a8672aa5971f8fcebdd0c79fdec64b52ad3acee: Status 404 returned error can't find the container with id 3bfacd70218c6e2f902d787e6a8672aa5971f8fcebdd0c79fdec64b52ad3acee
Sep 19 10:54:18.127920 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:18.127889    2563 generic.go:356] "Generic (PLEG): container finished" podID="7403103b-d637-403c-b424-b55b73a80d4c" containerID="13de894c991b90052f1df89e742e79b6dd3e3446f831051217bcceb1f32fac51" exitCode=0
Sep 19 10:54:18.128279 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:18.127954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6" event={"ID":"7403103b-d637-403c-b424-b55b73a80d4c","Type":"ContainerDied","Data":"13de894c991b90052f1df89e742e79b6dd3e3446f831051217bcceb1f32fac51"}
Sep 19 10:54:18.128279 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:18.127999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6" event={"ID":"7403103b-d637-403c-b424-b55b73a80d4c","Type":"ContainerStarted","Data":"3bfacd70218c6e2f902d787e6a8672aa5971f8fcebdd0c79fdec64b52ad3acee"}
Sep 19 10:54:19.291095 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:19.291068    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"
Sep 19 10:54:19.386496 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:19.386371    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7403103b-d637-403c-b424-b55b73a80d4c-maas-api-service-ca\") pod \"7403103b-d637-403c-b424-b55b73a80d4c\" (UID: \"7403103b-d637-403c-b424-b55b73a80d4c\") "
Sep 19 10:54:19.386799 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:19.386776    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7403103b-d637-403c-b424-b55b73a80d4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7403103b-d637-403c-b424-b55b73a80d4c" (UID: "7403103b-d637-403c-b424-b55b73a80d4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:54:19.488070 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:19.488023    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7403103b-d637-403c-b424-b55b73a80d4c-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:54:20.141167 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:20.141142    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"
Sep 19 10:54:20.141308 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:20.141179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6" event={"ID":"7403103b-d637-403c-b424-b55b73a80d4c","Type":"ContainerDied","Data":"3bfacd70218c6e2f902d787e6a8672aa5971f8fcebdd0c79fdec64b52ad3acee"}
Sep 19 10:54:20.141308 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:20.141226    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bfacd70218c6e2f902d787e6a8672aa5971f8fcebdd0c79fdec64b52ad3acee"
Sep 19 10:54:24.109064 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.109030    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"]
Sep 19 10:54:24.109723 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.109697    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7403103b-d637-403c-b424-b55b73a80d4c" containerName="revoke-keys"
Sep 19 10:54:24.109723 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.109722    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7403103b-d637-403c-b424-b55b73a80d4c" containerName="revoke-keys"
Sep 19 10:54:24.109960 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.109834    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7403103b-d637-403c-b424-b55b73a80d4c" containerName="revoke-keys"
Sep 19 10:54:24.113518 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.113494    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.115868 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.115847    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-8ddce5-openshift-default-dockercfg-wdslg\""
Sep 19 10:54:24.125659 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.125630    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"]
Sep 19 10:54:24.137717 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.137681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-data\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.137871 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.137763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istiod-ca-cert\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.137871 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.137802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-certs\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.137871 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.137822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-podinfo\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.137871 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.137844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-envoy\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.138053 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.137880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzwc5\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-kube-api-access-hzwc5\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.138053 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.137954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-socket\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.138053 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.138013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-credential-socket\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.138196 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.138129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-token\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.239799 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.239759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-token\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.239836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-data\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.239907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istiod-ca-cert\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.239950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-certs\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.239979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-podinfo\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.240013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-envoy\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240336 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.240059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzwc5\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-kube-api-access-hzwc5\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240336 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.240088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-socket\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240336 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.240114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-credential-socket\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240813 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.240785    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-credential-socket\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.240918 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.240883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-data\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.241091 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.241070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-certs\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.241206 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.241167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-socket\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.241572 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.241299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istiod-ca-cert\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.243206 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.243183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-envoy\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.244127 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.244083    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-podinfo\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.249323 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.249286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-token\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.249445 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.249400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzwc5\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-kube-api-access-hzwc5\") pod \"e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") " pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.426586 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.426477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:24.706210 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.706184    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"]
Sep 19 10:54:24.707632 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:54:24.707608    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a82dfa_1cfc_473a_a1ee_f0b1a11fb671.slice/crio-d8a3fa44b7bcf9fb1b92f254262ab4ba49af09e829fb0fc7b01946d159ed2087 WatchSource:0}: Error finding container d8a3fa44b7bcf9fb1b92f254262ab4ba49af09e829fb0fc7b01946d159ed2087: Status 404 returned error can't find the container with id d8a3fa44b7bcf9fb1b92f254262ab4ba49af09e829fb0fc7b01946d159ed2087
Sep 19 10:54:24.710387 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.710345    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:54:24.710487 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.710438    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:54:24.710487 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:24.710481    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:54:25.105328 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:25.105301    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 10:54:25.105501 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:25.105372    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 10:54:25.176204 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:25.176164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" event={"ID":"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671","Type":"ContainerStarted","Data":"18f83022720ee090390da9235c42f7c5691f6c3e386906318709b6044895bbb3"}
Sep 19 10:54:25.176668 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:25.176228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" event={"ID":"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671","Type":"ContainerStarted","Data":"d8a3fa44b7bcf9fb1b92f254262ab4ba49af09e829fb0fc7b01946d159ed2087"}
Sep 19 10:54:25.194331 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:25.194287    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" podStartSLOduration=1.194267642 podStartE2EDuration="1.194267642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:54:25.192531757 +0000 UTC m=+1069.126238018" watchObservedRunningTime="2026-09-19 10:54:25.194267642 +0000 UTC m=+1069.127973856"
Sep 19 10:54:25.427676 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:25.427590    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:25.433348 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:25.433322    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:26.181953 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:26.181921    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:26.182993 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:26.182970    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:54:27.208308 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.208274    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"]
Sep 19 10:54:27.208800 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.208535    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d" podUID="9a39086c-fb0f-4e94-ba67-83877139e04a" containerName="payload-pre-processing" containerID="cri-o://8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498" gracePeriod=30
Sep 19 10:54:27.378524 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.378366    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"]
Sep 19 10:54:27.381973 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.381946    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-e898f8-5btf6"]
Sep 19 10:54:27.468129 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.468062    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:54:27.575521 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.575489    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a39086c-fb0f-4e94-ba67-83877139e04a-plugins-config-volume\") pod \"9a39086c-fb0f-4e94-ba67-83877139e04a\" (UID: \"9a39086c-fb0f-4e94-ba67-83877139e04a\") "
Sep 19 10:54:27.575722 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.575694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wf9g\" (UniqueName: \"kubernetes.io/projected/9a39086c-fb0f-4e94-ba67-83877139e04a-kube-api-access-7wf9g\") pod \"9a39086c-fb0f-4e94-ba67-83877139e04a\" (UID: \"9a39086c-fb0f-4e94-ba67-83877139e04a\") "
Sep 19 10:54:27.575886 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.575862    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a39086c-fb0f-4e94-ba67-83877139e04a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a39086c-fb0f-4e94-ba67-83877139e04a" (UID: "9a39086c-fb0f-4e94-ba67-83877139e04a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:54:27.576030 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.576013    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a39086c-fb0f-4e94-ba67-83877139e04a-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:54:27.577747 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.577721    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a39086c-fb0f-4e94-ba67-83877139e04a-kube-api-access-7wf9g" (OuterVolumeSpecName: "kube-api-access-7wf9g") pod "9a39086c-fb0f-4e94-ba67-83877139e04a" (UID: "9a39086c-fb0f-4e94-ba67-83877139e04a"). InnerVolumeSpecName "kube-api-access-7wf9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:54:27.677364 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:27.677327    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wf9g\" (UniqueName: \"kubernetes.io/projected/9a39086c-fb0f-4e94-ba67-83877139e04a-kube-api-access-7wf9g\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:54:28.120414 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.120379    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7403103b-d637-403c-b424-b55b73a80d4c" path="/var/lib/kubelet/pods/7403103b-d637-403c-b424-b55b73a80d4c/volumes"
Sep 19 10:54:28.199895 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.199866    2563 generic.go:356] "Generic (PLEG): container finished" podID="9a39086c-fb0f-4e94-ba67-83877139e04a" containerID="8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498" exitCode=0
Sep 19 10:54:28.200074 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.199915    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"
Sep 19 10:54:28.200074 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.199952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d" event={"ID":"9a39086c-fb0f-4e94-ba67-83877139e04a","Type":"ContainerDied","Data":"8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498"}
Sep 19 10:54:28.200074 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.200002    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d" event={"ID":"9a39086c-fb0f-4e94-ba67-83877139e04a","Type":"ContainerDied","Data":"a7845b55c1769c1c8baf3d3b9d5bd1e44d33782c38cfc8677433162f0ef8ede0"}
Sep 19 10:54:28.200074 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.200024    2563 scope.go:117] "RemoveContainer" containerID="8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498"
Sep 19 10:54:28.210441 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.210266    2563 scope.go:117] "RemoveContainer" containerID="8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498"
Sep 19 10:54:28.210717 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:54:28.210636    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498\": container with ID starting with 8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498 not found: ID does not exist" containerID="8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498"
Sep 19 10:54:28.210717 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.210665    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498"} err="failed to get container status \"8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498\": rpc error: code = NotFound desc = could not find container \"8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498\": container with ID starting with 8caf3eaffe295b6cc317a91a4a90216040a6d30419bae593461a0416a6e04498 not found: ID does not exist"
Sep 19 10:54:28.218462 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.218432    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"]
Sep 19 10:54:28.226858 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:28.226830    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-e898f8-6bfd6c7546-8q77d"]
Sep 19 10:54:30.119135 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:54:30.119104    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a39086c-fb0f-4e94-ba67-83877139e04a" path="/var/lib/kubelet/pods/9a39086c-fb0f-4e94-ba67-83877139e04a/volumes"
Sep 19 10:55:04.425024 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:04.424990    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerID="18f83022720ee090390da9235c42f7c5691f6c3e386906318709b6044895bbb3" exitCode=0
Sep 19 10:55:04.425476 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:04.425073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" event={"ID":"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671","Type":"ContainerDied","Data":"18f83022720ee090390da9235c42f7c5691f6c3e386906318709b6044895bbb3"}
Sep 19 10:55:04.425523 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:04.425498    2563 scope.go:117] "RemoveContainer" containerID="18f83022720ee090390da9235c42f7c5691f6c3e386906318709b6044895bbb3"
Sep 19 10:55:04.426739 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:04.426713    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:55:04.426806 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:04.426779    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:55:04.426843 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:04.426811    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:55:05.438451 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:05.438415    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" event={"ID":"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671","Type":"ContainerStarted","Data":"cd05615b753bd689eeffd7476281845ecbeda90414b850e4f0a2021be9d0cff0"}
Sep 19 10:55:06.430756 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:06.430722    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:55:06.432692 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:06.432660    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 19 10:55:06.432909 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:06.432882    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 19 10:55:07.427220 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:07.427174    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 19 10:55:07.427750 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:07.427248    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 19 10:55:08.427700 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.427666    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 19 10:55:08.428763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.428357    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 19 10:55:08.632641 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.632606    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"]
Sep 19 10:55:08.633561 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.633517    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a39086c-fb0f-4e94-ba67-83877139e04a" containerName="payload-pre-processing"
Sep 19 10:55:08.633713 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.633700    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a39086c-fb0f-4e94-ba67-83877139e04a" containerName="payload-pre-processing"
Sep 19 10:55:08.633944 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.633930    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a39086c-fb0f-4e94-ba67-83877139e04a" containerName="payload-pre-processing"
Sep 19 10:55:08.640985 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.640960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.644858 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.644833    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9ebfd604-openshift-default-dockercfg-42xpf\""
Sep 19 10:55:08.653576 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.652727    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"]
Sep 19 10:55:08.701813 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.701727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istiod-ca-cert\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.701813 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.701771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-data\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.702047 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.701868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-token\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.702047 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.701918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-podinfo\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.702047 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.701953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwdsl\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-kube-api-access-kwdsl\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.702047 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.701982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-credential-socket\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.702047 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.702006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-certs\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.702231 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.702100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-envoy\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.702231 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.702137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-socket\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.803811 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.803774    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istiod-ca-cert\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.803811 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.803816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-data\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804166 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.803842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-token\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804166 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.803866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-podinfo\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804166 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.803889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwdsl\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-kube-api-access-kwdsl\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804166 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.803909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-credential-socket\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804166 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.803926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-certs\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804166 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.803968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-envoy\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804166 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.803987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-socket\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804577 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.804308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-socket\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804577 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.804487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-data\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.804696 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.804669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istiod-ca-cert\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.805018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.804936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-credential-socket\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.805252 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.805232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-certs\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.807264 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.807235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-podinfo\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.807382 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.807322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-envoy\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.812193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.812169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-token\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.812330 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.812311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwdsl\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-kube-api-access-kwdsl\") pod \"e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") " pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:08.959101 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:08.959003    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:09.277023 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.276991    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"]
Sep 19 10:55:09.278642 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:55:09.278604    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0b312a_130e_4dc1_8637_0d3d2572eee7.slice/crio-f4f69f0d25babb35ee6a91ccbf573c76320a119cfc78a93ac3fc9b7761f8a246 WatchSource:0}: Error finding container f4f69f0d25babb35ee6a91ccbf573c76320a119cfc78a93ac3fc9b7761f8a246: Status 404 returned error can't find the container with id f4f69f0d25babb35ee6a91ccbf573c76320a119cfc78a93ac3fc9b7761f8a246
Sep 19 10:55:09.281449 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.281418    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:55:09.281525 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.281487    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:55:09.281525 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.281513    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:55:09.450624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.448794    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 19 10:55:09.450624 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.448892    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 19 10:55:09.469195 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.469148    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" event={"ID":"ec0b312a-130e-4dc1-8637-0d3d2572eee7","Type":"ContainerStarted","Data":"909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d"}
Sep 19 10:55:09.469374 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.469298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" event={"ID":"ec0b312a-130e-4dc1-8637-0d3d2572eee7","Type":"ContainerStarted","Data":"f4f69f0d25babb35ee6a91ccbf573c76320a119cfc78a93ac3fc9b7761f8a246"}
Sep 19 10:55:09.492178 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.492115    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" podStartSLOduration=1.492091968 podStartE2EDuration="1.492091968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:55:09.488928666 +0000 UTC m=+1113.422634897" watchObservedRunningTime="2026-09-19 10:55:09.492091968 +0000 UTC m=+1113.425798184"
Sep 19 10:55:09.959601 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:09.959543    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:10.427070 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:10.427030    2563 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 19 10:55:10.427264 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:10.427088    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 19 10:55:11.004378 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:11.004332    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:11.182106 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:11.182072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:55:11.431680 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:11.431652    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:55:11.482671 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:11.482640    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:11.483473 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:11.483450    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:11.483640 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:11.483611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 10:55:16.865558 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:16.865513    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"]
Sep 19 10:55:16.869448 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:16.869426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:16.871791 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:16.871771    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-9ebfd604-dockercfg-vwwqr\""
Sep 19 10:55:16.872075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:16.872060    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-9ebfd604\""
Sep 19 10:55:16.880000 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:16.879974    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"]
Sep 19 10:55:16.997493 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:16.997452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536d4fce-81e2-457b-8d0e-5f382485b1b0-plugins-config-volume\") pod \"payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc\" (UID: \"536d4fce-81e2-457b-8d0e-5f382485b1b0\") " pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:16.997493 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:16.997498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj7xm\" (UniqueName: \"kubernetes.io/projected/536d4fce-81e2-457b-8d0e-5f382485b1b0-kube-api-access-rj7xm\") pod \"payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc\" (UID: \"536d4fce-81e2-457b-8d0e-5f382485b1b0\") " pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:17.098933 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.098895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536d4fce-81e2-457b-8d0e-5f382485b1b0-plugins-config-volume\") pod \"payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc\" (UID: \"536d4fce-81e2-457b-8d0e-5f382485b1b0\") " pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:17.098933 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.098938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj7xm\" (UniqueName: \"kubernetes.io/projected/536d4fce-81e2-457b-8d0e-5f382485b1b0-kube-api-access-rj7xm\") pod \"payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc\" (UID: \"536d4fce-81e2-457b-8d0e-5f382485b1b0\") " pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:17.099675 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.099654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536d4fce-81e2-457b-8d0e-5f382485b1b0-plugins-config-volume\") pod \"payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc\" (UID: \"536d4fce-81e2-457b-8d0e-5f382485b1b0\") " pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:17.106610 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.106590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj7xm\" (UniqueName: \"kubernetes.io/projected/536d4fce-81e2-457b-8d0e-5f382485b1b0-kube-api-access-rj7xm\") pod \"payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc\" (UID: \"536d4fce-81e2-457b-8d0e-5f382485b1b0\") " pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:17.181747 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.181667    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:17.455732 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.455703    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"]
Sep 19 10:55:17.457029 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:55:17.456999    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536d4fce_81e2_457b_8d0e_5f382485b1b0.slice/crio-0ba4238a5876af5c84124f99287635d970709fb287599df3f4a22abdf6118f8f WatchSource:0}: Error finding container 0ba4238a5876af5c84124f99287635d970709fb287599df3f4a22abdf6118f8f: Status 404 returned error can't find the container with id 0ba4238a5876af5c84124f99287635d970709fb287599df3f4a22abdf6118f8f
Sep 19 10:55:17.532694 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.532657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc" event={"ID":"536d4fce-81e2-457b-8d0e-5f382485b1b0","Type":"ContainerStarted","Data":"848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7"}
Sep 19 10:55:17.532838 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.532717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc" event={"ID":"536d4fce-81e2-457b-8d0e-5f382485b1b0","Type":"ContainerStarted","Data":"0ba4238a5876af5c84124f99287635d970709fb287599df3f4a22abdf6118f8f"}
Sep 19 10:55:17.532838 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.532771    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:17.548720 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:17.548669    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc" podStartSLOduration=1.548650692 podStartE2EDuration="1.548650692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:55:17.548085365 +0000 UTC m=+1121.481791589" watchObservedRunningTime="2026-09-19 10:55:17.548650692 +0000 UTC m=+1121.482356905"
Sep 19 10:55:28.541636 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:28.541606    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:55:38.199017 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:38.198982    2563 scope.go:117] "RemoveContainer" containerID="fa1906f389e52c4996dad7d7cbdc7f6d5532c8d9807917472e3989e2adf12f35"
Sep 19 10:55:38.211423 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:38.211396    2563 scope.go:117] "RemoveContainer" containerID="1af8fc09674939ff2f1b728950d08fe684749daa2aff6fb0636b5cc53f87beea"
Sep 19 10:55:42.523748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:42.523703    2563 patch_prober.go:28] interesting pod/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 10:55:42.524199 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:42.523795    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 10:55:43.704583 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:43.704531    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerID="909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d" exitCode=0
Sep 19 10:55:43.705057 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:43.704605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" event={"ID":"ec0b312a-130e-4dc1-8637-0d3d2572eee7","Type":"ContainerDied","Data":"909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d"}
Sep 19 10:55:43.705057 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:43.705015    2563 scope.go:117] "RemoveContainer" containerID="909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d"
Sep 19 10:55:43.706201 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:43.706175    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:55:43.706255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:43.706242    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:55:43.706293 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:43.706275    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:55:44.712973 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:44.712924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" event={"ID":"ec0b312a-130e-4dc1-8637-0d3d2572eee7","Type":"ContainerStarted","Data":"7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2"}
Sep 19 10:55:44.959942 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:44.959907    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:44.960184 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:44.960161    2563 patch_prober.go:28] interesting pod/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 19 10:55:44.960242 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:44.960223    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 19 10:55:45.959429 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:45.959391    2563 patch_prober.go:28] interesting pod/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 19 10:55:45.959848 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:45.959462    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 19 10:55:46.959694 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:46.959660    2563 patch_prober.go:28] interesting pod/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 19 10:55:46.960078 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:46.959717    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 19 10:55:47.959881 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:47.959850    2563 patch_prober.go:28] interesting pod/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 19 10:55:47.960259 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:47.959901    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 19 10:55:48.960324 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:48.960282    2563 patch_prober.go:28] interesting pod/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 19 10:55:48.960815 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:48.960342    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 19 10:55:49.963644 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:49.963531    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:49.964061 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:49.964032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:55:49.964915 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:55:49.964893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:56:02.721006 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.720970    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"]
Sep 19 10:56:02.724470 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.724452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.726822 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.726804    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-1907c1\"/\"openshift-service-ca.crt\""
Sep 19 10:56:02.728022 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.728002    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1907c1\"/\"default-dockercfg-d8flv\""
Sep 19 10:56:02.728022 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.728014    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1907c1\"/\"distinct-w0-1907c1-kserve-self-signed-certs\""
Sep 19 10:56:02.728166 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.728080    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-1907c1\"/\"kube-root-ca.crt\""
Sep 19 10:56:02.734485 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.734462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"]
Sep 19 10:56:02.796025 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.795987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tls-certs\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.796224 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.796102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tmp-dir\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.796292 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.796239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-home\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.796351 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.796308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-dshm\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.796416 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.796369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-model-cache\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.796416 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.796396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcx5t\" (UniqueName: \"kubernetes.io/projected/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-kube-api-access-bcx5t\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.897281 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.897246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-home\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.897477 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.897298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-dshm\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.897477 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.897351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-model-cache\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.897477 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.897373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcx5t\" (UniqueName: \"kubernetes.io/projected/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-kube-api-access-bcx5t\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.897477 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.897459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tls-certs\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.897747 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.897501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tmp-dir\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.897747 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.897719    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-home\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.897866 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.897751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-model-cache\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.897923 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.897884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tmp-dir\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.899515 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.899497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-dshm\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.899995 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.899976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tls-certs\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:02.906256 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:02.906235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcx5t\" (UniqueName: \"kubernetes.io/projected/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-kube-api-access-bcx5t\") pod \"distinct-w0-1907c1-kserve-669d578ddd-smsjb\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") " pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:03.035884 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:03.035796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:03.308501 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:03.308469    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"]
Sep 19 10:56:03.309579 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:56:03.309535    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dd94a1a_282a_4176_9f7a_fb6cc0ed221f.slice/crio-1fb313fe9872a6837e8dfcce19a2a443e8671afc17f53fb08e3d0a66da74d0f4 WatchSource:0}: Error finding container 1fb313fe9872a6837e8dfcce19a2a443e8671afc17f53fb08e3d0a66da74d0f4: Status 404 returned error can't find the container with id 1fb313fe9872a6837e8dfcce19a2a443e8671afc17f53fb08e3d0a66da74d0f4
Sep 19 10:56:03.848442 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:03.848393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb" event={"ID":"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f","Type":"ContainerStarted","Data":"d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981"}
Sep 19 10:56:03.848442 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:03.848446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb" event={"ID":"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f","Type":"ContainerStarted","Data":"1fb313fe9872a6837e8dfcce19a2a443e8671afc17f53fb08e3d0a66da74d0f4"}
Sep 19 10:56:03.864293 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:03.864245    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb" podStartSLOduration=1.8642293410000002 podStartE2EDuration="1.864229341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:56:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:56:03.862958004 +0000 UTC m=+1167.796664237" watchObservedRunningTime="2026-09-19 10:56:03.864229341 +0000 UTC m=+1167.797935559"
Sep 19 10:56:13.036738 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:13.036701    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:13.036738 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:13.036752    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:13.049461 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:13.049433    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:13.921999 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:13.921963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 10:56:30.353516 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.353475    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"]
Sep 19 10:56:30.357031 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.357013    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"
Sep 19 10:56:30.360285 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.360181    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:56:30.360285 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.360181    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:56:30.363542 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.363514    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"]
Sep 19 10:56:30.371742 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.371714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da31b72b-4d40-4d74-a0f8-de04d050a646-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt\" (UID: \"da31b72b-4d40-4d74-a0f8-de04d050a646\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"
Sep 19 10:56:30.472976 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.472946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da31b72b-4d40-4d74-a0f8-de04d050a646-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt\" (UID: \"da31b72b-4d40-4d74-a0f8-de04d050a646\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"
Sep 19 10:56:30.473525 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.473505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da31b72b-4d40-4d74-a0f8-de04d050a646-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt\" (UID: \"da31b72b-4d40-4d74-a0f8-de04d050a646\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"
Sep 19 10:56:30.670253 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.670168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"
Sep 19 10:56:30.953065 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:30.953036    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"]
Sep 19 10:56:30.954499 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:56:30.954466    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda31b72b_4d40_4d74_a0f8_de04d050a646.slice/crio-793cd89b0262a829f0af12e4f607c6030cb97656980049851dd0f64cd5a49954 WatchSource:0}: Error finding container 793cd89b0262a829f0af12e4f607c6030cb97656980049851dd0f64cd5a49954: Status 404 returned error can't find the container with id 793cd89b0262a829f0af12e4f607c6030cb97656980049851dd0f64cd5a49954
Sep 19 10:56:31.022942 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:31.022912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt" event={"ID":"da31b72b-4d40-4d74-a0f8-de04d050a646","Type":"ContainerStarted","Data":"793cd89b0262a829f0af12e4f607c6030cb97656980049851dd0f64cd5a49954"}
Sep 19 10:56:32.030850 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:32.030762    2563 generic.go:356] "Generic (PLEG): container finished" podID="da31b72b-4d40-4d74-a0f8-de04d050a646" containerID="11230f4b66c0ef936f9712aa281ce19d3cc5c36162e8abcddcc396c2c79735a9" exitCode=0
Sep 19 10:56:32.031217 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:32.030852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt" event={"ID":"da31b72b-4d40-4d74-a0f8-de04d050a646","Type":"ContainerDied","Data":"11230f4b66c0ef936f9712aa281ce19d3cc5c36162e8abcddcc396c2c79735a9"}
Sep 19 10:56:33.176227 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:33.176195    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"
Sep 19 10:56:33.203361 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:33.203337    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da31b72b-4d40-4d74-a0f8-de04d050a646-maas-api-service-ca\") pod \"da31b72b-4d40-4d74-a0f8-de04d050a646\" (UID: \"da31b72b-4d40-4d74-a0f8-de04d050a646\") "
Sep 19 10:56:33.203806 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:33.203780    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da31b72b-4d40-4d74-a0f8-de04d050a646-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da31b72b-4d40-4d74-a0f8-de04d050a646" (UID: "da31b72b-4d40-4d74-a0f8-de04d050a646"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:33.305625 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:33.305521    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da31b72b-4d40-4d74-a0f8-de04d050a646-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:34.045026 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:34.044995    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"
Sep 19 10:56:34.045212 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:34.044994    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt" event={"ID":"da31b72b-4d40-4d74-a0f8-de04d050a646","Type":"ContainerDied","Data":"793cd89b0262a829f0af12e4f607c6030cb97656980049851dd0f64cd5a49954"}
Sep 19 10:56:34.045212 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:34.045155    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="793cd89b0262a829f0af12e4f607c6030cb97656980049851dd0f64cd5a49954"
Sep 19 10:56:38.165018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:38.164987    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:56:38.169217 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:38.169196    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 10:56:38.264684 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:38.264652    2563 scope.go:117] "RemoveContainer" containerID="7c03358d94c1204f4e3b96bfc627dfe892c9c5df1df6f6df9da65ed7a5eea17f"
Sep 19 10:56:38.273704 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:38.273685    2563 scope.go:117] "RemoveContainer" containerID="bfb16f6bf3d7414c4afec565d56d71a282e9a8be33ff482102352b2ae9992240"
Sep 19 10:56:40.943087 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:40.943053    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"]
Sep 19 10:56:40.943489 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:40.943296    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn" podUID="6ff8042b-6c88-4c50-a93c-ff9d198c93e8" containerName="payload-processing" containerID="cri-o://40f5cc0c7362b2ef8dbd9ac7317d1f07b00f6aaf6f641879982d358e15db96d9" gracePeriod=30
Sep 19 10:56:40.950213 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:40.950189    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"]
Sep 19 10:56:40.950684 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:40.950655    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x" podUID="5c964ba2-5f78-44d7-be36-d1e6dbce403b" containerName="payload-pre-processing" containerID="cri-o://6bfd2dab02546c134880cc13eccf4a137779d2042f9a5ea899c5b622f91d362a" gracePeriod=30
Sep 19 10:56:41.093210 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.093180    2563 generic.go:356] "Generic (PLEG): container finished" podID="5c964ba2-5f78-44d7-be36-d1e6dbce403b" containerID="6bfd2dab02546c134880cc13eccf4a137779d2042f9a5ea899c5b622f91d362a" exitCode=0
Sep 19 10:56:41.093411 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.093253    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x" event={"ID":"5c964ba2-5f78-44d7-be36-d1e6dbce403b","Type":"ContainerDied","Data":"6bfd2dab02546c134880cc13eccf4a137779d2042f9a5ea899c5b622f91d362a"}
Sep 19 10:56:41.095154 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.095127    2563 generic.go:356] "Generic (PLEG): container finished" podID="6ff8042b-6c88-4c50-a93c-ff9d198c93e8" containerID="40f5cc0c7362b2ef8dbd9ac7317d1f07b00f6aaf6f641879982d358e15db96d9" exitCode=0
Sep 19 10:56:41.095261 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.095245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn" event={"ID":"6ff8042b-6c88-4c50-a93c-ff9d198c93e8","Type":"ContainerDied","Data":"40f5cc0c7362b2ef8dbd9ac7317d1f07b00f6aaf6f641879982d358e15db96d9"}
Sep 19 10:56:41.156130 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.156073    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"]
Sep 19 10:56:41.159005 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.158982    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6a0d36-v24lt"]
Sep 19 10:56:41.274173 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.274149    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:56:41.282441 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.282360    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:56:41.401391 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.401356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2d55\" (UniqueName: \"kubernetes.io/projected/5c964ba2-5f78-44d7-be36-d1e6dbce403b-kube-api-access-d2d55\") pod \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\" (UID: \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\") "
Sep 19 10:56:41.401577 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.401443    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c964ba2-5f78-44d7-be36-d1e6dbce403b-plugins-config-volume\") pod \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\" (UID: \"5c964ba2-5f78-44d7-be36-d1e6dbce403b\") "
Sep 19 10:56:41.401577 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.401474    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v85zn\" (UniqueName: \"kubernetes.io/projected/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-kube-api-access-v85zn\") pod \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\" (UID: \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\") "
Sep 19 10:56:41.401577 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.401574    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-plugins-config-volume\") pod \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\" (UID: \"6ff8042b-6c88-4c50-a93c-ff9d198c93e8\") "
Sep 19 10:56:41.401922 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.401897    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c964ba2-5f78-44d7-be36-d1e6dbce403b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c964ba2-5f78-44d7-be36-d1e6dbce403b" (UID: "5c964ba2-5f78-44d7-be36-d1e6dbce403b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:41.402018 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.401990    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ff8042b-6c88-4c50-a93c-ff9d198c93e8" (UID: "6ff8042b-6c88-4c50-a93c-ff9d198c93e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:41.403486 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.403463    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c964ba2-5f78-44d7-be36-d1e6dbce403b-kube-api-access-d2d55" (OuterVolumeSpecName: "kube-api-access-d2d55") pod "5c964ba2-5f78-44d7-be36-d1e6dbce403b" (UID: "5c964ba2-5f78-44d7-be36-d1e6dbce403b"). InnerVolumeSpecName "kube-api-access-d2d55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:41.403660 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.403565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-kube-api-access-v85zn" (OuterVolumeSpecName: "kube-api-access-v85zn") pod "6ff8042b-6c88-4c50-a93c-ff9d198c93e8" (UID: "6ff8042b-6c88-4c50-a93c-ff9d198c93e8"). InnerVolumeSpecName "kube-api-access-v85zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:41.502603 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.502503    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:41.502603 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.502530    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2d55\" (UniqueName: \"kubernetes.io/projected/5c964ba2-5f78-44d7-be36-d1e6dbce403b-kube-api-access-d2d55\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:41.502603 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.502540    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c964ba2-5f78-44d7-be36-d1e6dbce403b-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:41.502603 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:41.502570    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v85zn\" (UniqueName: \"kubernetes.io/projected/6ff8042b-6c88-4c50-a93c-ff9d198c93e8-kube-api-access-v85zn\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:42.103501 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.103470    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"
Sep 19 10:56:42.103501 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.103491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x" event={"ID":"5c964ba2-5f78-44d7-be36-d1e6dbce403b","Type":"ContainerDied","Data":"e891d5146406299689681042ac07eecec1e8d14832c7987a1db9a47289068c6c"}
Sep 19 10:56:42.103997 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.103597    2563 scope.go:117] "RemoveContainer" containerID="6bfd2dab02546c134880cc13eccf4a137779d2042f9a5ea899c5b622f91d362a"
Sep 19 10:56:42.105039 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.104900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn" event={"ID":"6ff8042b-6c88-4c50-a93c-ff9d198c93e8","Type":"ContainerDied","Data":"c2ac533d6f6d41da8130147563635c2d9b0122a1a98594ccc0a74f4023669c00"}
Sep 19 10:56:42.105039 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.104919    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"
Sep 19 10:56:42.114147 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.114130    2563 scope.go:117] "RemoveContainer" containerID="40f5cc0c7362b2ef8dbd9ac7317d1f07b00f6aaf6f641879982d358e15db96d9"
Sep 19 10:56:42.120093 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.120071    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da31b72b-4d40-4d74-a0f8-de04d050a646" path="/var/lib/kubelet/pods/da31b72b-4d40-4d74-a0f8-de04d050a646/volumes"
Sep 19 10:56:42.130029 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.129989    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"]
Sep 19 10:56:42.132797 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.132776    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6a0d36-88855d6df-6s6kn"]
Sep 19 10:56:42.142060 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.142040    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"]
Sep 19 10:56:42.144330 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:42.144313    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6a0d36-58d7d6fd98-rmh5x"]
Sep 19 10:56:44.120038 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:44.119993    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c964ba2-5f78-44d7-be36-d1e6dbce403b" path="/var/lib/kubelet/pods/5c964ba2-5f78-44d7-be36-d1e6dbce403b/volumes"
Sep 19 10:56:44.120628 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:44.120606    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff8042b-6c88-4c50-a93c-ff9d198c93e8" path="/var/lib/kubelet/pods/6ff8042b-6c88-4c50-a93c-ff9d198c93e8/volumes"
Sep 19 10:56:48.068351 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068314    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"]
Sep 19 10:56:48.068817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068756    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff8042b-6c88-4c50-a93c-ff9d198c93e8" containerName="payload-processing"
Sep 19 10:56:48.068817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068768    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff8042b-6c88-4c50-a93c-ff9d198c93e8" containerName="payload-processing"
Sep 19 10:56:48.068817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068777    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da31b72b-4d40-4d74-a0f8-de04d050a646" containerName="revoke-keys"
Sep 19 10:56:48.068817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068783    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da31b72b-4d40-4d74-a0f8-de04d050a646" containerName="revoke-keys"
Sep 19 10:56:48.068817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068800    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c964ba2-5f78-44d7-be36-d1e6dbce403b" containerName="payload-pre-processing"
Sep 19 10:56:48.068817 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068806    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c964ba2-5f78-44d7-be36-d1e6dbce403b" containerName="payload-pre-processing"
Sep 19 10:56:48.069026 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068878    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c964ba2-5f78-44d7-be36-d1e6dbce403b" containerName="payload-pre-processing"
Sep 19 10:56:48.069026 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068885    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da31b72b-4d40-4d74-a0f8-de04d050a646" containerName="revoke-keys"
Sep 19 10:56:48.069026 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.068896    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff8042b-6c88-4c50-a93c-ff9d198c93e8" containerName="payload-processing"
Sep 19 10:56:48.073824 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.073806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"
Sep 19 10:56:48.076103 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.076078    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:56:48.076253 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.076078    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:56:48.078300 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.078280    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"]
Sep 19 10:56:48.170447 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.170409    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e984f0-2b33-42bf-8dd0-fe68a527c5d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc\" (UID: \"71e984f0-2b33-42bf-8dd0-fe68a527c5d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"
Sep 19 10:56:48.271798 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.271765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e984f0-2b33-42bf-8dd0-fe68a527c5d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc\" (UID: \"71e984f0-2b33-42bf-8dd0-fe68a527c5d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"
Sep 19 10:56:48.272396 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.272376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e984f0-2b33-42bf-8dd0-fe68a527c5d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc\" (UID: \"71e984f0-2b33-42bf-8dd0-fe68a527c5d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"
Sep 19 10:56:48.387280 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.387245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"
Sep 19 10:56:48.659458 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:48.659420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"]
Sep 19 10:56:48.661161 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:56:48.661138    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e984f0_2b33_42bf_8dd0_fe68a527c5d2.slice/crio-4da4c7da5e7f080c0fe47080d814c1e24bb619b6734643d525cdee4d86e0e254 WatchSource:0}: Error finding container 4da4c7da5e7f080c0fe47080d814c1e24bb619b6734643d525cdee4d86e0e254: Status 404 returned error can't find the container with id 4da4c7da5e7f080c0fe47080d814c1e24bb619b6734643d525cdee4d86e0e254
Sep 19 10:56:49.154075 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:49.154031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc" event={"ID":"71e984f0-2b33-42bf-8dd0-fe68a527c5d2","Type":"ContainerStarted","Data":"5406b1140dc3b8f82e2bfd8ca6fec3597295009bbef07df02859cb6a071a942c"}
Sep 19 10:56:49.154523 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:49.154094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc" event={"ID":"71e984f0-2b33-42bf-8dd0-fe68a527c5d2","Type":"ContainerStarted","Data":"4da4c7da5e7f080c0fe47080d814c1e24bb619b6734643d525cdee4d86e0e254"}
Sep 19 10:56:49.169789 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:49.169737    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc" podStartSLOduration=1.169718237 podStartE2EDuration="1.169718237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:56:49.168347469 +0000 UTC m=+1213.102053682" watchObservedRunningTime="2026-09-19 10:56:49.169718237 +0000 UTC m=+1213.103424451"
Sep 19 10:56:50.161805 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:50.161771    2563 generic.go:356] "Generic (PLEG): container finished" podID="71e984f0-2b33-42bf-8dd0-fe68a527c5d2" containerID="5406b1140dc3b8f82e2bfd8ca6fec3597295009bbef07df02859cb6a071a942c" exitCode=0
Sep 19 10:56:50.162191 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:50.161856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc" event={"ID":"71e984f0-2b33-42bf-8dd0-fe68a527c5d2","Type":"ContainerDied","Data":"5406b1140dc3b8f82e2bfd8ca6fec3597295009bbef07df02859cb6a071a942c"}
Sep 19 10:56:51.342483 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:51.342277    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"
Sep 19 10:56:51.514835 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:51.514747    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e984f0-2b33-42bf-8dd0-fe68a527c5d2-maas-api-service-ca\") pod \"71e984f0-2b33-42bf-8dd0-fe68a527c5d2\" (UID: \"71e984f0-2b33-42bf-8dd0-fe68a527c5d2\") "
Sep 19 10:56:51.515062 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:51.515040    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e984f0-2b33-42bf-8dd0-fe68a527c5d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "71e984f0-2b33-42bf-8dd0-fe68a527c5d2" (UID: "71e984f0-2b33-42bf-8dd0-fe68a527c5d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:51.615984 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:51.615944    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e984f0-2b33-42bf-8dd0-fe68a527c5d2-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:52.179287 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:52.179249    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"
Sep 19 10:56:52.179470 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:52.179298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc" event={"ID":"71e984f0-2b33-42bf-8dd0-fe68a527c5d2","Type":"ContainerDied","Data":"4da4c7da5e7f080c0fe47080d814c1e24bb619b6734643d525cdee4d86e0e254"}
Sep 19 10:56:52.179470 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:52.179353    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4da4c7da5e7f080c0fe47080d814c1e24bb619b6734643d525cdee4d86e0e254"
Sep 19 10:56:58.541835 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.541787    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"]
Sep 19 10:56:58.542298 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.542044    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld" podUID="dd1c5874-23e7-4b19-b3ed-668173e9589c" containerName="payload-processing" containerID="cri-o://4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7" gracePeriod=30
Sep 19 10:56:58.546504 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.546476    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"]
Sep 19 10:56:58.546945 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.546894    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx" podUID="9ff253a2-96a4-461f-8c9a-57945f45fb35" containerName="payload-pre-processing" containerID="cri-o://bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c" gracePeriod=30
Sep 19 10:56:58.650984 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:56:58.650950    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1c5874_23e7_4b19_b3ed_668173e9589c.slice/crio-conmon-4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7.scope\": RecentStats: unable to find data in memory cache]"
Sep 19 10:56:58.696833 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.696796    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"]
Sep 19 10:56:58.699460 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.699416    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-df95e5-zkblc"]
Sep 19 10:56:58.821971 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.821945    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:56:58.847974 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.847949    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:56:58.895465 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.895421    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1c5874-23e7-4b19-b3ed-668173e9589c-plugins-config-volume\") pod \"dd1c5874-23e7-4b19-b3ed-668173e9589c\" (UID: \"dd1c5874-23e7-4b19-b3ed-668173e9589c\") "
Sep 19 10:56:58.895701 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.895501    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl448\" (UniqueName: \"kubernetes.io/projected/9ff253a2-96a4-461f-8c9a-57945f45fb35-kube-api-access-rl448\") pod \"9ff253a2-96a4-461f-8c9a-57945f45fb35\" (UID: \"9ff253a2-96a4-461f-8c9a-57945f45fb35\") "
Sep 19 10:56:58.895701 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.895601    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn52l\" (UniqueName: \"kubernetes.io/projected/dd1c5874-23e7-4b19-b3ed-668173e9589c-kube-api-access-qn52l\") pod \"dd1c5874-23e7-4b19-b3ed-668173e9589c\" (UID: \"dd1c5874-23e7-4b19-b3ed-668173e9589c\") "
Sep 19 10:56:58.898280 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.895701    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ff253a2-96a4-461f-8c9a-57945f45fb35-plugins-config-volume\") pod \"9ff253a2-96a4-461f-8c9a-57945f45fb35\" (UID: \"9ff253a2-96a4-461f-8c9a-57945f45fb35\") "
Sep 19 10:56:58.898280 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.897529    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff253a2-96a4-461f-8c9a-57945f45fb35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ff253a2-96a4-461f-8c9a-57945f45fb35" (UID: "9ff253a2-96a4-461f-8c9a-57945f45fb35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:58.898280 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.898024    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1c5874-23e7-4b19-b3ed-668173e9589c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd1c5874-23e7-4b19-b3ed-668173e9589c" (UID: "dd1c5874-23e7-4b19-b3ed-668173e9589c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:58.905113 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.905051    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd1c5874-23e7-4b19-b3ed-668173e9589c-kube-api-access-qn52l" (OuterVolumeSpecName: "kube-api-access-qn52l") pod "dd1c5874-23e7-4b19-b3ed-668173e9589c" (UID: "dd1c5874-23e7-4b19-b3ed-668173e9589c"). InnerVolumeSpecName "kube-api-access-qn52l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:58.907807 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.907764    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff253a2-96a4-461f-8c9a-57945f45fb35-kube-api-access-rl448" (OuterVolumeSpecName: "kube-api-access-rl448") pod "9ff253a2-96a4-461f-8c9a-57945f45fb35" (UID: "9ff253a2-96a4-461f-8c9a-57945f45fb35"). InnerVolumeSpecName "kube-api-access-rl448". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:58.997415 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.997375    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ff253a2-96a4-461f-8c9a-57945f45fb35-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:58.997415 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.997406    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1c5874-23e7-4b19-b3ed-668173e9589c-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:58.997415 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.997417    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl448\" (UniqueName: \"kubernetes.io/projected/9ff253a2-96a4-461f-8c9a-57945f45fb35-kube-api-access-rl448\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:58.997415 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:58.997425    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn52l\" (UniqueName: \"kubernetes.io/projected/dd1c5874-23e7-4b19-b3ed-668173e9589c-kube-api-access-qn52l\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:56:59.224160 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.224124    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ff253a2-96a4-461f-8c9a-57945f45fb35" containerID="bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c" exitCode=0
Sep 19 10:56:59.224345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.224168    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"
Sep 19 10:56:59.224345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.224209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx" event={"ID":"9ff253a2-96a4-461f-8c9a-57945f45fb35","Type":"ContainerDied","Data":"bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c"}
Sep 19 10:56:59.224345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.224263    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx" event={"ID":"9ff253a2-96a4-461f-8c9a-57945f45fb35","Type":"ContainerDied","Data":"658c4876bb63f553e79bc57b1a5c3d7d241d38b15d4fbd909a81fac8c2bb79c5"}
Sep 19 10:56:59.224345 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.224287    2563 scope.go:117] "RemoveContainer" containerID="bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c"
Sep 19 10:56:59.225843 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.225818    2563 generic.go:356] "Generic (PLEG): container finished" podID="dd1c5874-23e7-4b19-b3ed-668173e9589c" containerID="4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7" exitCode=0
Sep 19 10:56:59.225977 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.225860    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"
Sep 19 10:56:59.225977 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.225900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld" event={"ID":"dd1c5874-23e7-4b19-b3ed-668173e9589c","Type":"ContainerDied","Data":"4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7"}
Sep 19 10:56:59.225977 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.225950    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld" event={"ID":"dd1c5874-23e7-4b19-b3ed-668173e9589c","Type":"ContainerDied","Data":"ef0faeb6be0581a20db5bbd4797facd4ad19e58c986315c7d07090b3406045bd"}
Sep 19 10:56:59.239162 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.239143    2563 scope.go:117] "RemoveContainer" containerID="bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c"
Sep 19 10:56:59.239480 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:56:59.239460    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c\": container with ID starting with bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c not found: ID does not exist" containerID="bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c"
Sep 19 10:56:59.239586 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.239487    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c"} err="failed to get container status \"bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c\": rpc error: code = NotFound desc = could not find container \"bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c\": container with ID starting with bd628be5e2f51a8c0822434c22f1116dcc9e195bf7e6b15aa21a21c5a517670c not found: ID does not exist"
Sep 19 10:56:59.239586 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.239508    2563 scope.go:117] "RemoveContainer" containerID="4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7"
Sep 19 10:56:59.248183 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.248039    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"]
Sep 19 10:56:59.249508 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.249487    2563 scope.go:117] "RemoveContainer" containerID="4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7"
Sep 19 10:56:59.249939 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:56:59.249920    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7\": container with ID starting with 4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7 not found: ID does not exist" containerID="4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7"
Sep 19 10:56:59.250020 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.249950    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7"} err="failed to get container status \"4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7\": rpc error: code = NotFound desc = could not find container \"4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7\": container with ID starting with 4a74f4a117c0f7dbf09bbda6b5ccf03b9076448b3f359fee6ed80984011f67a7 not found: ID does not exist"
Sep 19 10:56:59.251372 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.251352    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-df95e5-7787596fcd-4tklx"]
Sep 19 10:56:59.261655 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.261625    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"]
Sep 19 10:56:59.265130 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:56:59.265105    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df95e5-64779bd5f5-gpkld"]
Sep 19 10:57:00.118937 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:00.118907    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71e984f0-2b33-42bf-8dd0-fe68a527c5d2" path="/var/lib/kubelet/pods/71e984f0-2b33-42bf-8dd0-fe68a527c5d2/volumes"
Sep 19 10:57:00.119370 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:00.119328    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff253a2-96a4-461f-8c9a-57945f45fb35" path="/var/lib/kubelet/pods/9ff253a2-96a4-461f-8c9a-57945f45fb35/volumes"
Sep 19 10:57:00.119687 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:00.119672    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd1c5874-23e7-4b19-b3ed-668173e9589c" path="/var/lib/kubelet/pods/dd1c5874-23e7-4b19-b3ed-668173e9589c/volumes"
Sep 19 10:57:12.986429 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986396    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"]
Sep 19 10:57:12.986856 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986843    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e984f0-2b33-42bf-8dd0-fe68a527c5d2" containerName="revoke-keys"
Sep 19 10:57:12.986856 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986854    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e984f0-2b33-42bf-8dd0-fe68a527c5d2" containerName="revoke-keys"
Sep 19 10:57:12.986951 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986865    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff253a2-96a4-461f-8c9a-57945f45fb35" containerName="payload-pre-processing"
Sep 19 10:57:12.986951 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986871    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff253a2-96a4-461f-8c9a-57945f45fb35" containerName="payload-pre-processing"
Sep 19 10:57:12.986951 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986893    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd1c5874-23e7-4b19-b3ed-668173e9589c" containerName="payload-processing"
Sep 19 10:57:12.986951 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986900    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd1c5874-23e7-4b19-b3ed-668173e9589c" containerName="payload-processing"
Sep 19 10:57:12.987086 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986963    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff253a2-96a4-461f-8c9a-57945f45fb35" containerName="payload-pre-processing"
Sep 19 10:57:12.987086 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986970    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd1c5874-23e7-4b19-b3ed-668173e9589c" containerName="payload-processing"
Sep 19 10:57:12.987086 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.986977    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e984f0-2b33-42bf-8dd0-fe68a527c5d2" containerName="revoke-keys"
Sep 19 10:57:12.991652 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.991635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:12.994097 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.994075    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-137f88-dockercfg-rwdf2\""
Sep 19 10:57:12.994097 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.994089    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-137f88\""
Sep 19 10:57:12.999896 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:12.999742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"]
Sep 19 10:57:13.148238 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:13.148200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b67ef3-fcfc-4f57-b2b7-eae505b73071-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462\" (UID: \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:13.148412 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:13.148246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scbmc\" (UniqueName: \"kubernetes.io/projected/79b67ef3-fcfc-4f57-b2b7-eae505b73071-kube-api-access-scbmc\") pod \"payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462\" (UID: \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:13.250154 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:13.250042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b67ef3-fcfc-4f57-b2b7-eae505b73071-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462\" (UID: \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:13.250154 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:13.250117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scbmc\" (UniqueName: \"kubernetes.io/projected/79b67ef3-fcfc-4f57-b2b7-eae505b73071-kube-api-access-scbmc\") pod \"payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462\" (UID: \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:13.250672 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:13.250652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b67ef3-fcfc-4f57-b2b7-eae505b73071-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462\" (UID: \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:13.257417 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:13.257391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scbmc\" (UniqueName: \"kubernetes.io/projected/79b67ef3-fcfc-4f57-b2b7-eae505b73071-kube-api-access-scbmc\") pod \"payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462\" (UID: \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:13.304395 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:13.304367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:13.576645 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:13.576619    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"]
Sep 19 10:57:13.579027 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:57:13.579001    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b67ef3_fcfc_4f57_b2b7_eae505b73071.slice/crio-9cdb50a48419edd01380d8ae5d6ff24eabcaa1b3724f54e8f4ac0ae8b5e9da33 WatchSource:0}: Error finding container 9cdb50a48419edd01380d8ae5d6ff24eabcaa1b3724f54e8f4ac0ae8b5e9da33: Status 404 returned error can't find the container with id 9cdb50a48419edd01380d8ae5d6ff24eabcaa1b3724f54e8f4ac0ae8b5e9da33
Sep 19 10:57:14.324354 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:14.324314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462" event={"ID":"79b67ef3-fcfc-4f57-b2b7-eae505b73071","Type":"ContainerStarted","Data":"8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf"}
Sep 19 10:57:14.324877 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:14.324376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462" event={"ID":"79b67ef3-fcfc-4f57-b2b7-eae505b73071","Type":"ContainerStarted","Data":"9cdb50a48419edd01380d8ae5d6ff24eabcaa1b3724f54e8f4ac0ae8b5e9da33"}
Sep 19 10:57:14.324877 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:14.324456    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:14.339743 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:14.339691    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462" podStartSLOduration=2.3396734439999998 podStartE2EDuration="2.339673444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:57:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:57:14.33846845 +0000 UTC m=+1238.272174688" watchObservedRunningTime="2026-09-19 10:57:14.339673444 +0000 UTC m=+1238.273379711"
Sep 19 10:57:25.332771 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:25.332683    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 10:57:38.299880 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:38.299847    2563 scope.go:117] "RemoveContainer" containerID="432931f88d0d7a83ab3991a349b5988c475ed1ba01e7f4fbbc4d8a99db0a591b"
Sep 19 10:57:48.097187 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.097148    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"]
Sep 19 10:57:48.102563 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.102525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:57:48.105120 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.105101    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-9b3bef-dockercfg-f62k6\""
Sep 19 10:57:48.105256 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.105104    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-9b3bef\""
Sep 19 10:57:48.119674 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.119645    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"]
Sep 19 10:57:48.207167 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.207128    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8c96f84-ca8e-42c4-b7a1-be36ea215384-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv\" (UID: \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:57:48.207581 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.207538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnrrq\" (UniqueName: \"kubernetes.io/projected/b8c96f84-ca8e-42c4-b7a1-be36ea215384-kube-api-access-tnrrq\") pod \"payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv\" (UID: \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:57:48.308803 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.308754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnrrq\" (UniqueName: \"kubernetes.io/projected/b8c96f84-ca8e-42c4-b7a1-be36ea215384-kube-api-access-tnrrq\") pod \"payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv\" (UID: \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:57:48.309034 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.308879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8c96f84-ca8e-42c4-b7a1-be36ea215384-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv\" (UID: \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:57:48.309623 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.309604    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8c96f84-ca8e-42c4-b7a1-be36ea215384-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv\" (UID: \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:57:48.316084 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.316063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnrrq\" (UniqueName: \"kubernetes.io/projected/b8c96f84-ca8e-42c4-b7a1-be36ea215384-kube-api-access-tnrrq\") pod \"payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv\" (UID: \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:57:48.414823 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.414720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:57:48.476079 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.475354    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"]
Sep 19 10:57:48.496074 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.496042    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"]
Sep 19 10:57:48.496210 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.496134    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"
Sep 19 10:57:48.498748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.498607    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:57:48.498748 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.498630    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 10:57:48.612088 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.612057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16b6544-b45f-444d-91bb-a3d768a2042e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc\" (UID: \"d16b6544-b45f-444d-91bb-a3d768a2042e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"
Sep 19 10:57:48.697054 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.697021    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"]
Sep 19 10:57:48.698432 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:57:48.698406    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c96f84_ca8e_42c4_b7a1_be36ea215384.slice/crio-01f301079dbe114cea54481dd00cacfef05d2dbc9d9f15a4da2d0d709e73877b WatchSource:0}: Error finding container 01f301079dbe114cea54481dd00cacfef05d2dbc9d9f15a4da2d0d709e73877b: Status 404 returned error can't find the container with id 01f301079dbe114cea54481dd00cacfef05d2dbc9d9f15a4da2d0d709e73877b
Sep 19 10:57:48.712846 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.712817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16b6544-b45f-444d-91bb-a3d768a2042e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc\" (UID: \"d16b6544-b45f-444d-91bb-a3d768a2042e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"
Sep 19 10:57:48.713510 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.713491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16b6544-b45f-444d-91bb-a3d768a2042e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc\" (UID: \"d16b6544-b45f-444d-91bb-a3d768a2042e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"
Sep 19 10:57:48.810638 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:48.810602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"
Sep 19 10:57:49.083597 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:49.083563    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"]
Sep 19 10:57:49.084409 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:57:49.084385    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16b6544_b45f_444d_91bb_a3d768a2042e.slice/crio-b2f4ce8d1048f17ca106493db7f93cf4005cdad62d7f3a050bfc28d4917bbb07 WatchSource:0}: Error finding container b2f4ce8d1048f17ca106493db7f93cf4005cdad62d7f3a050bfc28d4917bbb07: Status 404 returned error can't find the container with id b2f4ce8d1048f17ca106493db7f93cf4005cdad62d7f3a050bfc28d4917bbb07
Sep 19 10:57:49.551873 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:49.551827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv" event={"ID":"b8c96f84-ca8e-42c4-b7a1-be36ea215384","Type":"ContainerStarted","Data":"0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b"}
Sep 19 10:57:49.552321 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:49.551904    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:57:49.552321 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:49.551926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv" event={"ID":"b8c96f84-ca8e-42c4-b7a1-be36ea215384","Type":"ContainerStarted","Data":"01f301079dbe114cea54481dd00cacfef05d2dbc9d9f15a4da2d0d709e73877b"}
Sep 19 10:57:49.553763 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:49.553729    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc" event={"ID":"d16b6544-b45f-444d-91bb-a3d768a2042e","Type":"ContainerStarted","Data":"e7772df6ef2e34fba3538f9b5e1e38a5ed6bc986a4b580ac2c1c9b9d306bb914"}
Sep 19 10:57:49.553897 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:49.553786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc" event={"ID":"d16b6544-b45f-444d-91bb-a3d768a2042e","Type":"ContainerStarted","Data":"b2f4ce8d1048f17ca106493db7f93cf4005cdad62d7f3a050bfc28d4917bbb07"}
Sep 19 10:57:49.569582 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:49.569511    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv" podStartSLOduration=1.5694966909999999 podStartE2EDuration="1.569496691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:57:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:57:49.565995673 +0000 UTC m=+1273.499701911" watchObservedRunningTime="2026-09-19 10:57:49.569496691 +0000 UTC m=+1273.503202910"
Sep 19 10:57:49.579329 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:49.579278    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc" podStartSLOduration=1.579260152 podStartE2EDuration="1.579260152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:57:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:57:49.578370021 +0000 UTC m=+1273.512076235" watchObservedRunningTime="2026-09-19 10:57:49.579260152 +0000 UTC m=+1273.512966366"
Sep 19 10:57:50.561804 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:50.561773    2563 generic.go:356] "Generic (PLEG): container finished" podID="d16b6544-b45f-444d-91bb-a3d768a2042e" containerID="e7772df6ef2e34fba3538f9b5e1e38a5ed6bc986a4b580ac2c1c9b9d306bb914" exitCode=0
Sep 19 10:57:50.562172 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:50.561854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc" event={"ID":"d16b6544-b45f-444d-91bb-a3d768a2042e","Type":"ContainerDied","Data":"e7772df6ef2e34fba3538f9b5e1e38a5ed6bc986a4b580ac2c1c9b9d306bb914"}
Sep 19 10:57:51.705692 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:51.705665    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"
Sep 19 10:57:51.848170 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:51.848129    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16b6544-b45f-444d-91bb-a3d768a2042e-maas-api-service-ca\") pod \"d16b6544-b45f-444d-91bb-a3d768a2042e\" (UID: \"d16b6544-b45f-444d-91bb-a3d768a2042e\") "
Sep 19 10:57:51.848472 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:51.848448    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16b6544-b45f-444d-91bb-a3d768a2042e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d16b6544-b45f-444d-91bb-a3d768a2042e" (UID: "d16b6544-b45f-444d-91bb-a3d768a2042e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:57:51.949458 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:51.949420    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16b6544-b45f-444d-91bb-a3d768a2042e-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:57:52.575067 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:52.575036    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"
Sep 19 10:57:52.575238 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:52.575072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc" event={"ID":"d16b6544-b45f-444d-91bb-a3d768a2042e","Type":"ContainerDied","Data":"b2f4ce8d1048f17ca106493db7f93cf4005cdad62d7f3a050bfc28d4917bbb07"}
Sep 19 10:57:52.575238 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:57:52.575126    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2f4ce8d1048f17ca106493db7f93cf4005cdad62d7f3a050bfc28d4917bbb07"
Sep 19 10:58:00.564599 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:00.564525    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 10:58:04.020063 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.020029    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"]
Sep 19 10:58:04.020576 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.020289    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc" podUID="536d4fce-81e2-457b-8d0e-5f382485b1b0" containerName="payload-processing" containerID="cri-o://848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7" gracePeriod=30
Sep 19 10:58:04.172134 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.172094    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"]
Sep 19 10:58:04.174730 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.174702    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9ebfd604-c29rc"]
Sep 19 10:58:04.310892 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.310863    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:58:04.370439 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.370401    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536d4fce-81e2-457b-8d0e-5f382485b1b0-plugins-config-volume\") pod \"536d4fce-81e2-457b-8d0e-5f382485b1b0\" (UID: \"536d4fce-81e2-457b-8d0e-5f382485b1b0\") "
Sep 19 10:58:04.370679 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.370471    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj7xm\" (UniqueName: \"kubernetes.io/projected/536d4fce-81e2-457b-8d0e-5f382485b1b0-kube-api-access-rj7xm\") pod \"536d4fce-81e2-457b-8d0e-5f382485b1b0\" (UID: \"536d4fce-81e2-457b-8d0e-5f382485b1b0\") "
Sep 19 10:58:04.370896 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.370868    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/536d4fce-81e2-457b-8d0e-5f382485b1b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "536d4fce-81e2-457b-8d0e-5f382485b1b0" (UID: "536d4fce-81e2-457b-8d0e-5f382485b1b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:58:04.372776 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.372750    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/536d4fce-81e2-457b-8d0e-5f382485b1b0-kube-api-access-rj7xm" (OuterVolumeSpecName: "kube-api-access-rj7xm") pod "536d4fce-81e2-457b-8d0e-5f382485b1b0" (UID: "536d4fce-81e2-457b-8d0e-5f382485b1b0"). InnerVolumeSpecName "kube-api-access-rj7xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:58:04.472289 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.472252    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536d4fce-81e2-457b-8d0e-5f382485b1b0-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:58:04.472289 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.472285    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj7xm\" (UniqueName: \"kubernetes.io/projected/536d4fce-81e2-457b-8d0e-5f382485b1b0-kube-api-access-rj7xm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:58:04.655948 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.655914    2563 generic.go:356] "Generic (PLEG): container finished" podID="536d4fce-81e2-457b-8d0e-5f382485b1b0" containerID="848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7" exitCode=0
Sep 19 10:58:04.656135 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.655960    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"
Sep 19 10:58:04.656135 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.655985    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc" event={"ID":"536d4fce-81e2-457b-8d0e-5f382485b1b0","Type":"ContainerDied","Data":"848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7"}
Sep 19 10:58:04.656135 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.656027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc" event={"ID":"536d4fce-81e2-457b-8d0e-5f382485b1b0","Type":"ContainerDied","Data":"0ba4238a5876af5c84124f99287635d970709fb287599df3f4a22abdf6118f8f"}
Sep 19 10:58:04.656135 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.656048    2563 scope.go:117] "RemoveContainer" containerID="848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7"
Sep 19 10:58:04.666496 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.666476    2563 scope.go:117] "RemoveContainer" containerID="848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7"
Sep 19 10:58:04.666841 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:58:04.666819    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7\": container with ID starting with 848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7 not found: ID does not exist" containerID="848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7"
Sep 19 10:58:04.666909 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.666852    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7"} err="failed to get container status \"848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7\": rpc error: code = NotFound desc = could not find container \"848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7\": container with ID starting with 848eadffafbd8c8dab863d9fe9ae164af994340cbc666e5b7fd6c7db9f744fe7 not found: ID does not exist"
Sep 19 10:58:04.683895 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.683830    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"]
Sep 19 10:58:04.687205 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:04.687171    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9ebfd604-7dc864bdf-dl4xc"]
Sep 19 10:58:06.118981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:06.118951    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="536d4fce-81e2-457b-8d0e-5f382485b1b0" path="/var/lib/kubelet/pods/536d4fce-81e2-457b-8d0e-5f382485b1b0/volumes"
Sep 19 10:58:06.119365 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:06.119294    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d16b6544-b45f-444d-91bb-a3d768a2042e" path="/var/lib/kubelet/pods/d16b6544-b45f-444d-91bb-a3d768a2042e/volumes"
Sep 19 10:58:38.339148 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:58:38.339113    2563 scope.go:117] "RemoveContainer" containerID="b5480f5c2a6a611a923286b5388b9132f3804ce00d43cc0bc463c1cdd84dbb08"
Sep 19 10:59:05.702184 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.702108    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"]
Sep 19 10:59:05.702661 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.702534    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536d4fce-81e2-457b-8d0e-5f382485b1b0" containerName="payload-processing"
Sep 19 10:59:05.702661 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.702558    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="536d4fce-81e2-457b-8d0e-5f382485b1b0" containerName="payload-processing"
Sep 19 10:59:05.702661 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.702582    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16b6544-b45f-444d-91bb-a3d768a2042e" containerName="revoke-keys"
Sep 19 10:59:05.702661 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.702587    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16b6544-b45f-444d-91bb-a3d768a2042e" containerName="revoke-keys"
Sep 19 10:59:05.702661 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.702656    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d16b6544-b45f-444d-91bb-a3d768a2042e" containerName="revoke-keys"
Sep 19 10:59:05.702836 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.702666    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="536d4fce-81e2-457b-8d0e-5f382485b1b0" containerName="payload-processing"
Sep 19 10:59:05.705889 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.705860    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.708080 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.708057    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5116ec\"/\"distinct-2-w4-5116ec-kserve-self-signed-certs\""
Sep 19 10:59:05.713180 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.713153    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"]
Sep 19 10:59:05.804812 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.804771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-model-cache\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.805013 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.804848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-tmp-dir\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.805013 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.804913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-dshm\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.805123 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.805015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db6d2215-48f0-464a-9d9a-c2530589cffd-tls-certs\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.805123 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.805042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-home\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.805123 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.805096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qdl2\" (UniqueName: \"kubernetes.io/projected/db6d2215-48f0-464a-9d9a-c2530589cffd-kube-api-access-7qdl2\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.905704 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.905670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db6d2215-48f0-464a-9d9a-c2530589cffd-tls-certs\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.905704 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.905710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-home\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.905918 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.905760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qdl2\" (UniqueName: \"kubernetes.io/projected/db6d2215-48f0-464a-9d9a-c2530589cffd-kube-api-access-7qdl2\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.905918 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.905804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-model-cache\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.905918 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.905829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-tmp-dir\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.906069 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.906037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-dshm\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.906213 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.906193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-home\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.906257 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.906231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-tmp-dir\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.906296 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.906255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-model-cache\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.908209 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.908176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-dshm\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.908497 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.908474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db6d2215-48f0-464a-9d9a-c2530589cffd-tls-certs\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:05.918431 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:05.914012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qdl2\" (UniqueName: \"kubernetes.io/projected/db6d2215-48f0-464a-9d9a-c2530589cffd-kube-api-access-7qdl2\") pod \"distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") " pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:06.016509 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:06.016413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:06.290164 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:06.290131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"]
Sep 19 10:59:06.291234 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:59:06.291210    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb6d2215_48f0_464a_9d9a_c2530589cffd.slice/crio-89cc324cf1874a0154905fc41a6260d38269687a1b5c66feb01af0b6d5e77111 WatchSource:0}: Error finding container 89cc324cf1874a0154905fc41a6260d38269687a1b5c66feb01af0b6d5e77111: Status 404 returned error can't find the container with id 89cc324cf1874a0154905fc41a6260d38269687a1b5c66feb01af0b6d5e77111
Sep 19 10:59:07.063539 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:07.063505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4" event={"ID":"db6d2215-48f0-464a-9d9a-c2530589cffd","Type":"ContainerStarted","Data":"b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2"}
Sep 19 10:59:07.063539 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:07.063569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4" event={"ID":"db6d2215-48f0-464a-9d9a-c2530589cffd","Type":"ContainerStarted","Data":"89cc324cf1874a0154905fc41a6260d38269687a1b5c66feb01af0b6d5e77111"}
Sep 19 10:59:07.080420 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:07.080365    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4" podStartSLOduration=2.080349118 podStartE2EDuration="2.080349118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:59:07.079380727 +0000 UTC m=+1351.013086941" watchObservedRunningTime="2026-09-19 10:59:07.080349118 +0000 UTC m=+1351.014055332"
Sep 19 10:59:09.286797 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:09.286763    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"]
Sep 19 10:59:09.287332 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:09.287054    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy" containerID="cri-o://7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2" gracePeriod=30
Sep 19 10:59:14.542312 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.542286    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:59:14.592391 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592351    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-envoy\") pod \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") "
Sep 19 10:59:14.592391 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-data\") pod \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") "
Sep 19 10:59:14.592685 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592444    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwdsl\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-kube-api-access-kwdsl\") pod \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") "
Sep 19 10:59:14.592685 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592471    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istiod-ca-cert\") pod \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") "
Sep 19 10:59:14.592685 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592495    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-podinfo\") pod \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") "
Sep 19 10:59:14.592685 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592626    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-certs\") pod \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") "
Sep 19 10:59:14.592685 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592680    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-credential-socket\") pod \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") "
Sep 19 10:59:14.592947 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592713    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-token\") pod \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") "
Sep 19 10:59:14.592947 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592778    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-socket\") pod \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\" (UID: \"ec0b312a-130e-4dc1-8637-0d3d2572eee7\") "
Sep 19 10:59:14.592947 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592912    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec0b312a-130e-4dc1-8637-0d3d2572eee7" (UID: "ec0b312a-130e-4dc1-8637-0d3d2572eee7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:14.592947 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.592931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec0b312a-130e-4dc1-8637-0d3d2572eee7" (UID: "ec0b312a-130e-4dc1-8637-0d3d2572eee7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:14.593170 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.593083    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec0b312a-130e-4dc1-8637-0d3d2572eee7" (UID: "ec0b312a-130e-4dc1-8637-0d3d2572eee7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:14.593235 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.593183    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec0b312a-130e-4dc1-8637-0d3d2572eee7" (UID: "ec0b312a-130e-4dc1-8637-0d3d2572eee7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:14.593329 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.593304    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:59:14.593329 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.593325    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:59:14.593434 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.593338    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:59:14.593434 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.593351    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:59:14.593607 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.593535    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec0b312a-130e-4dc1-8637-0d3d2572eee7" (UID: "ec0b312a-130e-4dc1-8637-0d3d2572eee7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:59:14.594902 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.594871    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec0b312a-130e-4dc1-8637-0d3d2572eee7" (UID: "ec0b312a-130e-4dc1-8637-0d3d2572eee7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 10:59:14.595080 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.595060    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec0b312a-130e-4dc1-8637-0d3d2572eee7" (UID: "ec0b312a-130e-4dc1-8637-0d3d2572eee7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:59:14.595163 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.595094    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec0b312a-130e-4dc1-8637-0d3d2572eee7" (UID: "ec0b312a-130e-4dc1-8637-0d3d2572eee7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:14.595339 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.595319    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-kube-api-access-kwdsl" (OuterVolumeSpecName: "kube-api-access-kwdsl") pod "ec0b312a-130e-4dc1-8637-0d3d2572eee7" (UID: "ec0b312a-130e-4dc1-8637-0d3d2572eee7"). InnerVolumeSpecName "kube-api-access-kwdsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:59:14.694255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.694217    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:59:14.694255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.694248    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwdsl\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-kube-api-access-kwdsl\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:59:14.694255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.694258    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:59:14.694255 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.694266    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:59:14.694534 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:14.694273    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec0b312a-130e-4dc1-8637-0d3d2572eee7-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 10:59:15.117607 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.117541    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerID="7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2" exitCode=0
Sep 19 10:59:15.117607 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.117604    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"
Sep 19 10:59:15.117883 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.117633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" event={"ID":"ec0b312a-130e-4dc1-8637-0d3d2572eee7","Type":"ContainerDied","Data":"7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2"}
Sep 19 10:59:15.117883 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.117694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5" event={"ID":"ec0b312a-130e-4dc1-8637-0d3d2572eee7","Type":"ContainerDied","Data":"f4f69f0d25babb35ee6a91ccbf573c76320a119cfc78a93ac3fc9b7761f8a246"}
Sep 19 10:59:15.117883 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.117750    2563 scope.go:117] "RemoveContainer" containerID="7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2"
Sep 19 10:59:15.128295 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.128275    2563 scope.go:117] "RemoveContainer" containerID="909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d"
Sep 19 10:59:15.138920 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.138898    2563 scope.go:117] "RemoveContainer" containerID="7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2"
Sep 19 10:59:15.139276 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:59:15.139255    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2\": container with ID starting with 7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2 not found: ID does not exist" containerID="7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2"
Sep 19 10:59:15.139357 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.139285    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2"} err="failed to get container status \"7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2\": rpc error: code = NotFound desc = could not find container \"7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2\": container with ID starting with 7810cc8bba554163282927e270a61832e7cf8bbcb3ece7cc10628489ce7979c2 not found: ID does not exist"
Sep 19 10:59:15.139357 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.139307    2563 scope.go:117] "RemoveContainer" containerID="909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d"
Sep 19 10:59:15.139592 ip-10-0-138-7 kubenswrapper[2563]: E0919 10:59:15.139579    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d\": container with ID starting with 909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d not found: ID does not exist" containerID="909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d"
Sep 19 10:59:15.139642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.139596    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d"} err="failed to get container status \"909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d\": rpc error: code = NotFound desc = could not find container \"909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d\": container with ID starting with 909e0de48a24e5ea248f5525f158e55cae268db2525a0d4df6299b68fec47d5d not found: ID does not exist"
Sep 19 10:59:15.141216 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.141189    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"]
Sep 19 10:59:15.143971 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:15.143950    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9ebfd604-openshift-default-5d6cdcc888-k2dr5"]
Sep 19 10:59:16.017189 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:16.017149    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:16.017613 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:16.017205    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:16.030739 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:16.030709    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:16.119838 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:16.119805    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" path="/var/lib/kubelet/pods/ec0b312a-130e-4dc1-8637-0d3d2572eee7/volumes"
Sep 19 10:59:16.138705 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:16.138672    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 10:59:18.400306 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.400268    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"]
Sep 19 10:59:18.400756 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.400740    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy"
Sep 19 10:59:18.400801 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.400758    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy"
Sep 19 10:59:18.400854 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.400845    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy"
Sep 19 10:59:18.400891 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.400856    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy"
Sep 19 10:59:18.405502 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.405483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.407642 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.407623    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-9b3bef\"/\"openshift-service-ca.crt\""
Sep 19 10:59:18.407751 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.407676    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-9b3bef\"/\"kube-root-ca.crt\""
Sep 19 10:59:18.408536 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.408518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-9b3bef\"/\"default-dockercfg-z6csr\""
Sep 19 10:59:18.408643 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.408560    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-9b3bef\"/\"auth-test-model-9b3bef-kserve-self-signed-certs\""
Sep 19 10:59:18.413979 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.413961    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"]
Sep 19 10:59:18.430717 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.430691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-dshm\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.430904 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.430805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfgnk\" (UniqueName: \"kubernetes.io/projected/4ad40556-a176-4e8b-82d5-ace52fa53bab-kube-api-access-xfgnk\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.430904 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.430869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-model-cache\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.430904 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.430896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-tmp-dir\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.431076 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.430979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-home\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.431076 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.431015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad40556-a176-4e8b-82d5-ace52fa53bab-tls-certs\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.532334 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.532304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-home\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.532478 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.532342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad40556-a176-4e8b-82d5-ace52fa53bab-tls-certs\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.532478 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.532472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-dshm\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.532608 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.532593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfgnk\" (UniqueName: \"kubernetes.io/projected/4ad40556-a176-4e8b-82d5-ace52fa53bab-kube-api-access-xfgnk\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.532716 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.532644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-model-cache\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.532716 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.532674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-tmp-dir\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.532815 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.532755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-home\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.532985 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.532955    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-model-cache\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.533092 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.533043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-tmp-dir\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.534726 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.534701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-dshm\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.534981 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.534964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad40556-a176-4e8b-82d5-ace52fa53bab-tls-certs\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.539661 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.539641    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfgnk\" (UniqueName: \"kubernetes.io/projected/4ad40556-a176-4e8b-82d5-ace52fa53bab-kube-api-access-xfgnk\") pod \"auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.716126 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.716030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:18.995313 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:18.995283    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"]
Sep 19 10:59:18.997640 ip-10-0-138-7 kubenswrapper[2563]: W0919 10:59:18.997615    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ad40556_a176_4e8b_82d5_ace52fa53bab.slice/crio-348c62ad469497b1c7e7ca8e71306c5937c5ace2312af1c4c5f2c4dc33eaa0b0 WatchSource:0}: Error finding container 348c62ad469497b1c7e7ca8e71306c5937c5ace2312af1c4c5f2c4dc33eaa0b0: Status 404 returned error can't find the container with id 348c62ad469497b1c7e7ca8e71306c5937c5ace2312af1c4c5f2c4dc33eaa0b0
Sep 19 10:59:19.145086 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:19.145050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6" event={"ID":"4ad40556-a176-4e8b-82d5-ace52fa53bab","Type":"ContainerStarted","Data":"c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3"}
Sep 19 10:59:19.145236 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:19.145102    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6" event={"ID":"4ad40556-a176-4e8b-82d5-ace52fa53bab","Type":"ContainerStarted","Data":"348c62ad469497b1c7e7ca8e71306c5937c5ace2312af1c4c5f2c4dc33eaa0b0"}
Sep 19 10:59:19.164408 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:19.164347    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6" podStartSLOduration=1.164327665 podStartE2EDuration="1.164327665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:59:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:59:19.16114218 +0000 UTC m=+1363.094848393" watchObservedRunningTime="2026-09-19 10:59:19.164327665 +0000 UTC m=+1363.098033888"
Sep 19 10:59:28.716745 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:28.716711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:28.717343 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:28.716770    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:28.729480 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:28.729454    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:29.217264 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:29.217236    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 10:59:38.366193 ip-10-0-138-7 kubenswrapper[2563]: I0919 10:59:38.366161    2563 scope.go:117] "RemoveContainer" containerID="f8e3f0ab5e18609554458d000bb5aa9cf00b1f4911126f2952cbb237173a881d"
Sep 19 11:00:00.139013 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.138967    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6"]
Sep 19 11:00:00.139573 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.139491    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy"
Sep 19 11:00:00.139573 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.139508    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0b312a-130e-4dc1-8637-0d3d2572eee7" containerName="istio-proxy"
Sep 19 11:00:00.142504 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.142486    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn"]
Sep 19 11:00:00.142667 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.142644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6"
Sep 19 11:00:00.144709 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.144688    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:00:00.146036 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.146011    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x"]
Sep 19 11:00:00.146212 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.146195    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn"
Sep 19 11:00:00.150578 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.149781    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x"
Sep 19 11:00:00.151037 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.151008    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn"]
Sep 19 11:00:00.155361 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.155332    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6"]
Sep 19 11:00:00.159805 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.159782    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6"
Sep 19 11:00:00.162194 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.162161    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64"]
Sep 19 11:00:00.180637 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.180605    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64"
Sep 19 11:00:00.187033 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.187003    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn"
Sep 19 11:00:00.188888 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.188864    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x"]
Sep 19 11:00:00.193110 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.193086    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64"]
Sep 19 11:00:00.222906 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.222874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x"
Sep 19 11:00:00.229339 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.229314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64"
Sep 19 11:00:00.463038 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.463014    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6"]
Sep 19 11:00:00.464334 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:00:00.464308    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35972e9_5885_48b7_b2d3_27a7c335557f.slice/crio-05929b098d8724ae5a60f23e9f4c990bd919ab5471ee0c33018a945a6d10844c WatchSource:0}: Error finding container 05929b098d8724ae5a60f23e9f4c990bd919ab5471ee0c33018a945a6d10844c: Status 404 returned error can't find the container with id 05929b098d8724ae5a60f23e9f4c990bd919ab5471ee0c33018a945a6d10844c
Sep 19 11:00:00.473431 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.473405    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn"]
Sep 19 11:00:00.477451 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:00:00.477425    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaac7882_7be5_443f_b514_eeb42bf57213.slice/crio-c05ac8db77b4ae4182ce0b1b9df90a9211e20f38147850e2e1eecddfd89ab3eb WatchSource:0}: Error finding container c05ac8db77b4ae4182ce0b1b9df90a9211e20f38147850e2e1eecddfd89ab3eb: Status 404 returned error can't find the container with id c05ac8db77b4ae4182ce0b1b9df90a9211e20f38147850e2e1eecddfd89ab3eb
Sep 19 11:00:00.535173 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.535146    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x"]
Sep 19 11:00:00.536125 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:00:00.536104    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6968b1d0_4931_471f_b57d_86183d20830e.slice/crio-644cb40297c635d4c7fb7739d2b6d1db7c8f89959d49e30453515064663a38ce WatchSource:0}: Error finding container 644cb40297c635d4c7fb7739d2b6d1db7c8f89959d49e30453515064663a38ce: Status 404 returned error can't find the container with id 644cb40297c635d4c7fb7739d2b6d1db7c8f89959d49e30453515064663a38ce
Sep 19 11:00:00.545051 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:00.545027    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64"]
Sep 19 11:00:00.550215 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:00:00.550191    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d03f4b0_41f8_464e_85a7_08f61a7ffd2b.slice/crio-915662fcca1721b9eac101d2e2b0d2792ebf6f18b6f63b27cd407fddb159c6dd WatchSource:0}: Error finding container 915662fcca1721b9eac101d2e2b0d2792ebf6f18b6f63b27cd407fddb159c6dd: Status 404 returned error can't find the container with id 915662fcca1721b9eac101d2e2b0d2792ebf6f18b6f63b27cd407fddb159c6dd
Sep 19 11:00:01.409209 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.409173    2563 generic.go:356] "Generic (PLEG): container finished" podID="c35972e9-5885-48b7-b2d3-27a7c335557f" containerID="ab9d86b757808f1b2024e05874711e639fbbd6806d85943a7caf43bcdd90ac2b" exitCode=0
Sep 19 11:00:01.409614 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.409231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6" event={"ID":"c35972e9-5885-48b7-b2d3-27a7c335557f","Type":"ContainerDied","Data":"ab9d86b757808f1b2024e05874711e639fbbd6806d85943a7caf43bcdd90ac2b"}
Sep 19 11:00:01.409614 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.409287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6" event={"ID":"c35972e9-5885-48b7-b2d3-27a7c335557f","Type":"ContainerStarted","Data":"05929b098d8724ae5a60f23e9f4c990bd919ab5471ee0c33018a945a6d10844c"}
Sep 19 11:00:01.410866 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.410843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn" event={"ID":"daac7882-7be5-443f-b514-eeb42bf57213","Type":"ContainerStarted","Data":"fbc36ead163c857af68f27eab49e2ea694bcf6a0c80bb13dfb3b0e809d628bc6"}
Sep 19 11:00:01.410991 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.410886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn" event={"ID":"daac7882-7be5-443f-b514-eeb42bf57213","Type":"ContainerStarted","Data":"c05ac8db77b4ae4182ce0b1b9df90a9211e20f38147850e2e1eecddfd89ab3eb"}
Sep 19 11:00:01.412526 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.412501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x" event={"ID":"6968b1d0-4931-471f-b57d-86183d20830e","Type":"ContainerStarted","Data":"375c6b89221ac7431664df7cedab5590467dc3e2e8d972d668ec16d22486fbc7"}
Sep 19 11:00:01.412674 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.412540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x" event={"ID":"6968b1d0-4931-471f-b57d-86183d20830e","Type":"ContainerStarted","Data":"644cb40297c635d4c7fb7739d2b6d1db7c8f89959d49e30453515064663a38ce"}
Sep 19 11:00:01.414231 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.414209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64" event={"ID":"2d03f4b0-41f8-464e-85a7-08f61a7ffd2b","Type":"ContainerStarted","Data":"e23f5a36767dd4136542a31c7481d151809816df52f24c721e0b1d89d095ebeb"}
Sep 19 11:00:01.414305 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.414253    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64" event={"ID":"2d03f4b0-41f8-464e-85a7-08f61a7ffd2b","Type":"ContainerStarted","Data":"915662fcca1721b9eac101d2e2b0d2792ebf6f18b6f63b27cd407fddb159c6dd"}
Sep 19 11:00:01.434642 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.434432    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64" podStartSLOduration=1.434411422 podStartE2EDuration="1.434411422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:00:01.433753206 +0000 UTC m=+1405.367459439" watchObservedRunningTime="2026-09-19 11:00:01.434411422 +0000 UTC m=+1405.368117638"
Sep 19 11:00:01.448366 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.448307    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn" podStartSLOduration=1.448290658 podStartE2EDuration="1.448290658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:00:01.446161738 +0000 UTC m=+1405.379867977" watchObservedRunningTime="2026-09-19 11:00:01.448290658 +0000 UTC m=+1405.381996902"
Sep 19 11:00:01.459421 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:01.459369    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x" podStartSLOduration=1.459355068 podStartE2EDuration="1.459355068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:00:01.458055704 +0000 UTC m=+1405.391762023" watchObservedRunningTime="2026-09-19 11:00:01.459355068 +0000 UTC m=+1405.393061277"
Sep 19 11:00:02.422836 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:02.422802    2563 generic.go:356] "Generic (PLEG): container finished" podID="6968b1d0-4931-471f-b57d-86183d20830e" containerID="375c6b89221ac7431664df7cedab5590467dc3e2e8d972d668ec16d22486fbc7" exitCode=0
Sep 19 11:00:02.423275 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:02.422890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x" event={"ID":"6968b1d0-4931-471f-b57d-86183d20830e","Type":"ContainerDied","Data":"375c6b89221ac7431664df7cedab5590467dc3e2e8d972d668ec16d22486fbc7"}
Sep 19 11:00:02.424541 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:02.424519    2563 generic.go:356] "Generic (PLEG): container finished" podID="2d03f4b0-41f8-464e-85a7-08f61a7ffd2b" containerID="e23f5a36767dd4136542a31c7481d151809816df52f24c721e0b1d89d095ebeb" exitCode=0
Sep 19 11:00:02.424678 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:02.424591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64" event={"ID":"2d03f4b0-41f8-464e-85a7-08f61a7ffd2b","Type":"ContainerDied","Data":"e23f5a36767dd4136542a31c7481d151809816df52f24c721e0b1d89d095ebeb"}
Sep 19 11:00:02.426248 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:02.426223    2563 generic.go:356] "Generic (PLEG): container finished" podID="daac7882-7be5-443f-b514-eeb42bf57213" containerID="fbc36ead163c857af68f27eab49e2ea694bcf6a0c80bb13dfb3b0e809d628bc6" exitCode=0
Sep 19 11:00:02.426369 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:02.426307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn" event={"ID":"daac7882-7be5-443f-b514-eeb42bf57213","Type":"ContainerDied","Data":"fbc36ead163c857af68f27eab49e2ea694bcf6a0c80bb13dfb3b0e809d628bc6"}
Sep 19 11:00:02.584944 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:02.584916    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6"
Sep 19 11:00:03.433308 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:03.433278    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6"
Sep 19 11:00:03.433752 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:03.433333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6" event={"ID":"c35972e9-5885-48b7-b2d3-27a7c335557f","Type":"ContainerDied","Data":"05929b098d8724ae5a60f23e9f4c990bd919ab5471ee0c33018a945a6d10844c"}
Sep 19 11:00:03.433752 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:03.433380    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05929b098d8724ae5a60f23e9f4c990bd919ab5471ee0c33018a945a6d10844c"
Sep 19 11:00:03.594037 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:03.594008    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn"
Sep 19 11:00:03.644993 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:03.644963    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64"
Sep 19 11:00:03.648018 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:03.647999    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x"
Sep 19 11:00:04.441429 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:04.441341    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x"
Sep 19 11:00:04.441429 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:04.441354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x" event={"ID":"6968b1d0-4931-471f-b57d-86183d20830e","Type":"ContainerDied","Data":"644cb40297c635d4c7fb7739d2b6d1db7c8f89959d49e30453515064663a38ce"}
Sep 19 11:00:04.441429 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:04.441403    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="644cb40297c635d4c7fb7739d2b6d1db7c8f89959d49e30453515064663a38ce"
Sep 19 11:00:04.442842 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:04.442819    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64"
Sep 19 11:00:04.442955 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:04.442856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64" event={"ID":"2d03f4b0-41f8-464e-85a7-08f61a7ffd2b","Type":"ContainerDied","Data":"915662fcca1721b9eac101d2e2b0d2792ebf6f18b6f63b27cd407fddb159c6dd"}
Sep 19 11:00:04.442955 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:04.442906    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="915662fcca1721b9eac101d2e2b0d2792ebf6f18b6f63b27cd407fddb159c6dd"
Sep 19 11:00:04.444407 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:04.444386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn" event={"ID":"daac7882-7be5-443f-b514-eeb42bf57213","Type":"ContainerDied","Data":"c05ac8db77b4ae4182ce0b1b9df90a9211e20f38147850e2e1eecddfd89ab3eb"}
Sep 19 11:00:04.444515 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:04.444415    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn"
Sep 19 11:00:04.444515 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:04.444424    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c05ac8db77b4ae4182ce0b1b9df90a9211e20f38147850e2e1eecddfd89ab3eb"
Sep 19 11:00:10.686445 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686411    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"]
Sep 19 11:00:10.686921 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686859    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35972e9-5885-48b7-b2d3-27a7c335557f" containerName="cleanup"
Sep 19 11:00:10.686921 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686871    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35972e9-5885-48b7-b2d3-27a7c335557f" containerName="cleanup"
Sep 19 11:00:10.686921 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686884    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daac7882-7be5-443f-b514-eeb42bf57213" containerName="cleanup"
Sep 19 11:00:10.686921 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686890    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daac7882-7be5-443f-b514-eeb42bf57213" containerName="cleanup"
Sep 19 11:00:10.686921 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686896    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d03f4b0-41f8-464e-85a7-08f61a7ffd2b" containerName="cleanup"
Sep 19 11:00:10.686921 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686902    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d03f4b0-41f8-464e-85a7-08f61a7ffd2b" containerName="cleanup"
Sep 19 11:00:10.686921 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686910    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6968b1d0-4931-471f-b57d-86183d20830e" containerName="cleanup"
Sep 19 11:00:10.686921 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686915    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6968b1d0-4931-471f-b57d-86183d20830e" containerName="cleanup"
Sep 19 11:00:10.687175 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.686991    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6968b1d0-4931-471f-b57d-86183d20830e" containerName="cleanup"
Sep 19 11:00:10.687175 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.687000    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d03f4b0-41f8-464e-85a7-08f61a7ffd2b" containerName="cleanup"
Sep 19 11:00:10.687175 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.687009    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35972e9-5885-48b7-b2d3-27a7c335557f" containerName="cleanup"
Sep 19 11:00:10.687175 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.687015    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="daac7882-7be5-443f-b514-eeb42bf57213" containerName="cleanup"
Sep 19 11:00:10.690174 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.690154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:10.692481 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.692459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-000aa3-dockercfg-99qrs\""
Sep 19 11:00:10.692481 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.692477    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-000aa3\""
Sep 19 11:00:10.700843 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.700735    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"]
Sep 19 11:00:10.728033 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.728000    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"]
Sep 19 11:00:10.731741 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.731724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:10.740596 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.740573    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"]
Sep 19 11:00:10.777785 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.777700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088edb16-d600-4472-8c76-297d4c9a17a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7\" (UID: \"088edb16-d600-4472-8c76-297d4c9a17a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:10.778067 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.777829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7k8c\" (UniqueName: \"kubernetes.io/projected/088edb16-d600-4472-8c76-297d4c9a17a3-kube-api-access-x7k8c\") pod \"payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7\" (UID: \"088edb16-d600-4472-8c76-297d4c9a17a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:10.879063 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.879025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8lfd\" (UniqueName: \"kubernetes.io/projected/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-kube-api-access-s8lfd\") pod \"payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7\" (UID: \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\") " pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:10.879237 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.879107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088edb16-d600-4472-8c76-297d4c9a17a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7\" (UID: \"088edb16-d600-4472-8c76-297d4c9a17a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:10.879237 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.879130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7k8c\" (UniqueName: \"kubernetes.io/projected/088edb16-d600-4472-8c76-297d4c9a17a3-kube-api-access-x7k8c\") pod \"payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7\" (UID: \"088edb16-d600-4472-8c76-297d4c9a17a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:10.879237 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.879171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7\" (UID: \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\") " pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:10.879844 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.879823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088edb16-d600-4472-8c76-297d4c9a17a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7\" (UID: \"088edb16-d600-4472-8c76-297d4c9a17a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:10.886604 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.886579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7k8c\" (UniqueName: \"kubernetes.io/projected/088edb16-d600-4472-8c76-297d4c9a17a3-kube-api-access-x7k8c\") pod \"payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7\" (UID: \"088edb16-d600-4472-8c76-297d4c9a17a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:10.980535 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.980444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7\" (UID: \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\") " pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:10.980747 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.980604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8lfd\" (UniqueName: \"kubernetes.io/projected/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-kube-api-access-s8lfd\") pod \"payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7\" (UID: \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\") " pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:10.981180 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.981158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7\" (UID: \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\") " pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:10.988146 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:10.988121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8lfd\" (UniqueName: \"kubernetes.io/projected/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-kube-api-access-s8lfd\") pod \"payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7\" (UID: \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\") " pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:11.003346 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.003322    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:11.042967 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.042928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:11.282391 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.282299    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"]
Sep 19 11:00:11.285558 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:00:11.285520    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088edb16_d600_4472_8c76_297d4c9a17a3.slice/crio-f11c03976e886f232e8643c36446580c7f567540ffd2316c4f15809ca0d4e052 WatchSource:0}: Error finding container f11c03976e886f232e8643c36446580c7f567540ffd2316c4f15809ca0d4e052: Status 404 returned error can't find the container with id f11c03976e886f232e8643c36446580c7f567540ffd2316c4f15809ca0d4e052
Sep 19 11:00:11.327026 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.326999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"]
Sep 19 11:00:11.327632 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:00:11.327609    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79fa3a6_0168_4d4e_9813_b2e9cdf645b5.slice/crio-b65f32acbb2ab9beef34fdb71bf1317ef3886ca314c2b303ccc04b7c5ade2e77 WatchSource:0}: Error finding container b65f32acbb2ab9beef34fdb71bf1317ef3886ca314c2b303ccc04b7c5ade2e77: Status 404 returned error can't find the container with id b65f32acbb2ab9beef34fdb71bf1317ef3886ca314c2b303ccc04b7c5ade2e77
Sep 19 11:00:11.491324 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.491291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7" event={"ID":"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5","Type":"ContainerStarted","Data":"c743e2c23ab2749774f0f41ca0f599e366ef15564965855c9c4702d9707bb653"}
Sep 19 11:00:11.491528 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.491345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7" event={"ID":"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5","Type":"ContainerStarted","Data":"b65f32acbb2ab9beef34fdb71bf1317ef3886ca314c2b303ccc04b7c5ade2e77"}
Sep 19 11:00:11.491528 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.491374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:11.493130 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.493088    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7" event={"ID":"088edb16-d600-4472-8c76-297d4c9a17a3","Type":"ContainerStarted","Data":"ec621a8a66055f9b1f4ba699ad8ea5226e1444e2cd9e255afba77f8875077794"}
Sep 19 11:00:11.493236 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.493157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7" event={"ID":"088edb16-d600-4472-8c76-297d4c9a17a3","Type":"ContainerStarted","Data":"f11c03976e886f232e8643c36446580c7f567540ffd2316c4f15809ca0d4e052"}
Sep 19 11:00:11.493236 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.493189    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:11.507422 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.507375    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7" podStartSLOduration=1.507359928 podStartE2EDuration="1.507359928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:00:11.506212962 +0000 UTC m=+1415.439919203" watchObservedRunningTime="2026-09-19 11:00:11.507359928 +0000 UTC m=+1415.441066142"
Sep 19 11:00:11.523252 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:11.523194    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7" podStartSLOduration=1.5231753590000001 podStartE2EDuration="1.523175359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:00:11.519734472 +0000 UTC m=+1415.453440713" watchObservedRunningTime="2026-09-19 11:00:11.523175359 +0000 UTC m=+1415.456881578"
Sep 19 11:00:22.502672 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:22.502598    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:00:22.503023 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:22.502829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:00:38.393170 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:38.393135    2563 scope.go:117] "RemoveContainer" containerID="13de894c991b90052f1df89e742e79b6dd3e3446f831051217bcceb1f32fac51"
Sep 19 11:00:46.125825 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.125795    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"]
Sep 19 11:00:46.129433 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.129407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:00:46.131972 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.131950    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-0c8f26-dockercfg-rb2wg\""
Sep 19 11:00:46.132083 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.132017    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-0c8f26\""
Sep 19 11:00:46.139197 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.139174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"]
Sep 19 11:00:46.251284 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.251244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h622n\" (UniqueName: \"kubernetes.io/projected/d4de16f3-d431-438e-bd73-cf83e84fd0a0-kube-api-access-h622n\") pod \"payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc\" (UID: \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:00:46.251580 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.251528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4de16f3-d431-438e-bd73-cf83e84fd0a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc\" (UID: \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:00:46.353114 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.353068    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h622n\" (UniqueName: \"kubernetes.io/projected/d4de16f3-d431-438e-bd73-cf83e84fd0a0-kube-api-access-h622n\") pod \"payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc\" (UID: \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:00:46.353114 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.353121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4de16f3-d431-438e-bd73-cf83e84fd0a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc\" (UID: \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:00:46.353877 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.353856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4de16f3-d431-438e-bd73-cf83e84fd0a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc\" (UID: \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:00:46.361068 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.361038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h622n\" (UniqueName: \"kubernetes.io/projected/d4de16f3-d431-438e-bd73-cf83e84fd0a0-kube-api-access-h622n\") pod \"payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc\" (UID: \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:00:46.444271 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.444173    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:00:46.723096 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.723061    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"]
Sep 19 11:00:46.723665 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:00:46.723639    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4de16f3_d431_438e_bd73_cf83e84fd0a0.slice/crio-09cd3bbf63bc866f1b1ff0085d4483e9cd78ee38825078893082e32c86392676 WatchSource:0}: Error finding container 09cd3bbf63bc866f1b1ff0085d4483e9cd78ee38825078893082e32c86392676: Status 404 returned error can't find the container with id 09cd3bbf63bc866f1b1ff0085d4483e9cd78ee38825078893082e32c86392676
Sep 19 11:00:46.743972 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:46.743941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc" event={"ID":"d4de16f3-d431-438e-bd73-cf83e84fd0a0","Type":"ContainerStarted","Data":"09cd3bbf63bc866f1b1ff0085d4483e9cd78ee38825078893082e32c86392676"}
Sep 19 11:00:47.752304 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:47.752261    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc" event={"ID":"d4de16f3-d431-438e-bd73-cf83e84fd0a0","Type":"ContainerStarted","Data":"c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9"}
Sep 19 11:00:47.752731 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:47.752344    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:00:47.769391 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:47.769337    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc" podStartSLOduration=1.7693205440000002 podStartE2EDuration="1.769320544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:00:47.766633721 +0000 UTC m=+1451.700339952" watchObservedRunningTime="2026-09-19 11:00:47.769320544 +0000 UTC m=+1451.703026759"
Sep 19 11:00:58.762044 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:00:58.762013    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:01:13.052490 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.052457    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"]
Sep 19 11:01:13.056267 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.056250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"
Sep 19 11:01:13.058814 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.058789    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:01:13.058910 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.058855    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:01:13.062361 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.062338    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"]
Sep 19 11:01:13.124371 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.124329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea98e63e-531a-4951-aa99-ab913cf323b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs\" (UID: \"ea98e63e-531a-4951-aa99-ab913cf323b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"
Sep 19 11:01:13.225659 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.225604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea98e63e-531a-4951-aa99-ab913cf323b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs\" (UID: \"ea98e63e-531a-4951-aa99-ab913cf323b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"
Sep 19 11:01:13.226246 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.226227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea98e63e-531a-4951-aa99-ab913cf323b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs\" (UID: \"ea98e63e-531a-4951-aa99-ab913cf323b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"
Sep 19 11:01:13.369240 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.369208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"
Sep 19 11:01:13.637953 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.637922    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"]
Sep 19 11:01:13.639231 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:01:13.639199    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea98e63e_531a_4951_aa99_ab913cf323b3.slice/crio-ed6379163f6935292b704e60b26912079462f0c172dc83bc361e86df0057d37c WatchSource:0}: Error finding container ed6379163f6935292b704e60b26912079462f0c172dc83bc361e86df0057d37c: Status 404 returned error can't find the container with id ed6379163f6935292b704e60b26912079462f0c172dc83bc361e86df0057d37c
Sep 19 11:01:13.921223 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:13.921186    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs" event={"ID":"ea98e63e-531a-4951-aa99-ab913cf323b3","Type":"ContainerStarted","Data":"ed6379163f6935292b704e60b26912079462f0c172dc83bc361e86df0057d37c"}
Sep 19 11:01:14.929433 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:14.929395    2563 generic.go:356] "Generic (PLEG): container finished" podID="ea98e63e-531a-4951-aa99-ab913cf323b3" containerID="40dfb404cef933295b3eeeba523ae7981a3eac3373ba592f9313700b52e123f3" exitCode=0
Sep 19 11:01:14.929953 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:14.929478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs" event={"ID":"ea98e63e-531a-4951-aa99-ab913cf323b3","Type":"ContainerDied","Data":"40dfb404cef933295b3eeeba523ae7981a3eac3373ba592f9313700b52e123f3"}
Sep 19 11:01:16.081682 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:16.081653    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"
Sep 19 11:01:16.161575 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:16.159571    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea98e63e-531a-4951-aa99-ab913cf323b3-maas-api-service-ca\") pod \"ea98e63e-531a-4951-aa99-ab913cf323b3\" (UID: \"ea98e63e-531a-4951-aa99-ab913cf323b3\") "
Sep 19 11:01:16.161575 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:16.160404    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea98e63e-531a-4951-aa99-ab913cf323b3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ea98e63e-531a-4951-aa99-ab913cf323b3" (UID: "ea98e63e-531a-4951-aa99-ab913cf323b3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:01:16.261405 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:16.261315    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea98e63e-531a-4951-aa99-ab913cf323b3-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:01:16.943259 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:16.943227    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"
Sep 19 11:01:16.943459 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:16.943271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs" event={"ID":"ea98e63e-531a-4951-aa99-ab913cf323b3","Type":"ContainerDied","Data":"ed6379163f6935292b704e60b26912079462f0c172dc83bc361e86df0057d37c"}
Sep 19 11:01:16.943459 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:16.943318    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed6379163f6935292b704e60b26912079462f0c172dc83bc361e86df0057d37c"
Sep 19 11:01:28.804910 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:28.804870    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"]
Sep 19 11:01:28.805404 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:28.805106    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7" podUID="a79fa3a6-0168-4d4e-9813-b2e9cdf645b5" containerName="payload-processing" containerID="cri-o://c743e2c23ab2749774f0f41ca0f599e366ef15564965855c9c4702d9707bb653" gracePeriod=30
Sep 19 11:01:28.815169 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:28.815138    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"]
Sep 19 11:01:28.815421 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:28.815382    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7" podUID="088edb16-d600-4472-8c76-297d4c9a17a3" containerName="payload-pre-processing" containerID="cri-o://ec621a8a66055f9b1f4ba699ad8ea5226e1444e2cd9e255afba77f8875077794" gracePeriod=30
Sep 19 11:01:28.952822 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:28.952784    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"]
Sep 19 11:01:28.956650 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:28.956617    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-000aa3-ldcgs"]
Sep 19 11:01:29.030831 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.030794    2563 generic.go:356] "Generic (PLEG): container finished" podID="a79fa3a6-0168-4d4e-9813-b2e9cdf645b5" containerID="c743e2c23ab2749774f0f41ca0f599e366ef15564965855c9c4702d9707bb653" exitCode=0
Sep 19 11:01:29.030987 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.030839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7" event={"ID":"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5","Type":"ContainerDied","Data":"c743e2c23ab2749774f0f41ca0f599e366ef15564965855c9c4702d9707bb653"}
Sep 19 11:01:29.032877 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.032850    2563 generic.go:356] "Generic (PLEG): container finished" podID="088edb16-d600-4472-8c76-297d4c9a17a3" containerID="ec621a8a66055f9b1f4ba699ad8ea5226e1444e2cd9e255afba77f8875077794" exitCode=0
Sep 19 11:01:29.033006 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.032920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7" event={"ID":"088edb16-d600-4472-8c76-297d4c9a17a3","Type":"ContainerDied","Data":"ec621a8a66055f9b1f4ba699ad8ea5226e1444e2cd9e255afba77f8875077794"}
Sep 19 11:01:29.089144 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.089114    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:01:29.092235 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.092208    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-plugins-config-volume\") pod \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\" (UID: \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\") "
Sep 19 11:01:29.092393 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.092281    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8lfd\" (UniqueName: \"kubernetes.io/projected/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-kube-api-access-s8lfd\") pod \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\" (UID: \"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5\") "
Sep 19 11:01:29.092666 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.092633    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a79fa3a6-0168-4d4e-9813-b2e9cdf645b5" (UID: "a79fa3a6-0168-4d4e-9813-b2e9cdf645b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:01:29.092817 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.092797    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:01:29.094426 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.094402    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-kube-api-access-s8lfd" (OuterVolumeSpecName: "kube-api-access-s8lfd") pod "a79fa3a6-0168-4d4e-9813-b2e9cdf645b5" (UID: "a79fa3a6-0168-4d4e-9813-b2e9cdf645b5"). InnerVolumeSpecName "kube-api-access-s8lfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:01:29.114213 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.114189    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:01:29.193716 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.193671    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8lfd\" (UniqueName: \"kubernetes.io/projected/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5-kube-api-access-s8lfd\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:01:29.294180 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.294144    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088edb16-d600-4472-8c76-297d4c9a17a3-plugins-config-volume\") pod \"088edb16-d600-4472-8c76-297d4c9a17a3\" (UID: \"088edb16-d600-4472-8c76-297d4c9a17a3\") "
Sep 19 11:01:29.294180 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.294186    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7k8c\" (UniqueName: \"kubernetes.io/projected/088edb16-d600-4472-8c76-297d4c9a17a3-kube-api-access-x7k8c\") pod \"088edb16-d600-4472-8c76-297d4c9a17a3\" (UID: \"088edb16-d600-4472-8c76-297d4c9a17a3\") "
Sep 19 11:01:29.294620 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.294599    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/088edb16-d600-4472-8c76-297d4c9a17a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "088edb16-d600-4472-8c76-297d4c9a17a3" (UID: "088edb16-d600-4472-8c76-297d4c9a17a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:01:29.296336 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.296311    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/088edb16-d600-4472-8c76-297d4c9a17a3-kube-api-access-x7k8c" (OuterVolumeSpecName: "kube-api-access-x7k8c") pod "088edb16-d600-4472-8c76-297d4c9a17a3" (UID: "088edb16-d600-4472-8c76-297d4c9a17a3"). InnerVolumeSpecName "kube-api-access-x7k8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:01:29.395111 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.395074    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/088edb16-d600-4472-8c76-297d4c9a17a3-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:01:29.395111 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:29.395103    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7k8c\" (UniqueName: \"kubernetes.io/projected/088edb16-d600-4472-8c76-297d4c9a17a3-kube-api-access-x7k8c\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:01:30.042134 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.042103    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"
Sep 19 11:01:30.042134 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.042128    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7" event={"ID":"a79fa3a6-0168-4d4e-9813-b2e9cdf645b5","Type":"ContainerDied","Data":"b65f32acbb2ab9beef34fdb71bf1317ef3886ca314c2b303ccc04b7c5ade2e77"}
Sep 19 11:01:30.042654 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.042196    2563 scope.go:117] "RemoveContainer" containerID="c743e2c23ab2749774f0f41ca0f599e366ef15564965855c9c4702d9707bb653"
Sep 19 11:01:30.043782 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.043765    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"
Sep 19 11:01:30.043917 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.043781    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7" event={"ID":"088edb16-d600-4472-8c76-297d4c9a17a3","Type":"ContainerDied","Data":"f11c03976e886f232e8643c36446580c7f567540ffd2316c4f15809ca0d4e052"}
Sep 19 11:01:30.053912 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.053894    2563 scope.go:117] "RemoveContainer" containerID="ec621a8a66055f9b1f4ba699ad8ea5226e1444e2cd9e255afba77f8875077794"
Sep 19 11:01:30.071076 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.071041    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"]
Sep 19 11:01:30.074384 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.074310    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-000aa3-78f7bd898b-9kvb7"]
Sep 19 11:01:30.084020 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.083979    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"]
Sep 19 11:01:30.087430 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.087404    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-000aa3-6755f96b77-6mtw7"]
Sep 19 11:01:30.119304 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.119274    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="088edb16-d600-4472-8c76-297d4c9a17a3" path="/var/lib/kubelet/pods/088edb16-d600-4472-8c76-297d4c9a17a3/volumes"
Sep 19 11:01:30.119689 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.119675    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a79fa3a6-0168-4d4e-9813-b2e9cdf645b5" path="/var/lib/kubelet/pods/a79fa3a6-0168-4d4e-9813-b2e9cdf645b5/volumes"
Sep 19 11:01:30.120001 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:30.119989    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea98e63e-531a-4951-aa99-ab913cf323b3" path="/var/lib/kubelet/pods/ea98e63e-531a-4951-aa99-ab913cf323b3/volumes"
Sep 19 11:01:35.876428 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.876392    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"]
Sep 19 11:01:35.876888 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.876873    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="088edb16-d600-4472-8c76-297d4c9a17a3" containerName="payload-pre-processing"
Sep 19 11:01:35.876936 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.876889    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="088edb16-d600-4472-8c76-297d4c9a17a3" containerName="payload-pre-processing"
Sep 19 11:01:35.876936 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.876912    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea98e63e-531a-4951-aa99-ab913cf323b3" containerName="revoke-keys"
Sep 19 11:01:35.876936 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.876918    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea98e63e-531a-4951-aa99-ab913cf323b3" containerName="revoke-keys"
Sep 19 11:01:35.876936 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.876931    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79fa3a6-0168-4d4e-9813-b2e9cdf645b5" containerName="payload-processing"
Sep 19 11:01:35.877071 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.876938    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79fa3a6-0168-4d4e-9813-b2e9cdf645b5" containerName="payload-processing"
Sep 19 11:01:35.877071 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.877011    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea98e63e-531a-4951-aa99-ab913cf323b3" containerName="revoke-keys"
Sep 19 11:01:35.877071 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.877023    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="088edb16-d600-4472-8c76-297d4c9a17a3" containerName="payload-pre-processing"
Sep 19 11:01:35.877071 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.877029    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79fa3a6-0168-4d4e-9813-b2e9cdf645b5" containerName="payload-processing"
Sep 19 11:01:35.881791 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.881774    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"
Sep 19 11:01:35.884199 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.884002    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:01:35.884199 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.884016    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:01:35.887100 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.887076    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"]
Sep 19 11:01:35.961134 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:35.961091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa2fba98-aa0d-4299-836d-8820a2d6ec95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z\" (UID: \"aa2fba98-aa0d-4299-836d-8820a2d6ec95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"
Sep 19 11:01:36.061957 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:36.061923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa2fba98-aa0d-4299-836d-8820a2d6ec95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z\" (UID: \"aa2fba98-aa0d-4299-836d-8820a2d6ec95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"
Sep 19 11:01:36.062590 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:36.062571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa2fba98-aa0d-4299-836d-8820a2d6ec95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z\" (UID: \"aa2fba98-aa0d-4299-836d-8820a2d6ec95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"
Sep 19 11:01:36.194569 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:36.194457    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"
Sep 19 11:01:36.469513 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:36.469480    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"]
Sep 19 11:01:36.470867 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:01:36.470838    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2fba98_aa0d_4299_836d_8820a2d6ec95.slice/crio-37d96b0cb7ee83921855448df7626505aac45b0b84b3d29c43d3fb32a7ecaa0d WatchSource:0}: Error finding container 37d96b0cb7ee83921855448df7626505aac45b0b84b3d29c43d3fb32a7ecaa0d: Status 404 returned error can't find the container with id 37d96b0cb7ee83921855448df7626505aac45b0b84b3d29c43d3fb32a7ecaa0d
Sep 19 11:01:37.091362 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:37.091319    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z" event={"ID":"aa2fba98-aa0d-4299-836d-8820a2d6ec95","Type":"ContainerStarted","Data":"e1c7aaaeb0deae5bf365acff188cb2562afa9206b60c1e93703dfe4ff6abec99"}
Sep 19 11:01:37.091790 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:37.091385    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z" event={"ID":"aa2fba98-aa0d-4299-836d-8820a2d6ec95","Type":"ContainerStarted","Data":"37d96b0cb7ee83921855448df7626505aac45b0b84b3d29c43d3fb32a7ecaa0d"}
Sep 19 11:01:37.108050 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:37.107996    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z" podStartSLOduration=2.107979965 podStartE2EDuration="2.107979965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:01:37.104436785 +0000 UTC m=+1501.038142998" watchObservedRunningTime="2026-09-19 11:01:37.107979965 +0000 UTC m=+1501.041686179"
Sep 19 11:01:38.099790 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:38.099757    2563 generic.go:356] "Generic (PLEG): container finished" podID="aa2fba98-aa0d-4299-836d-8820a2d6ec95" containerID="e1c7aaaeb0deae5bf365acff188cb2562afa9206b60c1e93703dfe4ff6abec99" exitCode=0
Sep 19 11:01:38.100181 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:38.099844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z" event={"ID":"aa2fba98-aa0d-4299-836d-8820a2d6ec95","Type":"ContainerDied","Data":"e1c7aaaeb0deae5bf365acff188cb2562afa9206b60c1e93703dfe4ff6abec99"}
Sep 19 11:01:38.210434 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:38.210409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 11:01:38.216430 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:38.216407    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 11:01:39.268260 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:39.268233    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"
Sep 19 11:01:39.295108 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:39.295076    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa2fba98-aa0d-4299-836d-8820a2d6ec95-maas-api-service-ca\") pod \"aa2fba98-aa0d-4299-836d-8820a2d6ec95\" (UID: \"aa2fba98-aa0d-4299-836d-8820a2d6ec95\") "
Sep 19 11:01:39.295436 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:39.295411    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa2fba98-aa0d-4299-836d-8820a2d6ec95-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa2fba98-aa0d-4299-836d-8820a2d6ec95" (UID: "aa2fba98-aa0d-4299-836d-8820a2d6ec95"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:01:39.396785 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:39.396682    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa2fba98-aa0d-4299-836d-8820a2d6ec95-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:01:40.117282 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:40.117256    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"
Sep 19 11:01:40.120442 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:40.120406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z" event={"ID":"aa2fba98-aa0d-4299-836d-8820a2d6ec95","Type":"ContainerDied","Data":"37d96b0cb7ee83921855448df7626505aac45b0b84b3d29c43d3fb32a7ecaa0d"}
Sep 19 11:01:40.120600 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:40.120471    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37d96b0cb7ee83921855448df7626505aac45b0b84b3d29c43d3fb32a7ecaa0d"
Sep 19 11:01:51.500578 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:51.500464    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"]
Sep 19 11:01:51.501174 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:51.500728    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc" podUID="d4de16f3-d431-438e-bd73-cf83e84fd0a0" containerName="payload-pre-processing" containerID="cri-o://c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9" gracePeriod=30
Sep 19 11:01:51.663167 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:51.663128    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"]
Sep 19 11:01:51.665999 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:51.665967    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8f26-pxs6z"]
Sep 19 11:01:51.764534 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:51.764436    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:01:51.925288 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:51.925257    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h622n\" (UniqueName: \"kubernetes.io/projected/d4de16f3-d431-438e-bd73-cf83e84fd0a0-kube-api-access-h622n\") pod \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\" (UID: \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\") "
Sep 19 11:01:51.925493 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:51.925382    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4de16f3-d431-438e-bd73-cf83e84fd0a0-plugins-config-volume\") pod \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\" (UID: \"d4de16f3-d431-438e-bd73-cf83e84fd0a0\") "
Sep 19 11:01:51.925800 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:51.925774    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4de16f3-d431-438e-bd73-cf83e84fd0a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4de16f3-d431-438e-bd73-cf83e84fd0a0" (UID: "d4de16f3-d431-438e-bd73-cf83e84fd0a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:01:51.927403 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:51.927373    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4de16f3-d431-438e-bd73-cf83e84fd0a0-kube-api-access-h622n" (OuterVolumeSpecName: "kube-api-access-h622n") pod "d4de16f3-d431-438e-bd73-cf83e84fd0a0" (UID: "d4de16f3-d431-438e-bd73-cf83e84fd0a0"). InnerVolumeSpecName "kube-api-access-h622n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:01:52.026363 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.026283    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4de16f3-d431-438e-bd73-cf83e84fd0a0-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:01:52.026363 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.026310    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h622n\" (UniqueName: \"kubernetes.io/projected/d4de16f3-d431-438e-bd73-cf83e84fd0a0-kube-api-access-h622n\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:01:52.118907 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.118866    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa2fba98-aa0d-4299-836d-8820a2d6ec95" path="/var/lib/kubelet/pods/aa2fba98-aa0d-4299-836d-8820a2d6ec95/volumes"
Sep 19 11:01:52.191116 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.191073    2563 generic.go:356] "Generic (PLEG): container finished" podID="d4de16f3-d431-438e-bd73-cf83e84fd0a0" containerID="c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9" exitCode=0
Sep 19 11:01:52.191116 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.191118    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"
Sep 19 11:01:52.191379 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.191168    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc" event={"ID":"d4de16f3-d431-438e-bd73-cf83e84fd0a0","Type":"ContainerDied","Data":"c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9"}
Sep 19 11:01:52.191379 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.191223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc" event={"ID":"d4de16f3-d431-438e-bd73-cf83e84fd0a0","Type":"ContainerDied","Data":"09cd3bbf63bc866f1b1ff0085d4483e9cd78ee38825078893082e32c86392676"}
Sep 19 11:01:52.191379 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.191253    2563 scope.go:117] "RemoveContainer" containerID="c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9"
Sep 19 11:01:52.210109 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.210072    2563 scope.go:117] "RemoveContainer" containerID="c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9"
Sep 19 11:01:52.210857 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:01:52.210520    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9\": container with ID starting with c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9 not found: ID does not exist" containerID="c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9"
Sep 19 11:01:52.210857 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.210588    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9"} err="failed to get container status \"c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9\": rpc error: code = NotFound desc = could not find container \"c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9\": container with ID starting with c1b62e6a169191ea185d258a4345f430a2436d43483fa4c35e5c68c57e26f3f9 not found: ID does not exist"
Sep 19 11:01:52.216493 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.216459    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"]
Sep 19 11:01:52.219730 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:52.219709    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0c8f26-5bd784fd9d-dlshc"]
Sep 19 11:01:54.118972 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:54.118938    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4de16f3-d431-438e-bd73-cf83e84fd0a0" path="/var/lib/kubelet/pods/d4de16f3-d431-438e-bd73-cf83e84fd0a0/volumes"
Sep 19 11:01:58.427274 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.427239    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"]
Sep 19 11:01:58.427678 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.427670    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2fba98-aa0d-4299-836d-8820a2d6ec95" containerName="revoke-keys"
Sep 19 11:01:58.427722 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.427682    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2fba98-aa0d-4299-836d-8820a2d6ec95" containerName="revoke-keys"
Sep 19 11:01:58.427722 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.427702    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4de16f3-d431-438e-bd73-cf83e84fd0a0" containerName="payload-pre-processing"
Sep 19 11:01:58.427722 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.427707    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4de16f3-d431-438e-bd73-cf83e84fd0a0" containerName="payload-pre-processing"
Sep 19 11:01:58.427829 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.427765    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa2fba98-aa0d-4299-836d-8820a2d6ec95" containerName="revoke-keys"
Sep 19 11:01:58.427829 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.427772    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4de16f3-d431-438e-bd73-cf83e84fd0a0" containerName="payload-pre-processing"
Sep 19 11:01:58.430794 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.430779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"
Sep 19 11:01:58.433255 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.433230    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:01:58.433255 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.433230    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:01:58.438718 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.438409    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"]
Sep 19 11:01:58.599146 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.599116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40c51b6-a73d-4e1e-8c77-892a4f7afe9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd\" (UID: \"a40c51b6-a73d-4e1e-8c77-892a4f7afe9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"
Sep 19 11:01:58.700641 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.700536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40c51b6-a73d-4e1e-8c77-892a4f7afe9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd\" (UID: \"a40c51b6-a73d-4e1e-8c77-892a4f7afe9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"
Sep 19 11:01:58.701188 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.701166    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40c51b6-a73d-4e1e-8c77-892a4f7afe9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd\" (UID: \"a40c51b6-a73d-4e1e-8c77-892a4f7afe9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"
Sep 19 11:01:58.742562 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:58.742529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"
Sep 19 11:01:59.024791 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:59.024763    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"]
Sep 19 11:01:59.026182 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:01:59.026157    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40c51b6_a73d_4e1e_8c77_892a4f7afe9f.slice/crio-476475334aeba511f215f2658bea0f6828b0daeb4c485aab8550fe0736cb00f2 WatchSource:0}: Error finding container 476475334aeba511f215f2658bea0f6828b0daeb4c485aab8550fe0736cb00f2: Status 404 returned error can't find the container with id 476475334aeba511f215f2658bea0f6828b0daeb4c485aab8550fe0736cb00f2
Sep 19 11:01:59.236478 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:01:59.236444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd" event={"ID":"a40c51b6-a73d-4e1e-8c77-892a4f7afe9f","Type":"ContainerStarted","Data":"476475334aeba511f215f2658bea0f6828b0daeb4c485aab8550fe0736cb00f2"}
Sep 19 11:02:00.244984 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:00.244941    2563 generic.go:356] "Generic (PLEG): container finished" podID="a40c51b6-a73d-4e1e-8c77-892a4f7afe9f" containerID="5a63af6a3ff8e64880f40758456d697966570cdba7f8594366f4cc896bdfce66" exitCode=0
Sep 19 11:02:00.245358 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:00.245028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd" event={"ID":"a40c51b6-a73d-4e1e-8c77-892a4f7afe9f","Type":"ContainerDied","Data":"5a63af6a3ff8e64880f40758456d697966570cdba7f8594366f4cc896bdfce66"}
Sep 19 11:02:01.395475 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:01.395448    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"
Sep 19 11:02:01.531697 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:01.531606    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40c51b6-a73d-4e1e-8c77-892a4f7afe9f-maas-api-service-ca\") pod \"a40c51b6-a73d-4e1e-8c77-892a4f7afe9f\" (UID: \"a40c51b6-a73d-4e1e-8c77-892a4f7afe9f\") "
Sep 19 11:02:01.532065 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:01.532040    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40c51b6-a73d-4e1e-8c77-892a4f7afe9f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a40c51b6-a73d-4e1e-8c77-892a4f7afe9f" (UID: "a40c51b6-a73d-4e1e-8c77-892a4f7afe9f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:02:01.632812 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:01.632767    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40c51b6-a73d-4e1e-8c77-892a4f7afe9f-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:02.260072 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:02.260044    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"
Sep 19 11:02:02.260230 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:02.260084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd" event={"ID":"a40c51b6-a73d-4e1e-8c77-892a4f7afe9f","Type":"ContainerDied","Data":"476475334aeba511f215f2658bea0f6828b0daeb4c485aab8550fe0736cb00f2"}
Sep 19 11:02:02.260230 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:02.260130    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="476475334aeba511f215f2658bea0f6828b0daeb4c485aab8550fe0736cb00f2"
Sep 19 11:02:08.941312 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:08.941260    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x"]
Sep 19 11:02:08.944533 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:08.944503    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-20c8d9-29830260-dcc7x"]
Sep 19 11:02:08.974164 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:08.974133    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"]
Sep 19 11:02:08.974625 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:08.974366    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8" podUID="7305aaf3-a146-490b-ad41-81564c21efcd" containerName="payload-processing" containerID="cri-o://16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0" gracePeriod=30
Sep 19 11:02:08.979116 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:08.979083    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"]
Sep 19 11:02:08.979541 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:08.979512    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l" podUID="dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0" containerName="payload-pre-processing" containerID="cri-o://f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18" gracePeriod=30
Sep 19 11:02:09.125136 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.125091    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"]
Sep 19 11:02:09.127964 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.127932    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-20c8d9-n45sd"]
Sep 19 11:02:09.272006 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.271981    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 11:02:09.300486 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.300456    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 11:02:09.311100 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.311069    2563 generic.go:356] "Generic (PLEG): container finished" podID="7305aaf3-a146-490b-ad41-81564c21efcd" containerID="16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0" exitCode=0
Sep 19 11:02:09.311273 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.311111    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"
Sep 19 11:02:09.311273 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.311152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8" event={"ID":"7305aaf3-a146-490b-ad41-81564c21efcd","Type":"ContainerDied","Data":"16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0"}
Sep 19 11:02:09.311273 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.311242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8" event={"ID":"7305aaf3-a146-490b-ad41-81564c21efcd","Type":"ContainerDied","Data":"e9744d317be8f440ea2d8578a2bd26c3c4a6ce1029a86b9a71565e78a0a465b0"}
Sep 19 11:02:09.311463 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.311278    2563 scope.go:117] "RemoveContainer" containerID="16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0"
Sep 19 11:02:09.312762 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.312739    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0" containerID="f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18" exitCode=0
Sep 19 11:02:09.312884 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.312784    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"
Sep 19 11:02:09.312884 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.312786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l" event={"ID":"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0","Type":"ContainerDied","Data":"f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18"}
Sep 19 11:02:09.312884 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.312845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l" event={"ID":"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0","Type":"ContainerDied","Data":"45fe07daa3654017d021225ee2f6d9d4e0c256d052a68308a1f52c3544ad966e"}
Sep 19 11:02:09.320824 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.320792    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xhrr\" (UniqueName: \"kubernetes.io/projected/7305aaf3-a146-490b-ad41-81564c21efcd-kube-api-access-8xhrr\") pod \"7305aaf3-a146-490b-ad41-81564c21efcd\" (UID: \"7305aaf3-a146-490b-ad41-81564c21efcd\") "
Sep 19 11:02:09.321017 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.320954    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7305aaf3-a146-490b-ad41-81564c21efcd-plugins-config-volume\") pod \"7305aaf3-a146-490b-ad41-81564c21efcd\" (UID: \"7305aaf3-a146-490b-ad41-81564c21efcd\") "
Sep 19 11:02:09.321697 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.321663    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7305aaf3-a146-490b-ad41-81564c21efcd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7305aaf3-a146-490b-ad41-81564c21efcd" (UID: "7305aaf3-a146-490b-ad41-81564c21efcd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:02:09.323418 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.323398    2563 scope.go:117] "RemoveContainer" containerID="16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0"
Sep 19 11:02:09.323670 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.323638    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7305aaf3-a146-490b-ad41-81564c21efcd-kube-api-access-8xhrr" (OuterVolumeSpecName: "kube-api-access-8xhrr") pod "7305aaf3-a146-490b-ad41-81564c21efcd" (UID: "7305aaf3-a146-490b-ad41-81564c21efcd"). InnerVolumeSpecName "kube-api-access-8xhrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:02:09.323820 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:02:09.323797    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0\": container with ID starting with 16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0 not found: ID does not exist" containerID="16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0"
Sep 19 11:02:09.323900 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.323829    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0"} err="failed to get container status \"16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0\": rpc error: code = NotFound desc = could not find container \"16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0\": container with ID starting with 16022dfa92cfa9b249a64ff18b66bb9af962f1d2df6fbea5f8b23188238e42b0 not found: ID does not exist"
Sep 19 11:02:09.323900 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.323848    2563 scope.go:117] "RemoveContainer" containerID="f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18"
Sep 19 11:02:09.335122 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.335102    2563 scope.go:117] "RemoveContainer" containerID="f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18"
Sep 19 11:02:09.335444 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:02:09.335422    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18\": container with ID starting with f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18 not found: ID does not exist" containerID="f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18"
Sep 19 11:02:09.335560 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.335448    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18"} err="failed to get container status \"f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18\": rpc error: code = NotFound desc = could not find container \"f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18\": container with ID starting with f6eef9d73595c8b0904f2af319d34678391f6a7f74821b86b756ac4c50df6c18 not found: ID does not exist"
Sep 19 11:02:09.421705 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.421672    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-plugins-config-volume\") pod \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\" (UID: \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\") "
Sep 19 11:02:09.421919 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.421734    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z85xq\" (UniqueName: \"kubernetes.io/projected/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-kube-api-access-z85xq\") pod \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\" (UID: \"dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0\") "
Sep 19 11:02:09.422047 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.422029    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7305aaf3-a146-490b-ad41-81564c21efcd-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:09.422047 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.422046    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xhrr\" (UniqueName: \"kubernetes.io/projected/7305aaf3-a146-490b-ad41-81564c21efcd-kube-api-access-8xhrr\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:09.422169 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.422147    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0" (UID: "dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:02:09.423991 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.423963    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-kube-api-access-z85xq" (OuterVolumeSpecName: "kube-api-access-z85xq") pod "dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0" (UID: "dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0"). InnerVolumeSpecName "kube-api-access-z85xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:02:09.523322 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.523198    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:09.523322 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.523234    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z85xq\" (UniqueName: \"kubernetes.io/projected/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0-kube-api-access-z85xq\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:09.640335 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.640302    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"]
Sep 19 11:02:09.643186 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.643153    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20c8d9-657964c794-tsc9l"]
Sep 19 11:02:09.664301 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.664255    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"]
Sep 19 11:02:09.667301 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:09.667256    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-20c8d9-6fdc86cb8f-w6zt8"]
Sep 19 11:02:10.122527 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:10.122491    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6968b1d0-4931-471f-b57d-86183d20830e" path="/var/lib/kubelet/pods/6968b1d0-4931-471f-b57d-86183d20830e/volumes"
Sep 19 11:02:10.123057 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:10.123033    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7305aaf3-a146-490b-ad41-81564c21efcd" path="/var/lib/kubelet/pods/7305aaf3-a146-490b-ad41-81564c21efcd/volumes"
Sep 19 11:02:10.123480 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:10.123459    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a40c51b6-a73d-4e1e-8c77-892a4f7afe9f" path="/var/lib/kubelet/pods/a40c51b6-a73d-4e1e-8c77-892a4f7afe9f/volumes"
Sep 19 11:02:10.123970 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:10.123953    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0" path="/var/lib/kubelet/pods/dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0/volumes"
Sep 19 11:02:15.882239 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882197    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"]
Sep 19 11:02:15.882666 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882652    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0" containerName="payload-pre-processing"
Sep 19 11:02:15.882666 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882667    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0" containerName="payload-pre-processing"
Sep 19 11:02:15.882767 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882687    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7305aaf3-a146-490b-ad41-81564c21efcd" containerName="payload-processing"
Sep 19 11:02:15.882767 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882693    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7305aaf3-a146-490b-ad41-81564c21efcd" containerName="payload-processing"
Sep 19 11:02:15.882767 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882711    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40c51b6-a73d-4e1e-8c77-892a4f7afe9f" containerName="revoke-keys"
Sep 19 11:02:15.882767 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882719    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40c51b6-a73d-4e1e-8c77-892a4f7afe9f" containerName="revoke-keys"
Sep 19 11:02:15.882893 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882787    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc735ded-ec6c-4cc2-b3a0-5cba0b5000e0" containerName="payload-pre-processing"
Sep 19 11:02:15.882893 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882800    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40c51b6-a73d-4e1e-8c77-892a4f7afe9f" containerName="revoke-keys"
Sep 19 11:02:15.882893 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.882807    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7305aaf3-a146-490b-ad41-81564c21efcd" containerName="payload-processing"
Sep 19 11:02:15.887456 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.887438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"
Sep 19 11:02:15.889709 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.889674    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:02:15.889860 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.889760    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:02:15.893207 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.893179    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"]
Sep 19 11:02:15.991524 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:15.991490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47ab337-92ed-4fa3-b699-294099a0207b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w\" (UID: \"e47ab337-92ed-4fa3-b699-294099a0207b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"
Sep 19 11:02:16.093005 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:16.092908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47ab337-92ed-4fa3-b699-294099a0207b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w\" (UID: \"e47ab337-92ed-4fa3-b699-294099a0207b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"
Sep 19 11:02:16.093803 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:16.093769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47ab337-92ed-4fa3-b699-294099a0207b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w\" (UID: \"e47ab337-92ed-4fa3-b699-294099a0207b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"
Sep 19 11:02:16.200715 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:16.200625    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"
Sep 19 11:02:16.476542 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:16.476511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"]
Sep 19 11:02:16.477495 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:02:16.477468    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47ab337_92ed_4fa3_b699_294099a0207b.slice/crio-8ba2d0448141c64f05868b1d00ea72ed7b0e332456a009a0aef7b7c3eb83d1e2 WatchSource:0}: Error finding container 8ba2d0448141c64f05868b1d00ea72ed7b0e332456a009a0aef7b7c3eb83d1e2: Status 404 returned error can't find the container with id 8ba2d0448141c64f05868b1d00ea72ed7b0e332456a009a0aef7b7c3eb83d1e2
Sep 19 11:02:17.370540 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:17.370511    2563 generic.go:356] "Generic (PLEG): container finished" podID="e47ab337-92ed-4fa3-b699-294099a0207b" containerID="28c7744f99e7db3c2312e962971c0448fcc5df72235c1ff6311ca2ba4bbbc07b" exitCode=0
Sep 19 11:02:17.370981 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:17.370593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w" event={"ID":"e47ab337-92ed-4fa3-b699-294099a0207b","Type":"ContainerDied","Data":"28c7744f99e7db3c2312e962971c0448fcc5df72235c1ff6311ca2ba4bbbc07b"}
Sep 19 11:02:17.370981 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:17.370643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w" event={"ID":"e47ab337-92ed-4fa3-b699-294099a0207b","Type":"ContainerStarted","Data":"8ba2d0448141c64f05868b1d00ea72ed7b0e332456a009a0aef7b7c3eb83d1e2"}
Sep 19 11:02:18.532418 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:18.532393    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"
Sep 19 11:02:18.620309 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:18.620273    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47ab337-92ed-4fa3-b699-294099a0207b-maas-api-service-ca\") pod \"e47ab337-92ed-4fa3-b699-294099a0207b\" (UID: \"e47ab337-92ed-4fa3-b699-294099a0207b\") "
Sep 19 11:02:18.620712 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:18.620683    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e47ab337-92ed-4fa3-b699-294099a0207b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e47ab337-92ed-4fa3-b699-294099a0207b" (UID: "e47ab337-92ed-4fa3-b699-294099a0207b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:02:18.721592 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:18.721490    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47ab337-92ed-4fa3-b699-294099a0207b-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:19.390822 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:19.390783    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"
Sep 19 11:02:19.390822 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:19.390815    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w" event={"ID":"e47ab337-92ed-4fa3-b699-294099a0207b","Type":"ContainerDied","Data":"8ba2d0448141c64f05868b1d00ea72ed7b0e332456a009a0aef7b7c3eb83d1e2"}
Sep 19 11:02:19.391017 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:19.390886    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ba2d0448141c64f05868b1d00ea72ed7b0e332456a009a0aef7b7c3eb83d1e2"
Sep 19 11:02:26.610311 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:26.610267    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"]
Sep 19 11:02:26.612941 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:26.612909    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-8ddce5-wvt8w"]
Sep 19 11:02:28.118349 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:28.118317    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e47ab337-92ed-4fa3-b699-294099a0207b" path="/var/lib/kubelet/pods/e47ab337-92ed-4fa3-b699-294099a0207b/volumes"
Sep 19 11:02:33.053827 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:33.053796    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"]
Sep 19 11:02:33.054270 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:33.054017    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy" containerID="cri-o://cd05615b753bd689eeffd7476281845ecbeda90414b850e4f0a2021be9d0cff0" gracePeriod=30
Sep 19 11:02:38.335253 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.335229    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 11:02:38.424224 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424190    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-envoy\") pod \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") "
Sep 19 11:02:38.424224 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424230    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-credential-socket\") pod \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") "
Sep 19 11:02:38.424452 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424257    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-podinfo\") pod \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") "
Sep 19 11:02:38.424452 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424310    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istiod-ca-cert\") pod \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") "
Sep 19 11:02:38.424452 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424342    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-token\") pod \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") "
Sep 19 11:02:38.424452 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-certs\") pod \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") "
Sep 19 11:02:38.424452 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424427    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-data\") pod \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") "
Sep 19 11:02:38.424452 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424449    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-socket\") pod \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") "
Sep 19 11:02:38.424799 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424500    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzwc5\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-kube-api-access-hzwc5\") pod \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\" (UID: \"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671\") "
Sep 19 11:02:38.424799 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424518    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" (UID: "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:02:38.424799 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424731    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" (UID: "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:02:38.424799 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424792    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" (UID: "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:02:38.425016 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424743    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" (UID: "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:02:38.425016 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" (UID: "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:02:38.425016 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.424999    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:38.425154 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.425018    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:38.425154 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.425030    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:38.425154 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.425043    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:38.425154 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.425057    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:38.426601 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.426567    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" (UID: "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:02:38.426601 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.426579    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" (UID: "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:02:38.427141 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.427119    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" (UID: "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:02:38.427213 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.427125    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-kube-api-access-hzwc5" (OuterVolumeSpecName: "kube-api-access-hzwc5") pod "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" (UID: "e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671"). InnerVolumeSpecName "kube-api-access-hzwc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:02:38.437969 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.437949    2563 scope.go:117] "RemoveContainer" containerID="11230f4b66c0ef936f9712aa281ce19d3cc5c36162e8abcddcc396c2c79735a9"
Sep 19 11:02:38.446836 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.446819    2563 scope.go:117] "RemoveContainer" containerID="18f83022720ee090390da9235c42f7c5691f6c3e386906318709b6044895bbb3"
Sep 19 11:02:38.455106 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.455088    2563 scope.go:117] "RemoveContainer" containerID="cd05615b753bd689eeffd7476281845ecbeda90414b850e4f0a2021be9d0cff0"
Sep 19 11:02:38.515697 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.515663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" event={"ID":"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671","Type":"ContainerDied","Data":"cd05615b753bd689eeffd7476281845ecbeda90414b850e4f0a2021be9d0cff0"}
Sep 19 11:02:38.515838 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.515720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl" event={"ID":"e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671","Type":"ContainerDied","Data":"d8a3fa44b7bcf9fb1b92f254262ab4ba49af09e829fb0fc7b01946d159ed2087"}
Sep 19 11:02:38.515838 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.515742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"
Sep 19 11:02:38.526300 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.526279    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:38.526300 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.526301    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:38.526428 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.526310    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzwc5\" (UniqueName: \"kubernetes.io/projected/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-kube-api-access-hzwc5\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:38.526428 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.526318    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:38.545736 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.545701    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"]
Sep 19 11:02:38.549115 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:38.549092    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8ddce5-openshift-default-fc86b696b-m7znl"]
Sep 19 11:02:39.063778 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.063738    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"]
Sep 19 11:02:39.064157 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.064145    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy"
Sep 19 11:02:39.064209 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.064159    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy"
Sep 19 11:02:39.064209 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.064170    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy"
Sep 19 11:02:39.064209 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.064176    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy"
Sep 19 11:02:39.064209 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.064189    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e47ab337-92ed-4fa3-b699-294099a0207b" containerName="revoke-keys"
Sep 19 11:02:39.064209 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.064194    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e47ab337-92ed-4fa3-b699-294099a0207b" containerName="revoke-keys"
Sep 19 11:02:39.064369 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.064264    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy"
Sep 19 11:02:39.064369 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.064275    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e47ab337-92ed-4fa3-b699-294099a0207b" containerName="revoke-keys"
Sep 19 11:02:39.064369 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.064281    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" containerName="istio-proxy"
Sep 19 11:02:39.069058 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.069039    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"
Sep 19 11:02:39.071690 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.071657    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:02:39.071855 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.071656    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:02:39.074427 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.074398    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"]
Sep 19 11:02:39.131572 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.131509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2942fc85-5718-4c12-9161-0363f482cc7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7\" (UID: \"2942fc85-5718-4c12-9161-0363f482cc7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"
Sep 19 11:02:39.232575 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.232512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2942fc85-5718-4c12-9161-0363f482cc7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7\" (UID: \"2942fc85-5718-4c12-9161-0363f482cc7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"
Sep 19 11:02:39.233165 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.233144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2942fc85-5718-4c12-9161-0363f482cc7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7\" (UID: \"2942fc85-5718-4c12-9161-0363f482cc7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"
Sep 19 11:02:39.382401 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.382360    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"
Sep 19 11:02:39.653647 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:39.653620    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"]
Sep 19 11:02:39.655035 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:02:39.655002    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2942fc85_5718_4c12_9161_0363f482cc7c.slice/crio-b471d4d827868da759b3979854e06f653d37c5a304a14d10fb7e52c1c8b03803 WatchSource:0}: Error finding container b471d4d827868da759b3979854e06f653d37c5a304a14d10fb7e52c1c8b03803: Status 404 returned error can't find the container with id b471d4d827868da759b3979854e06f653d37c5a304a14d10fb7e52c1c8b03803
Sep 19 11:02:40.119924 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:40.119889    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671" path="/var/lib/kubelet/pods/e1a82dfa-1cfc-473a-a1ee-f0b1a11fb671/volumes"
Sep 19 11:02:40.530161 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:40.530127    2563 generic.go:356] "Generic (PLEG): container finished" podID="2942fc85-5718-4c12-9161-0363f482cc7c" containerID="03a912841b7c9543fd26bdd58d9152a52e44311eba9c28bcb361620c1c725214" exitCode=0
Sep 19 11:02:40.530638 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:40.530192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7" event={"ID":"2942fc85-5718-4c12-9161-0363f482cc7c","Type":"ContainerDied","Data":"03a912841b7c9543fd26bdd58d9152a52e44311eba9c28bcb361620c1c725214"}
Sep 19 11:02:40.530638 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:40.530260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7" event={"ID":"2942fc85-5718-4c12-9161-0363f482cc7c","Type":"ContainerStarted","Data":"b471d4d827868da759b3979854e06f653d37c5a304a14d10fb7e52c1c8b03803"}
Sep 19 11:02:41.679167 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:41.679139    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"
Sep 19 11:02:41.760470 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:41.760434    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2942fc85-5718-4c12-9161-0363f482cc7c-maas-api-service-ca\") pod \"2942fc85-5718-4c12-9161-0363f482cc7c\" (UID: \"2942fc85-5718-4c12-9161-0363f482cc7c\") "
Sep 19 11:02:41.760886 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:41.760859    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2942fc85-5718-4c12-9161-0363f482cc7c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2942fc85-5718-4c12-9161-0363f482cc7c" (UID: "2942fc85-5718-4c12-9161-0363f482cc7c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:02:41.861496 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:41.861464    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2942fc85-5718-4c12-9161-0363f482cc7c-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:42.543679 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:42.543603    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"
Sep 19 11:02:42.543679 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:42.543613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7" event={"ID":"2942fc85-5718-4c12-9161-0363f482cc7c","Type":"ContainerDied","Data":"b471d4d827868da759b3979854e06f653d37c5a304a14d10fb7e52c1c8b03803"}
Sep 19 11:02:42.543679 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:42.543655    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b471d4d827868da759b3979854e06f653d37c5a304a14d10fb7e52c1c8b03803"
Sep 19 11:02:43.946342 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:43.946304    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"]
Sep 19 11:02:48.995810 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:48.995773    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"]
Sep 19 11:02:48.996227 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:48.996213    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2942fc85-5718-4c12-9161-0363f482cc7c" containerName="revoke-keys"
Sep 19 11:02:48.996227 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:48.996227    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2942fc85-5718-4c12-9161-0363f482cc7c" containerName="revoke-keys"
Sep 19 11:02:48.996325 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:48.996314    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2942fc85-5718-4c12-9161-0363f482cc7c" containerName="revoke-keys"
Sep 19 11:02:48.999690 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:48.999669    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"
Sep 19 11:02:49.002010 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:49.001985    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:02:49.002224 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:49.001990    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:02:49.006653 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:49.006627    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"]
Sep 19 11:02:49.135318 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:49.135274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6bdd084-ef81-4dd3-9fbb-225328fef993-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm\" (UID: \"a6bdd084-ef81-4dd3-9fbb-225328fef993\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"
Sep 19 11:02:49.236265 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:49.236228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6bdd084-ef81-4dd3-9fbb-225328fef993-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm\" (UID: \"a6bdd084-ef81-4dd3-9fbb-225328fef993\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"
Sep 19 11:02:49.236940 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:49.236921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6bdd084-ef81-4dd3-9fbb-225328fef993-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm\" (UID: \"a6bdd084-ef81-4dd3-9fbb-225328fef993\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"
Sep 19 11:02:49.311406 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:49.311318    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"
Sep 19 11:02:49.583050 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:49.583020    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"]
Sep 19 11:02:49.584761 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:02:49.584730    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bdd084_ef81_4dd3_9fbb_225328fef993.slice/crio-c5a46207063c24a4ff5a4da82bee0b34f7fb061d1461e8084d4a6d145c5e20f2 WatchSource:0}: Error finding container c5a46207063c24a4ff5a4da82bee0b34f7fb061d1461e8084d4a6d145c5e20f2: Status 404 returned error can't find the container with id c5a46207063c24a4ff5a4da82bee0b34f7fb061d1461e8084d4a6d145c5e20f2
Sep 19 11:02:50.595140 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:50.595109    2563 generic.go:356] "Generic (PLEG): container finished" podID="a6bdd084-ef81-4dd3-9fbb-225328fef993" containerID="6e5d195fe53bbb72789750c0d2581d46e5bee4de687f5c10161825b9f5f93479" exitCode=0
Sep 19 11:02:50.595575 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:50.595202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm" event={"ID":"a6bdd084-ef81-4dd3-9fbb-225328fef993","Type":"ContainerDied","Data":"6e5d195fe53bbb72789750c0d2581d46e5bee4de687f5c10161825b9f5f93479"}
Sep 19 11:02:50.595575 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:50.595251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm" event={"ID":"a6bdd084-ef81-4dd3-9fbb-225328fef993","Type":"ContainerStarted","Data":"c5a46207063c24a4ff5a4da82bee0b34f7fb061d1461e8084d4a6d145c5e20f2"}
Sep 19 11:02:51.739979 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:51.739948    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"
Sep 19 11:02:51.863117 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:51.863016    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6bdd084-ef81-4dd3-9fbb-225328fef993-maas-api-service-ca\") pod \"a6bdd084-ef81-4dd3-9fbb-225328fef993\" (UID: \"a6bdd084-ef81-4dd3-9fbb-225328fef993\") "
Sep 19 11:02:51.863411 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:51.863386    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6bdd084-ef81-4dd3-9fbb-225328fef993-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a6bdd084-ef81-4dd3-9fbb-225328fef993" (UID: "a6bdd084-ef81-4dd3-9fbb-225328fef993"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:02:51.963826 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:51.963791    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6bdd084-ef81-4dd3-9fbb-225328fef993-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:52.609274 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:52.609245    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"
Sep 19 11:02:52.609454 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:52.609276    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm" event={"ID":"a6bdd084-ef81-4dd3-9fbb-225328fef993","Type":"ContainerDied","Data":"c5a46207063c24a4ff5a4da82bee0b34f7fb061d1461e8084d4a6d145c5e20f2"}
Sep 19 11:02:52.609454 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:52.609320    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5a46207063c24a4ff5a4da82bee0b34f7fb061d1461e8084d4a6d145c5e20f2"
Sep 19 11:02:53.873364 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:53.873327    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"]
Sep 19 11:02:53.885217 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:53.885182    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"]
Sep 19 11:02:55.035463 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:55.035423    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn"]
Sep 19 11:02:55.040916 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:55.040818    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1907c1-29830260-9vphn"]
Sep 19 11:02:55.226309 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:55.226273    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"]
Sep 19 11:02:55.228844 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:55.228821    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1907c1-7drr7"]
Sep 19 11:02:56.119380 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:56.119344    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2942fc85-5718-4c12-9161-0363f482cc7c" path="/var/lib/kubelet/pods/2942fc85-5718-4c12-9161-0363f482cc7c/volumes"
Sep 19 11:02:56.119795 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:56.119712    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daac7882-7be5-443f-b514-eeb42bf57213" path="/var/lib/kubelet/pods/daac7882-7be5-443f-b514-eeb42bf57213/volumes"
Sep 19 11:02:58.967441 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:58.967400    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb" podUID="0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" containerName="main" containerID="cri-o://d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981" gracePeriod=45
Sep 19 11:02:59.235249 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.235225    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 11:02:59.340434 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.340395    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tls-certs\") pod \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") "
Sep 19 11:02:59.340655 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.340466    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcx5t\" (UniqueName: \"kubernetes.io/projected/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-kube-api-access-bcx5t\") pod \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") "
Sep 19 11:02:59.340655 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.340525    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tmp-dir\") pod \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") "
Sep 19 11:02:59.340655 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.340642    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-home\") pod \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") "
Sep 19 11:02:59.340837 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.340717    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-dshm\") pod \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") "
Sep 19 11:02:59.340837 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.340777    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-model-cache\") pod \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\" (UID: \"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f\") "
Sep 19 11:02:59.341226 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.341077    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-home" (OuterVolumeSpecName: "home") pod "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" (UID: "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:02:59.341226 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.341087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" (UID: "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:02:59.341226 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.341179    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:59.341226 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.341196    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:59.341562 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.341320    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-model-cache" (OuterVolumeSpecName: "model-cache") pod "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" (UID: "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:02:59.343143 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.343116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-kube-api-access-bcx5t" (OuterVolumeSpecName: "kube-api-access-bcx5t") pod "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" (UID: "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f"). InnerVolumeSpecName "kube-api-access-bcx5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:02:59.343337 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.343314    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" (UID: "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:02:59.343530 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.343511    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-dshm" (OuterVolumeSpecName: "dshm") pod "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" (UID: "0dd94a1a-282a-4176-9f7a-fb6cc0ed221f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:02:59.442214 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.442171    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:59.442214 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.442206    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:59.442214 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.442220    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:59.442461 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.442231    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcx5t\" (UniqueName: \"kubernetes.io/projected/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f-kube-api-access-bcx5t\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:02:59.660654 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.660620    2563 generic.go:356] "Generic (PLEG): container finished" podID="0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" containerID="d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981" exitCode=0
Sep 19 11:02:59.660879 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.660668    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"
Sep 19 11:02:59.660879 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.660706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb" event={"ID":"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f","Type":"ContainerDied","Data":"d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981"}
Sep 19 11:02:59.660879 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.660755    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb" event={"ID":"0dd94a1a-282a-4176-9f7a-fb6cc0ed221f","Type":"ContainerDied","Data":"1fb313fe9872a6837e8dfcce19a2a443e8671afc17f53fb08e3d0a66da74d0f4"}
Sep 19 11:02:59.660879 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.660774    2563 scope.go:117] "RemoveContainer" containerID="d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981"
Sep 19 11:02:59.671465 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.671441    2563 scope.go:117] "RemoveContainer" containerID="d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981"
Sep 19 11:02:59.671800 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:02:59.671778    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981\": container with ID starting with d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981 not found: ID does not exist" containerID="d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981"
Sep 19 11:02:59.671863 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.671810    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981"} err="failed to get container status \"d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981\": rpc error: code = NotFound desc = could not find container \"d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981\": container with ID starting with d0397bca04d200ecde7ecf5bc41d0a3e5371e7405623e9b82d6c26b7a9da6981 not found: ID does not exist"
Sep 19 11:02:59.681673 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.681645    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"]
Sep 19 11:02:59.684790 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:02:59.684767    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-1907c1/distinct-w0-1907c1-kserve-669d578ddd-smsjb"]
Sep 19 11:03:00.118806 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:00.118766    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" path="/var/lib/kubelet/pods/0dd94a1a-282a-4176-9f7a-fb6cc0ed221f/volumes"
Sep 19 11:03:04.717968 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:04.717937    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6"]
Sep 19 11:03:04.720479 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:04.720454    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5116ec-29830260-4ksp6"]
Sep 19 11:03:04.742705 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:04.742672    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"]
Sep 19 11:03:04.742998 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:04.742959    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8" podUID="68abc6a1-6824-4794-b65d-8849b22e06c2" containerName="payload-processing" containerID="cri-o://10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b" gracePeriod=30
Sep 19 11:03:04.902602 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:04.902563    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"]
Sep 19 11:03:04.905054 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:04.905024    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5116ec-6zglm"]
Sep 19 11:03:05.020889 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.020862    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 11:03:05.101845 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.101809    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c84w\" (UniqueName: \"kubernetes.io/projected/68abc6a1-6824-4794-b65d-8849b22e06c2-kube-api-access-9c84w\") pod \"68abc6a1-6824-4794-b65d-8849b22e06c2\" (UID: \"68abc6a1-6824-4794-b65d-8849b22e06c2\") "
Sep 19 11:03:05.102046 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.101878    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68abc6a1-6824-4794-b65d-8849b22e06c2-plugins-config-volume\") pod \"68abc6a1-6824-4794-b65d-8849b22e06c2\" (UID: \"68abc6a1-6824-4794-b65d-8849b22e06c2\") "
Sep 19 11:03:05.102345 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.102317    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68abc6a1-6824-4794-b65d-8849b22e06c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68abc6a1-6824-4794-b65d-8849b22e06c2" (UID: "68abc6a1-6824-4794-b65d-8849b22e06c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:03:05.103867 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.103846    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68abc6a1-6824-4794-b65d-8849b22e06c2-kube-api-access-9c84w" (OuterVolumeSpecName: "kube-api-access-9c84w") pod "68abc6a1-6824-4794-b65d-8849b22e06c2" (UID: "68abc6a1-6824-4794-b65d-8849b22e06c2"). InnerVolumeSpecName "kube-api-access-9c84w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:05.202779 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.202727    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c84w\" (UniqueName: \"kubernetes.io/projected/68abc6a1-6824-4794-b65d-8849b22e06c2-kube-api-access-9c84w\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:05.202779 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.202771    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68abc6a1-6824-4794-b65d-8849b22e06c2-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:05.702357 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.702325    2563 generic.go:356] "Generic (PLEG): container finished" podID="68abc6a1-6824-4794-b65d-8849b22e06c2" containerID="10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b" exitCode=0
Sep 19 11:03:05.702538 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.702377    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"
Sep 19 11:03:05.702538 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.702417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8" event={"ID":"68abc6a1-6824-4794-b65d-8849b22e06c2","Type":"ContainerDied","Data":"10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b"}
Sep 19 11:03:05.702538 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.702475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8" event={"ID":"68abc6a1-6824-4794-b65d-8849b22e06c2","Type":"ContainerDied","Data":"0ddcdde7cb5b603abb51d707f4dfa8d2a9b32d22e4dee01efad5a3b78da6dd7f"}
Sep 19 11:03:05.702538 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.702502    2563 scope.go:117] "RemoveContainer" containerID="10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b"
Sep 19 11:03:05.712378 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.712360    2563 scope.go:117] "RemoveContainer" containerID="10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b"
Sep 19 11:03:05.712705 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:03:05.712681    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b\": container with ID starting with 10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b not found: ID does not exist" containerID="10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b"
Sep 19 11:03:05.712759 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.712713    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b"} err="failed to get container status \"10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b\": rpc error: code = NotFound desc = could not find container \"10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b\": container with ID starting with 10afc105f85709f0d1e2aae7bb701676e36b5bccc42eb669bb9479af5513d01b not found: ID does not exist"
Sep 19 11:03:05.724314 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.724284    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"]
Sep 19 11:03:05.729365 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:05.729340    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5116ec-57b9b59fd9-n72q8"]
Sep 19 11:03:06.119110 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:06.119075    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68abc6a1-6824-4794-b65d-8849b22e06c2" path="/var/lib/kubelet/pods/68abc6a1-6824-4794-b65d-8849b22e06c2/volumes"
Sep 19 11:03:06.119518 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:06.119496    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6bdd084-ef81-4dd3-9fbb-225328fef993" path="/var/lib/kubelet/pods/a6bdd084-ef81-4dd3-9fbb-225328fef993/volumes"
Sep 19 11:03:06.119843 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:06.119825    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c35972e9-5885-48b7-b2d3-27a7c335557f" path="/var/lib/kubelet/pods/c35972e9-5885-48b7-b2d3-27a7c335557f/volumes"
Sep 19 11:03:08.894171 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:08.894125    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4" podUID="db6d2215-48f0-464a-9d9a-c2530589cffd" containerName="main" containerID="cri-o://b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2" gracePeriod=45
Sep 19 11:03:08.906011 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:08.905951    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf" podUID="69ce4712-0a58-4950-af99-a67e31c8109e" containerName="main" containerID="cri-o://cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95" gracePeriod=45
Sep 19 11:03:09.189928 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.189903    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 11:03:09.193151 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.193125    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 11:03:09.240563 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240516    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-home\") pod \"69ce4712-0a58-4950-af99-a67e31c8109e\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") "
Sep 19 11:03:09.240741 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240588    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-model-cache\") pod \"db6d2215-48f0-464a-9d9a-c2530589cffd\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") "
Sep 19 11:03:09.240828 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240734    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-dshm\") pod \"69ce4712-0a58-4950-af99-a67e31c8109e\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") "
Sep 19 11:03:09.240828 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240783    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-home\") pod \"db6d2215-48f0-464a-9d9a-c2530589cffd\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") "
Sep 19 11:03:09.240828 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240812    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-tmp-dir\") pod \"db6d2215-48f0-464a-9d9a-c2530589cffd\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") "
Sep 19 11:03:09.241012 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240860    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89fgs\" (UniqueName: \"kubernetes.io/projected/69ce4712-0a58-4950-af99-a67e31c8109e-kube-api-access-89fgs\") pod \"69ce4712-0a58-4950-af99-a67e31c8109e\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") "
Sep 19 11:03:09.241012 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240859    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-model-cache" (OuterVolumeSpecName: "model-cache") pod "db6d2215-48f0-464a-9d9a-c2530589cffd" (UID: "db6d2215-48f0-464a-9d9a-c2530589cffd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:09.241012 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240858    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-home" (OuterVolumeSpecName: "home") pod "69ce4712-0a58-4950-af99-a67e31c8109e" (UID: "69ce4712-0a58-4950-af99-a67e31c8109e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:09.241012 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240920    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qdl2\" (UniqueName: \"kubernetes.io/projected/db6d2215-48f0-464a-9d9a-c2530589cffd-kube-api-access-7qdl2\") pod \"db6d2215-48f0-464a-9d9a-c2530589cffd\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") "
Sep 19 11:03:09.241012 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.240951    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-model-cache\") pod \"69ce4712-0a58-4950-af99-a67e31c8109e\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") "
Sep 19 11:03:09.241012 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241003    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-tmp-dir\") pod \"69ce4712-0a58-4950-af99-a67e31c8109e\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") "
Sep 19 11:03:09.241343 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241032    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-dshm\") pod \"db6d2215-48f0-464a-9d9a-c2530589cffd\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") "
Sep 19 11:03:09.241343 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241060    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db6d2215-48f0-464a-9d9a-c2530589cffd-tls-certs\") pod \"db6d2215-48f0-464a-9d9a-c2530589cffd\" (UID: \"db6d2215-48f0-464a-9d9a-c2530589cffd\") "
Sep 19 11:03:09.241343 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241078    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-home" (OuterVolumeSpecName: "home") pod "db6d2215-48f0-464a-9d9a-c2530589cffd" (UID: "db6d2215-48f0-464a-9d9a-c2530589cffd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:09.241343 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241095    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db6d2215-48f0-464a-9d9a-c2530589cffd" (UID: "db6d2215-48f0-464a-9d9a-c2530589cffd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:09.241343 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241117    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ce4712-0a58-4950-af99-a67e31c8109e-tls-certs\") pod \"69ce4712-0a58-4950-af99-a67e31c8109e\" (UID: \"69ce4712-0a58-4950-af99-a67e31c8109e\") "
Sep 19 11:03:09.241343 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241281    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-model-cache" (OuterVolumeSpecName: "model-cache") pod "69ce4712-0a58-4950-af99-a67e31c8109e" (UID: "69ce4712-0a58-4950-af99-a67e31c8109e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:09.241343 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241300    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "69ce4712-0a58-4950-af99-a67e31c8109e" (UID: "69ce4712-0a58-4950-af99-a67e31c8109e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:09.241743 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241561    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.241743 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241580    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.241743 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241597    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.241743 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241610    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.241743 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241622    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.241743 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.241634    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.244420 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.244385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69ce4712-0a58-4950-af99-a67e31c8109e-kube-api-access-89fgs" (OuterVolumeSpecName: "kube-api-access-89fgs") pod "69ce4712-0a58-4950-af99-a67e31c8109e" (UID: "69ce4712-0a58-4950-af99-a67e31c8109e"). InnerVolumeSpecName "kube-api-access-89fgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:09.245042 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.245000    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69ce4712-0a58-4950-af99-a67e31c8109e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "69ce4712-0a58-4950-af99-a67e31c8109e" (UID: "69ce4712-0a58-4950-af99-a67e31c8109e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:03:09.245854 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.245531    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-dshm" (OuterVolumeSpecName: "dshm") pod "69ce4712-0a58-4950-af99-a67e31c8109e" (UID: "69ce4712-0a58-4950-af99-a67e31c8109e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:09.245854 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.245671    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db6d2215-48f0-464a-9d9a-c2530589cffd-kube-api-access-7qdl2" (OuterVolumeSpecName: "kube-api-access-7qdl2") pod "db6d2215-48f0-464a-9d9a-c2530589cffd" (UID: "db6d2215-48f0-464a-9d9a-c2530589cffd"). InnerVolumeSpecName "kube-api-access-7qdl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:09.245854 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.245791    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-dshm" (OuterVolumeSpecName: "dshm") pod "db6d2215-48f0-464a-9d9a-c2530589cffd" (UID: "db6d2215-48f0-464a-9d9a-c2530589cffd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:09.246080 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.245894    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6d2215-48f0-464a-9d9a-c2530589cffd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db6d2215-48f0-464a-9d9a-c2530589cffd" (UID: "db6d2215-48f0-464a-9d9a-c2530589cffd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:03:09.343018 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.342980    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89fgs\" (UniqueName: \"kubernetes.io/projected/69ce4712-0a58-4950-af99-a67e31c8109e-kube-api-access-89fgs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.343018 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.343012    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qdl2\" (UniqueName: \"kubernetes.io/projected/db6d2215-48f0-464a-9d9a-c2530589cffd-kube-api-access-7qdl2\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.343018 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.343022    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db6d2215-48f0-464a-9d9a-c2530589cffd-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.343018 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.343031    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db6d2215-48f0-464a-9d9a-c2530589cffd-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.343293 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.343039    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ce4712-0a58-4950-af99-a67e31c8109e-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.343293 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.343047    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69ce4712-0a58-4950-af99-a67e31c8109e-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:09.730045 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.730011    2563 generic.go:356] "Generic (PLEG): container finished" podID="db6d2215-48f0-464a-9d9a-c2530589cffd" containerID="b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2" exitCode=0
Sep 19 11:03:09.730242 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.730067    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"
Sep 19 11:03:09.730242 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.730092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4" event={"ID":"db6d2215-48f0-464a-9d9a-c2530589cffd","Type":"ContainerDied","Data":"b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2"}
Sep 19 11:03:09.730242 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.730140    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4" event={"ID":"db6d2215-48f0-464a-9d9a-c2530589cffd","Type":"ContainerDied","Data":"89cc324cf1874a0154905fc41a6260d38269687a1b5c66feb01af0b6d5e77111"}
Sep 19 11:03:09.730242 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.730160    2563 scope.go:117] "RemoveContainer" containerID="b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2"
Sep 19 11:03:09.731617 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.731588    2563 generic.go:356] "Generic (PLEG): container finished" podID="69ce4712-0a58-4950-af99-a67e31c8109e" containerID="cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95" exitCode=0
Sep 19 11:03:09.731742 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.731699    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"
Sep 19 11:03:09.731742 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.731706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf" event={"ID":"69ce4712-0a58-4950-af99-a67e31c8109e","Type":"ContainerDied","Data":"cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95"}
Sep 19 11:03:09.731825 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.731749    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf" event={"ID":"69ce4712-0a58-4950-af99-a67e31c8109e","Type":"ContainerDied","Data":"1af66fe989a78b1897b3bea41fe4f59043f00a21d7812f9826c041d5ae57f76d"}
Sep 19 11:03:09.743791 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.743517    2563 scope.go:117] "RemoveContainer" containerID="b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2"
Sep 19 11:03:09.744113 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:03:09.744088    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2\": container with ID starting with b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2 not found: ID does not exist" containerID="b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2"
Sep 19 11:03:09.744211 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.744120    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2"} err="failed to get container status \"b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2\": rpc error: code = NotFound desc = could not find container \"b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2\": container with ID starting with b583a9ccd4ce60b052179501fb241fa33bf249ecb18b1175fe438b300ad6ebd2 not found: ID does not exist"
Sep 19 11:03:09.744211 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.744137    2563 scope.go:117] "RemoveContainer" containerID="cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95"
Sep 19 11:03:09.754183 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.754158    2563 scope.go:117] "RemoveContainer" containerID="cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95"
Sep 19 11:03:09.754627 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:03:09.754597    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95\": container with ID starting with cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95 not found: ID does not exist" containerID="cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95"
Sep 19 11:03:09.754728 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.754635    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95"} err="failed to get container status \"cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95\": rpc error: code = NotFound desc = could not find container \"cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95\": container with ID starting with cae93441a62dc6db06b0aee32e2e6e9f1623f03040b8a70f29869f569ac9fc95 not found: ID does not exist"
Sep 19 11:03:09.757007 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.756982    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"]
Sep 19 11:03:09.759600 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.759575    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/distinct-2-w4-5116ec-kserve-59f4777cfc-btvq4"]
Sep 19 11:03:09.767820 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.767792    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"]
Sep 19 11:03:09.771619 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:09.771591    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5116ec/premium-w4-5116ec-kserve-6c66f85d8c-76vkf"]
Sep 19 11:03:10.119472 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:10.119442    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69ce4712-0a58-4950-af99-a67e31c8109e" path="/var/lib/kubelet/pods/69ce4712-0a58-4950-af99-a67e31c8109e/volumes"
Sep 19 11:03:10.119910 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:10.119894    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db6d2215-48f0-464a-9d9a-c2530589cffd" path="/var/lib/kubelet/pods/db6d2215-48f0-464a-9d9a-c2530589cffd/volumes"
Sep 19 11:03:11.214435 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:11.214400    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"]
Sep 19 11:03:11.214934 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:11.214636    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy" containerID="cri-o://4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f" gracePeriod=30
Sep 19 11:03:11.647996 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:11.647960    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 11:03:11.648152 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:11.648032    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 11:03:16.457887 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.457860    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 11:03:16.508663 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508580    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-socket\") pod \"e61ba681-ce00-4c89-964e-7019aa80608c\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") "
Sep 19 11:03:16.508663 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508619    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-istio-token\") pod \"e61ba681-ce00-4c89-964e-7019aa80608c\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") "
Sep 19 11:03:16.508890 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508677    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb9qn\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-kube-api-access-hb9qn\") pod \"e61ba681-ce00-4c89-964e-7019aa80608c\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") "
Sep 19 11:03:16.508890 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508703    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-credential-socket\") pod \"e61ba681-ce00-4c89-964e-7019aa80608c\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") "
Sep 19 11:03:16.508890 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508782    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61ba681-ce00-4c89-964e-7019aa80608c-istiod-ca-cert\") pod \"e61ba681-ce00-4c89-964e-7019aa80608c\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") "
Sep 19 11:03:16.508890 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508803    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61ba681-ce00-4c89-964e-7019aa80608c-istio-podinfo\") pod \"e61ba681-ce00-4c89-964e-7019aa80608c\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") "
Sep 19 11:03:16.508890 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508840    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-certs\") pod \"e61ba681-ce00-4c89-964e-7019aa80608c\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") "
Sep 19 11:03:16.508890 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508863    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e61ba681-ce00-4c89-964e-7019aa80608c" (UID: "e61ba681-ce00-4c89-964e-7019aa80608c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:16.508890 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508873    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-envoy\") pod \"e61ba681-ce00-4c89-964e-7019aa80608c\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") "
Sep 19 11:03:16.509287 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.508938    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-data\") pod \"e61ba681-ce00-4c89-964e-7019aa80608c\" (UID: \"e61ba681-ce00-4c89-964e-7019aa80608c\") "
Sep 19 11:03:16.509287 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.509211    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e61ba681-ce00-4c89-964e-7019aa80608c" (UID: "e61ba681-ce00-4c89-964e-7019aa80608c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:16.509287 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.509215    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e61ba681-ce00-4c89-964e-7019aa80608c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e61ba681-ce00-4c89-964e-7019aa80608c" (UID: "e61ba681-ce00-4c89-964e-7019aa80608c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:03:16.509287 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.509278    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e61ba681-ce00-4c89-964e-7019aa80608c" (UID: "e61ba681-ce00-4c89-964e-7019aa80608c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:16.509501 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.509380    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-data" (OuterVolumeSpecName: "istio-data") pod "e61ba681-ce00-4c89-964e-7019aa80608c" (UID: "e61ba681-ce00-4c89-964e-7019aa80608c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:16.509501 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.509432    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:16.509501 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.509451    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61ba681-ce00-4c89-964e-7019aa80608c-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:16.509501 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.509465    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:16.509501 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.509478    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:16.510963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.510936    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e61ba681-ce00-4c89-964e-7019aa80608c" (UID: "e61ba681-ce00-4c89-964e-7019aa80608c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:16.511081 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.511019    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e61ba681-ce00-4c89-964e-7019aa80608c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e61ba681-ce00-4c89-964e-7019aa80608c" (UID: "e61ba681-ce00-4c89-964e-7019aa80608c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:03:16.511081 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.511037    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-istio-token" (OuterVolumeSpecName: "istio-token") pod "e61ba681-ce00-4c89-964e-7019aa80608c" (UID: "e61ba681-ce00-4c89-964e-7019aa80608c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:16.511163 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.511079    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-kube-api-access-hb9qn" (OuterVolumeSpecName: "kube-api-access-hb9qn") pod "e61ba681-ce00-4c89-964e-7019aa80608c" (UID: "e61ba681-ce00-4c89-964e-7019aa80608c"). InnerVolumeSpecName "kube-api-access-hb9qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:16.610933 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.610894    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61ba681-ce00-4c89-964e-7019aa80608c-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:16.610933 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.610928    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:16.610933 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.610938    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61ba681-ce00-4c89-964e-7019aa80608c-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:16.611174 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.610949    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:16.611174 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.610961    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb9qn\" (UniqueName: \"kubernetes.io/projected/e61ba681-ce00-4c89-964e-7019aa80608c-kube-api-access-hb9qn\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:16.781441 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.781349    2563 generic.go:356] "Generic (PLEG): container finished" podID="e61ba681-ce00-4c89-964e-7019aa80608c" containerID="4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f" exitCode=0
Sep 19 11:03:16.781441 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.781401    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"
Sep 19 11:03:16.781441 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.781431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" event={"ID":"e61ba681-ce00-4c89-964e-7019aa80608c","Type":"ContainerDied","Data":"4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f"}
Sep 19 11:03:16.781755 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.781487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2" event={"ID":"e61ba681-ce00-4c89-964e-7019aa80608c","Type":"ContainerDied","Data":"89237236511ec41ae1cc978875cdb4d920fe94c65d53eeedf5a918540781c49f"}
Sep 19 11:03:16.781755 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.781510    2563 scope.go:117] "RemoveContainer" containerID="4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f"
Sep 19 11:03:16.791975 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.791956    2563 scope.go:117] "RemoveContainer" containerID="0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78"
Sep 19 11:03:16.800631 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.800612    2563 scope.go:117] "RemoveContainer" containerID="4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f"
Sep 19 11:03:16.800929 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:03:16.800906    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f\": container with ID starting with 4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f not found: ID does not exist" containerID="4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f"
Sep 19 11:03:16.801010 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.800939    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f"} err="failed to get container status \"4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f\": rpc error: code = NotFound desc = could not find container \"4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f\": container with ID starting with 4526b7169e20147ae2bdc77cd4f6acc1ad58670f46225dd082542f6b7e6e977f not found: ID does not exist"
Sep 19 11:03:16.801010 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.800956    2563 scope.go:117] "RemoveContainer" containerID="0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78"
Sep 19 11:03:16.801288 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:03:16.801264    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78\": container with ID starting with 0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78 not found: ID does not exist" containerID="0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78"
Sep 19 11:03:16.801288 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.801314    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78"} err="failed to get container status \"0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78\": rpc error: code = NotFound desc = could not find container \"0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78\": container with ID starting with 0eeae0f691e8bce52571619e7d530a3b70b124fef124aa8f8e61c7a9ee517a78 not found: ID does not exist"
Sep 19 11:03:16.804446 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.804425    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"]
Sep 19 11:03:16.809313 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:16.809290    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-5116ec-openshift-default-78d94f9994-c9bt2"]
Sep 19 11:03:18.118057 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:18.118024    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" path="/var/lib/kubelet/pods/e61ba681-ce00-4c89-964e-7019aa80608c/volumes"
Sep 19 11:03:38.498629 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:38.498591    2563 scope.go:117] "RemoveContainer" containerID="5406b1140dc3b8f82e2bfd8ca6fec3597295009bbef07df02859cb6a071a942c"
Sep 19 11:03:40.234087 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:40.234049    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"]
Sep 19 11:03:55.254100 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.254042    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6" podUID="4ad40556-a176-4e8b-82d5-ace52fa53bab" containerName="main" containerID="cri-o://c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3" gracePeriod=45
Sep 19 11:03:55.509736 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.509671    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 11:03:55.583446 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.583417    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-dshm\") pod \"4ad40556-a176-4e8b-82d5-ace52fa53bab\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") "
Sep 19 11:03:55.583682 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.583479    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-home\") pod \"4ad40556-a176-4e8b-82d5-ace52fa53bab\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") "
Sep 19 11:03:55.583682 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.583503    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad40556-a176-4e8b-82d5-ace52fa53bab-tls-certs\") pod \"4ad40556-a176-4e8b-82d5-ace52fa53bab\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") "
Sep 19 11:03:55.583682 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.583540    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-tmp-dir\") pod \"4ad40556-a176-4e8b-82d5-ace52fa53bab\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") "
Sep 19 11:03:55.583682 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.583596    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-model-cache\") pod \"4ad40556-a176-4e8b-82d5-ace52fa53bab\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") "
Sep 19 11:03:55.583682 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.583669    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfgnk\" (UniqueName: \"kubernetes.io/projected/4ad40556-a176-4e8b-82d5-ace52fa53bab-kube-api-access-xfgnk\") pod \"4ad40556-a176-4e8b-82d5-ace52fa53bab\" (UID: \"4ad40556-a176-4e8b-82d5-ace52fa53bab\") "
Sep 19 11:03:55.583966 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.583808    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-home" (OuterVolumeSpecName: "home") pod "4ad40556-a176-4e8b-82d5-ace52fa53bab" (UID: "4ad40556-a176-4e8b-82d5-ace52fa53bab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:55.583966 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.583854    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4ad40556-a176-4e8b-82d5-ace52fa53bab" (UID: "4ad40556-a176-4e8b-82d5-ace52fa53bab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:55.583966 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.583943    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-model-cache" (OuterVolumeSpecName: "model-cache") pod "4ad40556-a176-4e8b-82d5-ace52fa53bab" (UID: "4ad40556-a176-4e8b-82d5-ace52fa53bab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:55.584108 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.584058    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:55.584108 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.584077    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:55.584108 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.584092    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:55.586241 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.586217    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad40556-a176-4e8b-82d5-ace52fa53bab-kube-api-access-xfgnk" (OuterVolumeSpecName: "kube-api-access-xfgnk") pod "4ad40556-a176-4e8b-82d5-ace52fa53bab" (UID: "4ad40556-a176-4e8b-82d5-ace52fa53bab"). InnerVolumeSpecName "kube-api-access-xfgnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:55.586358 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.586338    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-dshm" (OuterVolumeSpecName: "dshm") pod "4ad40556-a176-4e8b-82d5-ace52fa53bab" (UID: "4ad40556-a176-4e8b-82d5-ace52fa53bab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:55.586404 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.586354    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ad40556-a176-4e8b-82d5-ace52fa53bab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4ad40556-a176-4e8b-82d5-ace52fa53bab" (UID: "4ad40556-a176-4e8b-82d5-ace52fa53bab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:03:55.685174 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.685139    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfgnk\" (UniqueName: \"kubernetes.io/projected/4ad40556-a176-4e8b-82d5-ace52fa53bab-kube-api-access-xfgnk\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:55.685174 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.685170    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad40556-a176-4e8b-82d5-ace52fa53bab-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:55.685174 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:55.685182    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad40556-a176-4e8b-82d5-ace52fa53bab-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:03:56.018276 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.018246    2563 generic.go:356] "Generic (PLEG): container finished" podID="4ad40556-a176-4e8b-82d5-ace52fa53bab" containerID="c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3" exitCode=0
Sep 19 11:03:56.018460 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.018286    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"
Sep 19 11:03:56.018460 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.018323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6" event={"ID":"4ad40556-a176-4e8b-82d5-ace52fa53bab","Type":"ContainerDied","Data":"c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3"}
Sep 19 11:03:56.018460 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.018369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6" event={"ID":"4ad40556-a176-4e8b-82d5-ace52fa53bab","Type":"ContainerDied","Data":"348c62ad469497b1c7e7ca8e71306c5937c5ace2312af1c4c5f2c4dc33eaa0b0"}
Sep 19 11:03:56.018460 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.018387    2563 scope.go:117] "RemoveContainer" containerID="c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3"
Sep 19 11:03:56.028035 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.028018    2563 scope.go:117] "RemoveContainer" containerID="c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3"
Sep 19 11:03:56.028312 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:03:56.028292    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3\": container with ID starting with c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3 not found: ID does not exist" containerID="c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3"
Sep 19 11:03:56.028358 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.028320    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3"} err="failed to get container status \"c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3\": rpc error: code = NotFound desc = could not find container \"c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3\": container with ID starting with c9c6b71ebcfef49c96e20a39eeec231353f793e459a45d62c81eb64ff31545d3 not found: ID does not exist"
Sep 19 11:03:56.039494 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.039468    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"]
Sep 19 11:03:56.042737 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.042708    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/auth-test-model-9b3bef-kserve-67cd65cf6c-cb4q6"]
Sep 19 11:03:56.118784 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:03:56.118754    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ad40556-a176-4e8b-82d5-ace52fa53bab" path="/var/lib/kubelet/pods/4ad40556-a176-4e8b-82d5-ace52fa53bab/volumes"
Sep 19 11:04:09.712860 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.712823    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"]
Sep 19 11:04:09.713485 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713465    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bdd084-ef81-4dd3-9fbb-225328fef993" containerName="revoke-keys"
Sep 19 11:04:09.713531 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713488    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bdd084-ef81-4dd3-9fbb-225328fef993" containerName="revoke-keys"
Sep 19 11:04:09.713531 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713513    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy"
Sep 19 11:04:09.713531 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713521    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713538    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68abc6a1-6824-4794-b65d-8849b22e06c2" containerName="payload-processing"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713564    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68abc6a1-6824-4794-b65d-8849b22e06c2" containerName="payload-processing"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713582    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad40556-a176-4e8b-82d5-ace52fa53bab" containerName="main"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713591    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad40556-a176-4e8b-82d5-ace52fa53bab" containerName="main"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713606    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69ce4712-0a58-4950-af99-a67e31c8109e" containerName="main"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713615    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69ce4712-0a58-4950-af99-a67e31c8109e" containerName="main"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713629    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713637    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713650    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6d2215-48f0-464a-9d9a-c2530589cffd" containerName="main"
Sep 19 11:04:09.713669 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713658    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6d2215-48f0-464a-9d9a-c2530589cffd" containerName="main"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713676    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" containerName="main"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713684    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" containerName="main"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713780    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6bdd084-ef81-4dd3-9fbb-225328fef993" containerName="revoke-keys"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713794    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6d2215-48f0-464a-9d9a-c2530589cffd" containerName="main"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713804    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713816    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="68abc6a1-6824-4794-b65d-8849b22e06c2" containerName="payload-processing"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713827    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e61ba681-ce00-4c89-964e-7019aa80608c" containerName="istio-proxy"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713837    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="69ce4712-0a58-4950-af99-a67e31c8109e" containerName="main"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713846    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ad40556-a176-4e8b-82d5-ace52fa53bab" containerName="main"
Sep 19 11:04:09.713963 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.713856    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd94a1a-282a-4176-9f7a-fb6cc0ed221f" containerName="main"
Sep 19 11:04:09.717148 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.717131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.720920 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.720633    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-9b3bef\"/\"default-dockercfg-z6csr\""
Sep 19 11:04:09.720920 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.720699    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-9b3bef\"/\"sub-test-model-9b3bef-kserve-self-signed-certs\""
Sep 19 11:04:09.720920 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.720633    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-9b3bef\"/\"kube-root-ca.crt\""
Sep 19 11:04:09.721200 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.721022    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-9b3bef\"/\"openshift-service-ca.crt\""
Sep 19 11:04:09.723090 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.723067    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"]
Sep 19 11:04:09.808795 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.808758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-model-cache\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.808984 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.808805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-home\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.808984 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.808822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-dshm\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.808984 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.808908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-tmp-dir\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.808984 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.808950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9qmw\" (UniqueName: \"kubernetes.io/projected/1f44c728-a913-42e3-950d-5bdf35576361-kube-api-access-c9qmw\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.809131 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.809008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f44c728-a913-42e3-950d-5bdf35576361-tls-certs\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.910091 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.910040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9qmw\" (UniqueName: \"kubernetes.io/projected/1f44c728-a913-42e3-950d-5bdf35576361-kube-api-access-c9qmw\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.910297 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.910127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f44c728-a913-42e3-950d-5bdf35576361-tls-certs\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.910297 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.910173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-model-cache\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.910297 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.910218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-home\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.910297 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.910247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-dshm\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.910536 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.910332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-tmp-dir\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.910850 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.910820    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-tmp-dir\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.911130 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.911105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-home\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.911319 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.911280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-model-cache\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.913711 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.913685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-dshm\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.913879 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.913862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f44c728-a913-42e3-950d-5bdf35576361-tls-certs\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:09.919498 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:09.919457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9qmw\" (UniqueName: \"kubernetes.io/projected/1f44c728-a913-42e3-950d-5bdf35576361-kube-api-access-c9qmw\") pod \"sub-test-model-9b3bef-kserve-77cdf646d9-ldbld\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") " pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:10.029427 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:10.029335    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:10.306718 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:10.306691    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"]
Sep 19 11:04:10.309656 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:04:10.309624    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f44c728_a913_42e3_950d_5bdf35576361.slice/crio-014cf7dab5e3075fa7c013bd3c324f26a6e7f834dabaa5a11a4259dd177bac14 WatchSource:0}: Error finding container 014cf7dab5e3075fa7c013bd3c324f26a6e7f834dabaa5a11a4259dd177bac14: Status 404 returned error can't find the container with id 014cf7dab5e3075fa7c013bd3c324f26a6e7f834dabaa5a11a4259dd177bac14
Sep 19 11:04:11.110597 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:11.110564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld" event={"ID":"1f44c728-a913-42e3-950d-5bdf35576361","Type":"ContainerStarted","Data":"9642c59aa5316ecbab48d6ff92d6cc4c74fa2d245d74300c8ff37691c11e9b3a"}
Sep 19 11:04:11.110597 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:11.110605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld" event={"ID":"1f44c728-a913-42e3-950d-5bdf35576361","Type":"ContainerStarted","Data":"014cf7dab5e3075fa7c013bd3c324f26a6e7f834dabaa5a11a4259dd177bac14"}
Sep 19 11:04:11.128342 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:11.128290    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld" podStartSLOduration=2.128269578 podStartE2EDuration="2.128269578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:04:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:04:11.127048418 +0000 UTC m=+1655.060754629" watchObservedRunningTime="2026-09-19 11:04:11.128269578 +0000 UTC m=+1655.061975792"
Sep 19 11:04:20.030275 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:20.030225    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:20.030805 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:20.030300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:20.043129 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:20.043089    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:20.175201 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:20.175173    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:04:38.543123 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:38.543090    2563 scope.go:117] "RemoveContainer" containerID="e7772df6ef2e34fba3538f9b5e1e38a5ed6bc986a4b580ac2c1c9b9d306bb914"
Sep 19 11:04:47.198251 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:04:47.198220    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"]
Sep 19 11:05:02.217377 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.217286    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld" podUID="1f44c728-a913-42e3-950d-5bdf35576361" containerName="main" containerID="cri-o://9642c59aa5316ecbab48d6ff92d6cc4c74fa2d245d74300c8ff37691c11e9b3a" gracePeriod=45
Sep 19 11:05:02.415784 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.415751    2563 generic.go:356] "Generic (PLEG): container finished" podID="1f44c728-a913-42e3-950d-5bdf35576361" containerID="9642c59aa5316ecbab48d6ff92d6cc4c74fa2d245d74300c8ff37691c11e9b3a" exitCode=0
Sep 19 11:05:02.415944 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.415833    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld" event={"ID":"1f44c728-a913-42e3-950d-5bdf35576361","Type":"ContainerDied","Data":"9642c59aa5316ecbab48d6ff92d6cc4c74fa2d245d74300c8ff37691c11e9b3a"}
Sep 19 11:05:02.467073 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.467049    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:05:02.525151 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525064    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-home\") pod \"1f44c728-a913-42e3-950d-5bdf35576361\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") "
Sep 19 11:05:02.525151 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525116    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-tmp-dir\") pod \"1f44c728-a913-42e3-950d-5bdf35576361\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") "
Sep 19 11:05:02.525383 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525151    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f44c728-a913-42e3-950d-5bdf35576361-tls-certs\") pod \"1f44c728-a913-42e3-950d-5bdf35576361\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") "
Sep 19 11:05:02.525383 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525195    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-model-cache\") pod \"1f44c728-a913-42e3-950d-5bdf35576361\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") "
Sep 19 11:05:02.525383 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525220    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-dshm\") pod \"1f44c728-a913-42e3-950d-5bdf35576361\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") "
Sep 19 11:05:02.525383 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525315    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9qmw\" (UniqueName: \"kubernetes.io/projected/1f44c728-a913-42e3-950d-5bdf35576361-kube-api-access-c9qmw\") pod \"1f44c728-a913-42e3-950d-5bdf35576361\" (UID: \"1f44c728-a913-42e3-950d-5bdf35576361\") "
Sep 19 11:05:02.525383 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525342    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-home" (OuterVolumeSpecName: "home") pod "1f44c728-a913-42e3-950d-5bdf35576361" (UID: "1f44c728-a913-42e3-950d-5bdf35576361"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:05:02.525649 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525419    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f44c728-a913-42e3-950d-5bdf35576361" (UID: "1f44c728-a913-42e3-950d-5bdf35576361"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:05:02.525649 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f44c728-a913-42e3-950d-5bdf35576361" (UID: "1f44c728-a913-42e3-950d-5bdf35576361"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:05:02.525758 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525651    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:05:02.525758 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525669    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:05:02.525758 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.525683    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:05:02.527434 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.527409    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-dshm" (OuterVolumeSpecName: "dshm") pod "1f44c728-a913-42e3-950d-5bdf35576361" (UID: "1f44c728-a913-42e3-950d-5bdf35576361"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:05:02.527434 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.527426    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f44c728-a913-42e3-950d-5bdf35576361-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f44c728-a913-42e3-950d-5bdf35576361" (UID: "1f44c728-a913-42e3-950d-5bdf35576361"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:05:02.527619 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.527445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f44c728-a913-42e3-950d-5bdf35576361-kube-api-access-c9qmw" (OuterVolumeSpecName: "kube-api-access-c9qmw") pod "1f44c728-a913-42e3-950d-5bdf35576361" (UID: "1f44c728-a913-42e3-950d-5bdf35576361"). InnerVolumeSpecName "kube-api-access-c9qmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:05:02.626902 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.626863    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9qmw\" (UniqueName: \"kubernetes.io/projected/1f44c728-a913-42e3-950d-5bdf35576361-kube-api-access-c9qmw\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:05:02.626902 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.626895    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f44c728-a913-42e3-950d-5bdf35576361-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:05:02.626902 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:02.626905    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f44c728-a913-42e3-950d-5bdf35576361-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:05:03.424633 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:03.424607    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"
Sep 19 11:05:03.424633 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:03.424615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld" event={"ID":"1f44c728-a913-42e3-950d-5bdf35576361","Type":"ContainerDied","Data":"014cf7dab5e3075fa7c013bd3c324f26a6e7f834dabaa5a11a4259dd177bac14"}
Sep 19 11:05:03.425137 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:03.424666    2563 scope.go:117] "RemoveContainer" containerID="9642c59aa5316ecbab48d6ff92d6cc4c74fa2d245d74300c8ff37691c11e9b3a"
Sep 19 11:05:03.453978 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:03.453952    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"]
Sep 19 11:05:03.457971 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:03.457944    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-9b3bef/sub-test-model-9b3bef-kserve-77cdf646d9-ldbld"]
Sep 19 11:05:04.119004 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:05:04.118969    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f44c728-a913-42e3-950d-5bdf35576361" path="/var/lib/kubelet/pods/1f44c728-a913-42e3-950d-5bdf35576361/volumes"
Sep 19 11:06:02.540790 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.540754    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"]
Sep 19 11:06:02.543397 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.541847    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f44c728-a913-42e3-950d-5bdf35576361" containerName="main"
Sep 19 11:06:02.543397 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.541868    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f44c728-a913-42e3-950d-5bdf35576361" containerName="main"
Sep 19 11:06:02.543397 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.541967    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f44c728-a913-42e3-950d-5bdf35576361" containerName="main"
Sep 19 11:06:02.550693 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.550670    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"]
Sep 19 11:06:02.550837 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.550759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.553096 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.553072    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b52037-openshift-default-dockercfg-v5749\""
Sep 19 11:06:02.697509 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.697471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-credential-socket\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.697722 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.697525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-certs\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.697722 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.697619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-envoy\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.697722 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.697662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-socket\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.697722 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.697689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-data\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.697722 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.697706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5072b42-9168-4900-ab91-fcc1e18662a6-istiod-ca-cert\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.697925 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.697803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bczfb\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-kube-api-access-bczfb\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.697925 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.697836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-podinfo\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.697925 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.697854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-token\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.798929 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.798845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-credential-socket\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.798929 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.798892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-certs\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.798929 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.798922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-envoy\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799219 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.798957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-socket\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799219 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.798979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-data\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799219 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.798998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5072b42-9168-4900-ab91-fcc1e18662a6-istiod-ca-cert\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799219 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.799030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bczfb\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-kube-api-access-bczfb\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799219 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.799054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-podinfo\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799219 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.799081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-token\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799498 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.799284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-certs\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799498 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.799411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-socket\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799681 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.799511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-data\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799681 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.799639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-credential-socket\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.799785 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.799739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5072b42-9168-4900-ab91-fcc1e18662a6-istiod-ca-cert\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.801622 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.801594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-envoy\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.801823 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.801803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-podinfo\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.806944 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.806920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-token\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.807759 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.807735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bczfb\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-kube-api-access-bczfb\") pod \"e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") " pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:02.861444 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:02.861412    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:03.138428 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:03.138402    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"]
Sep 19 11:06:03.140767 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:06:03.140735    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5072b42_9168_4900_ab91_fcc1e18662a6.slice/crio-8ea88bcf18733bcbbe7f50895e98decdcdefe3b7b817ecf936bf35c699ef5cad WatchSource:0}: Error finding container 8ea88bcf18733bcbbe7f50895e98decdcdefe3b7b817ecf936bf35c699ef5cad: Status 404 returned error can't find the container with id 8ea88bcf18733bcbbe7f50895e98decdcdefe3b7b817ecf936bf35c699ef5cad
Sep 19 11:06:03.143048 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:03.143018    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:06:03.143152 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:03.143080    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:06:03.143152 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:03.143106    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:06:03.774247 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:03.774202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" event={"ID":"e5072b42-9168-4900-ab91-fcc1e18662a6","Type":"ContainerStarted","Data":"44a0fa7d4737d28e1d0c9dbababb485187aceb553ff6cd2cec95ca3b308bf027"}
Sep 19 11:06:03.774757 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:03.774279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" event={"ID":"e5072b42-9168-4900-ab91-fcc1e18662a6","Type":"ContainerStarted","Data":"8ea88bcf18733bcbbe7f50895e98decdcdefe3b7b817ecf936bf35c699ef5cad"}
Sep 19 11:06:03.794436 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:03.794370    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" podStartSLOduration=1.7943557650000002 podStartE2EDuration="1.794355765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:06:03.791907621 +0000 UTC m=+1767.725613861" watchObservedRunningTime="2026-09-19 11:06:03.794355765 +0000 UTC m=+1767.728061978"
Sep 19 11:06:03.862244 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:03.862209    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:04.867440 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:04.867405    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:05.785823 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:05.785794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:05.786895 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:05.786872    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:07.936467 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:07.936429    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"]
Sep 19 11:06:07.939832 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:07.939814    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:07.942081 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:07.942047    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b52037\""
Sep 19 11:06:07.942208 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:07.942104    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b52037-dockercfg-q952g\""
Sep 19 11:06:07.953123 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:07.953093    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"]
Sep 19 11:06:07.960623 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:07.960598    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"]
Sep 19 11:06:07.963987 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:07.963971    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:07.975359 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:07.975326    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"]
Sep 19 11:06:08.052807 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.052769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fcqd\" (UniqueName: \"kubernetes.io/projected/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-kube-api-access-4fcqd\") pod \"payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm\" (UID: \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:08.053194 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.053172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msn88\" (UniqueName: \"kubernetes.io/projected/403786d8-13e2-45c9-8277-042457dc23a7-kube-api-access-msn88\") pod \"payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf\" (UID: \"403786d8-13e2-45c9-8277-042457dc23a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:08.053360 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.053346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm\" (UID: \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:08.053521 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.053506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/403786d8-13e2-45c9-8277-042457dc23a7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf\" (UID: \"403786d8-13e2-45c9-8277-042457dc23a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:08.154278 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.154237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msn88\" (UniqueName: \"kubernetes.io/projected/403786d8-13e2-45c9-8277-042457dc23a7-kube-api-access-msn88\") pod \"payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf\" (UID: \"403786d8-13e2-45c9-8277-042457dc23a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:08.154278 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.154287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm\" (UID: \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:08.154513 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.154341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/403786d8-13e2-45c9-8277-042457dc23a7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf\" (UID: \"403786d8-13e2-45c9-8277-042457dc23a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:08.154513 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.154423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fcqd\" (UniqueName: \"kubernetes.io/projected/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-kube-api-access-4fcqd\") pod \"payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm\" (UID: \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:08.154965 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.154948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm\" (UID: \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:08.155127 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.155111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/403786d8-13e2-45c9-8277-042457dc23a7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf\" (UID: \"403786d8-13e2-45c9-8277-042457dc23a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:08.161986 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.161964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fcqd\" (UniqueName: \"kubernetes.io/projected/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-kube-api-access-4fcqd\") pod \"payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm\" (UID: \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:08.162107 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.162071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msn88\" (UniqueName: \"kubernetes.io/projected/403786d8-13e2-45c9-8277-042457dc23a7-kube-api-access-msn88\") pod \"payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf\" (UID: \"403786d8-13e2-45c9-8277-042457dc23a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:08.259695 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.259621    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:08.276697 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.276671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:08.536570 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.536527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"]
Sep 19 11:06:08.538767 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:06:08.538731    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782fedcc_f0b3_4bb8_b9f4_f1f78b88b71b.slice/crio-faba6c25ecc645588c4f0cda5e9a0a527d8d3ce45459a2c71a15f30027207c6e WatchSource:0}: Error finding container faba6c25ecc645588c4f0cda5e9a0a527d8d3ce45459a2c71a15f30027207c6e: Status 404 returned error can't find the container with id faba6c25ecc645588c4f0cda5e9a0a527d8d3ce45459a2c71a15f30027207c6e
Sep 19 11:06:08.557880 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.557859    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"]
Sep 19 11:06:08.559364 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:06:08.559337    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403786d8_13e2_45c9_8277_042457dc23a7.slice/crio-772672cf087d2d71284223101e9255b3b7a992b46a1406e196e5b17d10d352bb WatchSource:0}: Error finding container 772672cf087d2d71284223101e9255b3b7a992b46a1406e196e5b17d10d352bb: Status 404 returned error can't find the container with id 772672cf087d2d71284223101e9255b3b7a992b46a1406e196e5b17d10d352bb
Sep 19 11:06:08.807795 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.807681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm" event={"ID":"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b","Type":"ContainerStarted","Data":"1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7"}
Sep 19 11:06:08.807795 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.807752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm" event={"ID":"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b","Type":"ContainerStarted","Data":"faba6c25ecc645588c4f0cda5e9a0a527d8d3ce45459a2c71a15f30027207c6e"}
Sep 19 11:06:08.807795 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.807781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:08.809612 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.809580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf" event={"ID":"403786d8-13e2-45c9-8277-042457dc23a7","Type":"ContainerStarted","Data":"a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0"}
Sep 19 11:06:08.809735 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.809640    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:08.809735 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.809662    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf" event={"ID":"403786d8-13e2-45c9-8277-042457dc23a7","Type":"ContainerStarted","Data":"772672cf087d2d71284223101e9255b3b7a992b46a1406e196e5b17d10d352bb"}
Sep 19 11:06:08.823715 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.823657    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm" podStartSLOduration=1.823625657 podStartE2EDuration="1.823625657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:06:08.823093842 +0000 UTC m=+1772.756800079" watchObservedRunningTime="2026-09-19 11:06:08.823625657 +0000 UTC m=+1772.757331873"
Sep 19 11:06:08.839733 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:08.839678    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf" podStartSLOduration=1.839660663 podStartE2EDuration="1.839660663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:06:08.837449117 +0000 UTC m=+1772.771155349" watchObservedRunningTime="2026-09-19 11:06:08.839660663 +0000 UTC m=+1772.773366877"
Sep 19 11:06:19.818178 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:19.818092    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:06:19.818722 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:19.818181    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:06:36.828749 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:36.828702    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 11:06:36.829152 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:36.828783    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 11:06:38.256344 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:38.256319    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 11:06:38.264674 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:38.264649    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 11:06:38.588532 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:38.588496    2563 scope.go:117] "RemoveContainer" containerID="ab9d86b757808f1b2024e05874711e639fbbd6806d85943a7caf43bcdd90ac2b"
Sep 19 11:06:38.597276 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:38.597251    2563 scope.go:117] "RemoveContainer" containerID="fbc36ead163c857af68f27eab49e2ea694bcf6a0c80bb13dfb3b0e809d628bc6"
Sep 19 11:06:38.607647 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:38.607622    2563 scope.go:117] "RemoveContainer" containerID="375c6b89221ac7431664df7cedab5590467dc3e2e8d972d668ec16d22486fbc7"
Sep 19 11:06:38.999753 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:38.999661    2563 generic.go:356] "Generic (PLEG): container finished" podID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerID="44a0fa7d4737d28e1d0c9dbababb485187aceb553ff6cd2cec95ca3b308bf027" exitCode=0
Sep 19 11:06:38.999753 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:38.999719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" event={"ID":"e5072b42-9168-4900-ab91-fcc1e18662a6","Type":"ContainerDied","Data":"44a0fa7d4737d28e1d0c9dbababb485187aceb553ff6cd2cec95ca3b308bf027"}
Sep 19 11:06:39.000118 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:39.000103    2563 scope.go:117] "RemoveContainer" containerID="44a0fa7d4737d28e1d0c9dbababb485187aceb553ff6cd2cec95ca3b308bf027"
Sep 19 11:06:39.001230 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:39.001196    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:06:39.001336 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:39.001262    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:06:39.001336 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:39.001291    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:06:40.007616 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:40.007515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" event={"ID":"e5072b42-9168-4900-ab91-fcc1e18662a6","Type":"ContainerStarted","Data":"7722392f44bbab65a6be6f02b77f04e329ddf4a2d9ebf49d94acf831cfa6bbc2"}
Sep 19 11:06:40.861907 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:40.861868    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:40.862168 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:40.862145    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 19 11:06:40.862235 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:40.862191    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 19 11:06:41.862797 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:41.862757    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 19 11:06:41.863170 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:41.862819    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 19 11:06:42.861997 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:42.861959    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 19 11:06:42.862185 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:42.862031    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 19 11:06:43.862768 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:43.862730    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 19 11:06:43.863163 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:43.862789    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 19 11:06:44.861999 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:44.861962    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 19 11:06:44.862197 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:44.862020    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 19 11:06:45.865222 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:45.865190    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:45.865619 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:45.865590    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:06:45.866304 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:06:45.866284    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:07:05.114776 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:05.114715    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cmmq2_606edbe1-4a74-4ff6-923f-5b7c2be0a58c/payload-processing/0.log"
Sep 19 11:07:30.937310 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:30.937281    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf_403786d8-13e2-45c9-8277-042457dc23a7/payload-processing/0.log"
Sep 19 11:07:31.056174 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:31.056148    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cmmq2_606edbe1-4a74-4ff6-923f-5b7c2be0a58c/payload-processing/0.log"
Sep 19 11:07:37.881632 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.881595    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"]
Sep 19 11:07:37.884334 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.884317    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:07:37.886909 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.886885    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-1b9c2b-dockercfg-pdgcd\""
Sep 19 11:07:37.887053 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.887033    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-1b9c2b\""
Sep 19 11:07:37.896804 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.896778    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"]
Sep 19 11:07:37.907622 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.907584    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"]
Sep 19 11:07:37.912001 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.911973    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:37.920258 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.920231    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"]
Sep 19 11:07:37.994834 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.994796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkc8g\" (UniqueName: \"kubernetes.io/projected/034f2b2b-1d68-4669-aa68-daea3215d0e6-kube-api-access-pkc8g\") pod \"payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94\" (UID: \"034f2b2b-1d68-4669-aa68-daea3215d0e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:07:37.995094 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.995072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06d2c0f3-41b0-4717-b5ab-6b8382148594-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c\" (UID: \"06d2c0f3-41b0-4717-b5ab-6b8382148594\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:37.995237 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.995223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqvxt\" (UniqueName: \"kubernetes.io/projected/06d2c0f3-41b0-4717-b5ab-6b8382148594-kube-api-access-vqvxt\") pod \"payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c\" (UID: \"06d2c0f3-41b0-4717-b5ab-6b8382148594\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:37.995342 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:37.995327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034f2b2b-1d68-4669-aa68-daea3215d0e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94\" (UID: \"034f2b2b-1d68-4669-aa68-daea3215d0e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:07:38.096070 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.096037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkc8g\" (UniqueName: \"kubernetes.io/projected/034f2b2b-1d68-4669-aa68-daea3215d0e6-kube-api-access-pkc8g\") pod \"payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94\" (UID: \"034f2b2b-1d68-4669-aa68-daea3215d0e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:07:38.096070 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.096074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06d2c0f3-41b0-4717-b5ab-6b8382148594-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c\" (UID: \"06d2c0f3-41b0-4717-b5ab-6b8382148594\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:38.096347 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.096102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvxt\" (UniqueName: \"kubernetes.io/projected/06d2c0f3-41b0-4717-b5ab-6b8382148594-kube-api-access-vqvxt\") pod \"payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c\" (UID: \"06d2c0f3-41b0-4717-b5ab-6b8382148594\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:38.096347 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.096123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034f2b2b-1d68-4669-aa68-daea3215d0e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94\" (UID: \"034f2b2b-1d68-4669-aa68-daea3215d0e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:07:38.098362 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.098340    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-1b9c2b\""
Sep 19 11:07:38.103917 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.103889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqvxt\" (UniqueName: \"kubernetes.io/projected/06d2c0f3-41b0-4717-b5ab-6b8382148594-kube-api-access-vqvxt\") pod \"payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c\" (UID: \"06d2c0f3-41b0-4717-b5ab-6b8382148594\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:38.104063 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.104042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkc8g\" (UniqueName: \"kubernetes.io/projected/034f2b2b-1d68-4669-aa68-daea3215d0e6-kube-api-access-pkc8g\") pod \"payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94\" (UID: \"034f2b2b-1d68-4669-aa68-daea3215d0e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:07:38.107270 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.107249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034f2b2b-1d68-4669-aa68-daea3215d0e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94\" (UID: \"034f2b2b-1d68-4669-aa68-daea3215d0e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:07:38.107339 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.107317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06d2c0f3-41b0-4717-b5ab-6b8382148594-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c\" (UID: \"06d2c0f3-41b0-4717-b5ab-6b8382148594\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:38.198742 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.198655    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-1b9c2b-dockercfg-pdgcd\""
Sep 19 11:07:38.207435 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.207411    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:07:38.225721 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.225698    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:38.485890 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.485858    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"]
Sep 19 11:07:38.487478 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:07:38.487449    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034f2b2b_1d68_4669_aa68_daea3215d0e6.slice/crio-f4cc111e42cddb42b3be1fd41d445f016389f53c7715d92c3596dfbf1560868e WatchSource:0}: Error finding container f4cc111e42cddb42b3be1fd41d445f016389f53c7715d92c3596dfbf1560868e: Status 404 returned error can't find the container with id f4cc111e42cddb42b3be1fd41d445f016389f53c7715d92c3596dfbf1560868e
Sep 19 11:07:38.511867 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.511843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"]
Sep 19 11:07:38.518637 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:07:38.518611    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d2c0f3_41b0_4717_b5ab_6b8382148594.slice/crio-1c68e65dae82c494d6341934b75de5627592d0f6ac17299ff76a32c6f77087df WatchSource:0}: Error finding container 1c68e65dae82c494d6341934b75de5627592d0f6ac17299ff76a32c6f77087df: Status 404 returned error can't find the container with id 1c68e65dae82c494d6341934b75de5627592d0f6ac17299ff76a32c6f77087df
Sep 19 11:07:38.637233 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.637197    2563 scope.go:117] "RemoveContainer" containerID="e1c7aaaeb0deae5bf365acff188cb2562afa9206b60c1e93703dfe4ff6abec99"
Sep 19 11:07:38.651922 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:38.651897    2563 scope.go:117] "RemoveContainer" containerID="40dfb404cef933295b3eeeba523ae7981a3eac3373ba592f9313700b52e123f3"
Sep 19 11:07:39.379189 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:39.379150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c" event={"ID":"06d2c0f3-41b0-4717-b5ab-6b8382148594","Type":"ContainerStarted","Data":"d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea"}
Sep 19 11:07:39.379719 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:39.379212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c" event={"ID":"06d2c0f3-41b0-4717-b5ab-6b8382148594","Type":"ContainerStarted","Data":"1c68e65dae82c494d6341934b75de5627592d0f6ac17299ff76a32c6f77087df"}
Sep 19 11:07:39.379719 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:39.379275    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:39.380870 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:39.380845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94" event={"ID":"034f2b2b-1d68-4669-aa68-daea3215d0e6","Type":"ContainerStarted","Data":"1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e"}
Sep 19 11:07:39.380996 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:39.380886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94" event={"ID":"034f2b2b-1d68-4669-aa68-daea3215d0e6","Type":"ContainerStarted","Data":"f4cc111e42cddb42b3be1fd41d445f016389f53c7715d92c3596dfbf1560868e"}
Sep 19 11:07:39.380996 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:39.380910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:07:39.397189 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:39.397136    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c" podStartSLOduration=2.397119098 podStartE2EDuration="2.397119098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:07:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:07:39.395297612 +0000 UTC m=+1863.329003826" watchObservedRunningTime="2026-09-19 11:07:39.397119098 +0000 UTC m=+1863.330825353"
Sep 19 11:07:39.411490 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:39.411440    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94" podStartSLOduration=2.411422535 podStartE2EDuration="2.411422535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:07:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:07:39.409889318 +0000 UTC m=+1863.343595552" watchObservedRunningTime="2026-09-19 11:07:39.411422535 +0000 UTC m=+1863.345128748"
Sep 19 11:07:50.389577 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:50.389480    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:07:50.389577 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:07:50.389565    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:08:00.181332 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.181297    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"]
Sep 19 11:08:00.184911 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.184893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"
Sep 19 11:08:00.187257 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.187228    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:08:00.187462 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.187340    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:08:00.191719 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.191689    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"]
Sep 19 11:08:00.216790 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.216760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b908710d-a6df-4a09-a9b6-92d3a65a4895-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr\" (UID: \"b908710d-a6df-4a09-a9b6-92d3a65a4895\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"
Sep 19 11:08:00.318043 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.317998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b908710d-a6df-4a09-a9b6-92d3a65a4895-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr\" (UID: \"b908710d-a6df-4a09-a9b6-92d3a65a4895\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"
Sep 19 11:08:00.318689 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.318669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b908710d-a6df-4a09-a9b6-92d3a65a4895-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr\" (UID: \"b908710d-a6df-4a09-a9b6-92d3a65a4895\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"
Sep 19 11:08:00.497654 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.497576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"
Sep 19 11:08:00.776865 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:00.776803    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"]
Sep 19 11:08:01.507686 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:01.507650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr" event={"ID":"b908710d-a6df-4a09-a9b6-92d3a65a4895","Type":"ContainerStarted","Data":"d485df29309f1690143e5be056803e8e28e673c2b7f4c999bbb7aa46b99294b9"}
Sep 19 11:08:01.508063 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:01.507713    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr" event={"ID":"b908710d-a6df-4a09-a9b6-92d3a65a4895","Type":"ContainerStarted","Data":"57fc36e4e7c048cd843f76ad1dd9900b6500f7ebd044a4e25321aae6bad087ee"}
Sep 19 11:08:01.523566 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:01.523495    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr" podStartSLOduration=1.523478409 podStartE2EDuration="1.523478409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:08:01.520542937 +0000 UTC m=+1885.454249154" watchObservedRunningTime="2026-09-19 11:08:01.523478409 +0000 UTC m=+1885.457184627"
Sep 19 11:08:02.514689 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:02.514655    2563 generic.go:356] "Generic (PLEG): container finished" podID="b908710d-a6df-4a09-a9b6-92d3a65a4895" containerID="d485df29309f1690143e5be056803e8e28e673c2b7f4c999bbb7aa46b99294b9" exitCode=0
Sep 19 11:08:02.514689 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:02.514694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr" event={"ID":"b908710d-a6df-4a09-a9b6-92d3a65a4895","Type":"ContainerDied","Data":"d485df29309f1690143e5be056803e8e28e673c2b7f4c999bbb7aa46b99294b9"}
Sep 19 11:08:03.658949 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:03.658920    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"
Sep 19 11:08:03.748462 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:03.748428    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b908710d-a6df-4a09-a9b6-92d3a65a4895-maas-api-service-ca\") pod \"b908710d-a6df-4a09-a9b6-92d3a65a4895\" (UID: \"b908710d-a6df-4a09-a9b6-92d3a65a4895\") "
Sep 19 11:08:03.748863 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:03.748838    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b908710d-a6df-4a09-a9b6-92d3a65a4895-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b908710d-a6df-4a09-a9b6-92d3a65a4895" (UID: "b908710d-a6df-4a09-a9b6-92d3a65a4895"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:08:03.849632 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:03.849602    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b908710d-a6df-4a09-a9b6-92d3a65a4895-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:04.528613 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:04.528525    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"
Sep 19 11:08:04.528613 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:04.528585    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr" event={"ID":"b908710d-a6df-4a09-a9b6-92d3a65a4895","Type":"ContainerDied","Data":"57fc36e4e7c048cd843f76ad1dd9900b6500f7ebd044a4e25321aae6bad087ee"}
Sep 19 11:08:04.528799 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:04.528633    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57fc36e4e7c048cd843f76ad1dd9900b6500f7ebd044a4e25321aae6bad087ee"
Sep 19 11:08:06.622141 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.622108    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"]
Sep 19 11:08:06.622668 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.622337    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c" podUID="06d2c0f3-41b0-4717-b5ab-6b8382148594" containerName="payload-processing" containerID="cri-o://d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea" gracePeriod=30
Sep 19 11:08:06.627460 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.627434    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"]
Sep 19 11:08:06.627872 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.627840    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94" podUID="034f2b2b-1d68-4669-aa68-daea3215d0e6" containerName="payload-pre-processing" containerID="cri-o://1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e" gracePeriod=30
Sep 19 11:08:06.786683 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.786604    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"]
Sep 19 11:08:06.793304 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.788858    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b9c2b-n6prr"]
Sep 19 11:08:06.920709 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.920680    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:08:06.923737 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.923716    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:08:06.984030 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.984002    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034f2b2b-1d68-4669-aa68-daea3215d0e6-plugins-config-volume\") pod \"034f2b2b-1d68-4669-aa68-daea3215d0e6\" (UID: \"034f2b2b-1d68-4669-aa68-daea3215d0e6\") "
Sep 19 11:08:06.984174 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.984053    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06d2c0f3-41b0-4717-b5ab-6b8382148594-plugins-config-volume\") pod \"06d2c0f3-41b0-4717-b5ab-6b8382148594\" (UID: \"06d2c0f3-41b0-4717-b5ab-6b8382148594\") "
Sep 19 11:08:06.984296 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.984212    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqvxt\" (UniqueName: \"kubernetes.io/projected/06d2c0f3-41b0-4717-b5ab-6b8382148594-kube-api-access-vqvxt\") pod \"06d2c0f3-41b0-4717-b5ab-6b8382148594\" (UID: \"06d2c0f3-41b0-4717-b5ab-6b8382148594\") "
Sep 19 11:08:06.984296 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.984271    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkc8g\" (UniqueName: \"kubernetes.io/projected/034f2b2b-1d68-4669-aa68-daea3215d0e6-kube-api-access-pkc8g\") pod \"034f2b2b-1d68-4669-aa68-daea3215d0e6\" (UID: \"034f2b2b-1d68-4669-aa68-daea3215d0e6\") "
Sep 19 11:08:06.984515 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.984491    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d2c0f3-41b0-4717-b5ab-6b8382148594-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06d2c0f3-41b0-4717-b5ab-6b8382148594" (UID: "06d2c0f3-41b0-4717-b5ab-6b8382148594"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:08:06.984515 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.984499    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/034f2b2b-1d68-4669-aa68-daea3215d0e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "034f2b2b-1d68-4669-aa68-daea3215d0e6" (UID: "034f2b2b-1d68-4669-aa68-daea3215d0e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:08:06.984674 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.984645    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034f2b2b-1d68-4669-aa68-daea3215d0e6-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:06.984716 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.984672    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06d2c0f3-41b0-4717-b5ab-6b8382148594-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:06.986341 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.986314    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/034f2b2b-1d68-4669-aa68-daea3215d0e6-kube-api-access-pkc8g" (OuterVolumeSpecName: "kube-api-access-pkc8g") pod "034f2b2b-1d68-4669-aa68-daea3215d0e6" (UID: "034f2b2b-1d68-4669-aa68-daea3215d0e6"). InnerVolumeSpecName "kube-api-access-pkc8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:08:06.986442 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:06.986351    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d2c0f3-41b0-4717-b5ab-6b8382148594-kube-api-access-vqvxt" (OuterVolumeSpecName: "kube-api-access-vqvxt") pod "06d2c0f3-41b0-4717-b5ab-6b8382148594" (UID: "06d2c0f3-41b0-4717-b5ab-6b8382148594"). InnerVolumeSpecName "kube-api-access-vqvxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:08:07.085662 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.085630    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkc8g\" (UniqueName: \"kubernetes.io/projected/034f2b2b-1d68-4669-aa68-daea3215d0e6-kube-api-access-pkc8g\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:07.085662 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.085655    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqvxt\" (UniqueName: \"kubernetes.io/projected/06d2c0f3-41b0-4717-b5ab-6b8382148594-kube-api-access-vqvxt\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:07.546784 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.546749    2563 generic.go:356] "Generic (PLEG): container finished" podID="06d2c0f3-41b0-4717-b5ab-6b8382148594" containerID="d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea" exitCode=0
Sep 19 11:08:07.546995 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.546793    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"
Sep 19 11:08:07.546995 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.546840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c" event={"ID":"06d2c0f3-41b0-4717-b5ab-6b8382148594","Type":"ContainerDied","Data":"d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea"}
Sep 19 11:08:07.546995 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.546888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c" event={"ID":"06d2c0f3-41b0-4717-b5ab-6b8382148594","Type":"ContainerDied","Data":"1c68e65dae82c494d6341934b75de5627592d0f6ac17299ff76a32c6f77087df"}
Sep 19 11:08:07.546995 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.546915    2563 scope.go:117] "RemoveContainer" containerID="d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea"
Sep 19 11:08:07.548457 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.548433    2563 generic.go:356] "Generic (PLEG): container finished" podID="034f2b2b-1d68-4669-aa68-daea3215d0e6" containerID="1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e" exitCode=0
Sep 19 11:08:07.548656 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.548469    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"
Sep 19 11:08:07.548656 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.548520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94" event={"ID":"034f2b2b-1d68-4669-aa68-daea3215d0e6","Type":"ContainerDied","Data":"1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e"}
Sep 19 11:08:07.548656 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.548592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94" event={"ID":"034f2b2b-1d68-4669-aa68-daea3215d0e6","Type":"ContainerDied","Data":"f4cc111e42cddb42b3be1fd41d445f016389f53c7715d92c3596dfbf1560868e"}
Sep 19 11:08:07.556776 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.556759    2563 scope.go:117] "RemoveContainer" containerID="d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea"
Sep 19 11:08:07.557095 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:08:07.557072    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea\": container with ID starting with d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea not found: ID does not exist" containerID="d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea"
Sep 19 11:08:07.557182 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.557102    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea"} err="failed to get container status \"d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea\": rpc error: code = NotFound desc = could not find container \"d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea\": container with ID starting with d698a28a47c7fc1f8648b74446fe9899860a85f1a6847b9786cae697042758ea not found: ID does not exist"
Sep 19 11:08:07.557182 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.557120    2563 scope.go:117] "RemoveContainer" containerID="1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e"
Sep 19 11:08:07.565541 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.565525    2563 scope.go:117] "RemoveContainer" containerID="1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e"
Sep 19 11:08:07.565805 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:08:07.565787    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e\": container with ID starting with 1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e not found: ID does not exist" containerID="1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e"
Sep 19 11:08:07.565871 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.565810    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e"} err="failed to get container status \"1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e\": rpc error: code = NotFound desc = could not find container \"1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e\": container with ID starting with 1a4ba8d4713fe2c9e27b8ecd4c02da69b3711a1140364595935bbfca200e849e not found: ID does not exist"
Sep 19 11:08:07.571986 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.571964    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"]
Sep 19 11:08:07.574711 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.574690    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1b9c2b-7dd9d86566-gvs94"]
Sep 19 11:08:07.585216 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.585194    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"]
Sep 19 11:08:07.590252 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:07.590232    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b9c2b-9cf89f465-fdb7c"]
Sep 19 11:08:08.118524 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:08.118496    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="034f2b2b-1d68-4669-aa68-daea3215d0e6" path="/var/lib/kubelet/pods/034f2b2b-1d68-4669-aa68-daea3215d0e6/volumes"
Sep 19 11:08:08.118911 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:08.118901    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d2c0f3-41b0-4717-b5ab-6b8382148594" path="/var/lib/kubelet/pods/06d2c0f3-41b0-4717-b5ab-6b8382148594/volumes"
Sep 19 11:08:08.119195 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:08.119182    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b908710d-a6df-4a09-a9b6-92d3a65a4895" path="/var/lib/kubelet/pods/b908710d-a6df-4a09-a9b6-92d3a65a4895/volumes"
Sep 19 11:08:16.589328 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.589284    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"]
Sep 19 11:08:16.589932 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.589910    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d2c0f3-41b0-4717-b5ab-6b8382148594" containerName="payload-processing"
Sep 19 11:08:16.590017 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.589936    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d2c0f3-41b0-4717-b5ab-6b8382148594" containerName="payload-processing"
Sep 19 11:08:16.590017 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.589973    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034f2b2b-1d68-4669-aa68-daea3215d0e6" containerName="payload-pre-processing"
Sep 19 11:08:16.590017 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.589982    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="034f2b2b-1d68-4669-aa68-daea3215d0e6" containerName="payload-pre-processing"
Sep 19 11:08:16.590017 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.590001    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b908710d-a6df-4a09-a9b6-92d3a65a4895" containerName="revoke-keys"
Sep 19 11:08:16.590017 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.590010    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b908710d-a6df-4a09-a9b6-92d3a65a4895" containerName="revoke-keys"
Sep 19 11:08:16.590271 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.590108    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d2c0f3-41b0-4717-b5ab-6b8382148594" containerName="payload-processing"
Sep 19 11:08:16.590271 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.590123    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="034f2b2b-1d68-4669-aa68-daea3215d0e6" containerName="payload-pre-processing"
Sep 19 11:08:16.590271 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.590133    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b908710d-a6df-4a09-a9b6-92d3a65a4895" containerName="revoke-keys"
Sep 19 11:08:16.593277 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.593254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"
Sep 19 11:08:16.595745 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.595531    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:08:16.596036 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.596017    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:08:16.599601 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.599576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"]
Sep 19 11:08:16.680129 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.680092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk\" (UID: \"6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"
Sep 19 11:08:16.781717 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.781682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk\" (UID: \"6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"
Sep 19 11:08:16.782331 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.782310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk\" (UID: \"6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"
Sep 19 11:08:16.907203 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:16.907085    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"
Sep 19 11:08:17.176802 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:17.176773    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"]
Sep 19 11:08:17.178297 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:08:17.178267    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c08b42b_8cf6_4cd5_ace9_10ea1451a9bb.slice/crio-a7c3edc7a73b4313c672e1b85d1c4d3a27acd35ef84cf587a5676f669f63fbd9 WatchSource:0}: Error finding container a7c3edc7a73b4313c672e1b85d1c4d3a27acd35ef84cf587a5676f669f63fbd9: Status 404 returned error can't find the container with id a7c3edc7a73b4313c672e1b85d1c4d3a27acd35ef84cf587a5676f669f63fbd9
Sep 19 11:08:17.618266 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:17.618231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk" event={"ID":"6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb","Type":"ContainerStarted","Data":"f7b50f4f7d7a123a2d2603dab2147ca8892e05f4e1af30fe863006cc53ca95e7"}
Sep 19 11:08:17.618686 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:17.618284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk" event={"ID":"6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb","Type":"ContainerStarted","Data":"a7c3edc7a73b4313c672e1b85d1c4d3a27acd35ef84cf587a5676f669f63fbd9"}
Sep 19 11:08:17.632496 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:17.632447    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk" podStartSLOduration=1.632427278 podStartE2EDuration="1.632427278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:08:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:08:17.631417744 +0000 UTC m=+1901.565124008" watchObservedRunningTime="2026-09-19 11:08:17.632427278 +0000 UTC m=+1901.566133491"
Sep 19 11:08:18.626595 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:18.626559    2563 generic.go:356] "Generic (PLEG): container finished" podID="6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb" containerID="f7b50f4f7d7a123a2d2603dab2147ca8892e05f4e1af30fe863006cc53ca95e7" exitCode=0
Sep 19 11:08:18.627012 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:18.626646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk" event={"ID":"6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb","Type":"ContainerDied","Data":"f7b50f4f7d7a123a2d2603dab2147ca8892e05f4e1af30fe863006cc53ca95e7"}
Sep 19 11:08:19.780164 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:19.780134    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"
Sep 19 11:08:19.917951 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:19.917862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb-maas-api-service-ca\") pod \"6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb\" (UID: \"6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb\") "
Sep 19 11:08:19.918258 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:19.918229    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb" (UID: "6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:08:20.019626 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:20.019592    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:20.639502 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:20.639468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk" event={"ID":"6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb","Type":"ContainerDied","Data":"a7c3edc7a73b4313c672e1b85d1c4d3a27acd35ef84cf587a5676f669f63fbd9"}
Sep 19 11:08:20.639716 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:20.639520    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7c3edc7a73b4313c672e1b85d1c4d3a27acd35ef84cf587a5676f669f63fbd9"
Sep 19 11:08:20.639716 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:20.639478    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"
Sep 19 11:08:32.122040 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.122009    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"]
Sep 19 11:08:32.122456 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.122072    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"]
Sep 19 11:08:32.122456 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.122249    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm" podUID="782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b" containerName="payload-pre-processing" containerID="cri-o://1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7" gracePeriod=30
Sep 19 11:08:32.122620 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.122470    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf" podUID="403786d8-13e2-45c9-8277-042457dc23a7" containerName="payload-processing" containerID="cri-o://a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0" gracePeriod=30
Sep 19 11:08:32.263626 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.263558    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"]
Sep 19 11:08:32.266781 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.266749    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b52037-sn8xk"]
Sep 19 11:08:32.424501 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.424476    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:08:32.427085 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.427066    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:08:32.540051 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.540016    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msn88\" (UniqueName: \"kubernetes.io/projected/403786d8-13e2-45c9-8277-042457dc23a7-kube-api-access-msn88\") pod \"403786d8-13e2-45c9-8277-042457dc23a7\" (UID: \"403786d8-13e2-45c9-8277-042457dc23a7\") "
Sep 19 11:08:32.540051 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.540056    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-plugins-config-volume\") pod \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\" (UID: \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\") "
Sep 19 11:08:32.540314 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.540141    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/403786d8-13e2-45c9-8277-042457dc23a7-plugins-config-volume\") pod \"403786d8-13e2-45c9-8277-042457dc23a7\" (UID: \"403786d8-13e2-45c9-8277-042457dc23a7\") "
Sep 19 11:08:32.540314 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.540164    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fcqd\" (UniqueName: \"kubernetes.io/projected/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-kube-api-access-4fcqd\") pod \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\" (UID: \"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b\") "
Sep 19 11:08:32.540524 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.540495    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b" (UID: "782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:08:32.540595 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.540517    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/403786d8-13e2-45c9-8277-042457dc23a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "403786d8-13e2-45c9-8277-042457dc23a7" (UID: "403786d8-13e2-45c9-8277-042457dc23a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:08:32.542275 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.542255    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403786d8-13e2-45c9-8277-042457dc23a7-kube-api-access-msn88" (OuterVolumeSpecName: "kube-api-access-msn88") pod "403786d8-13e2-45c9-8277-042457dc23a7" (UID: "403786d8-13e2-45c9-8277-042457dc23a7"). InnerVolumeSpecName "kube-api-access-msn88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:08:32.542329 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.542297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-kube-api-access-4fcqd" (OuterVolumeSpecName: "kube-api-access-4fcqd") pod "782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b" (UID: "782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b"). InnerVolumeSpecName "kube-api-access-4fcqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:08:32.641637 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.641532    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msn88\" (UniqueName: \"kubernetes.io/projected/403786d8-13e2-45c9-8277-042457dc23a7-kube-api-access-msn88\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:32.641637 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.641586    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:32.641637 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.641595    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/403786d8-13e2-45c9-8277-042457dc23a7-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:32.641637 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.641604    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fcqd\" (UniqueName: \"kubernetes.io/projected/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b-kube-api-access-4fcqd\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:08:32.711815 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.711777    2563 generic.go:356] "Generic (PLEG): container finished" podID="403786d8-13e2-45c9-8277-042457dc23a7" containerID="a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0" exitCode=0
Sep 19 11:08:32.712005 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.711825    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"
Sep 19 11:08:32.712005 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.711854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf" event={"ID":"403786d8-13e2-45c9-8277-042457dc23a7","Type":"ContainerDied","Data":"a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0"}
Sep 19 11:08:32.712005 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.711906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf" event={"ID":"403786d8-13e2-45c9-8277-042457dc23a7","Type":"ContainerDied","Data":"772672cf087d2d71284223101e9255b3b7a992b46a1406e196e5b17d10d352bb"}
Sep 19 11:08:32.712005 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.711928    2563 scope.go:117] "RemoveContainer" containerID="a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0"
Sep 19 11:08:32.713277 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.713254    2563 generic.go:356] "Generic (PLEG): container finished" podID="782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b" containerID="1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7" exitCode=0
Sep 19 11:08:32.713364 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.713291    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"
Sep 19 11:08:32.713364 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.713307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm" event={"ID":"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b","Type":"ContainerDied","Data":"1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7"}
Sep 19 11:08:32.713364 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.713338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm" event={"ID":"782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b","Type":"ContainerDied","Data":"faba6c25ecc645588c4f0cda5e9a0a527d8d3ce45459a2c71a15f30027207c6e"}
Sep 19 11:08:32.722819 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.722801    2563 scope.go:117] "RemoveContainer" containerID="a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0"
Sep 19 11:08:32.723117 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:08:32.723099    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0\": container with ID starting with a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0 not found: ID does not exist" containerID="a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0"
Sep 19 11:08:32.723183 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.723125    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0"} err="failed to get container status \"a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0\": rpc error: code = NotFound desc = could not find container \"a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0\": container with ID starting with a1a1969f3812c0b6e78ec031a5639bff960f497fd270c72bba26551f1711e4d0 not found: ID does not exist"
Sep 19 11:08:32.723183 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.723142    2563 scope.go:117] "RemoveContainer" containerID="1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7"
Sep 19 11:08:32.733700 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.733650    2563 scope.go:117] "RemoveContainer" containerID="1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7"
Sep 19 11:08:32.734122 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:08:32.734101    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7\": container with ID starting with 1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7 not found: ID does not exist" containerID="1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7"
Sep 19 11:08:32.734262 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.734239    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7"} err="failed to get container status \"1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7\": rpc error: code = NotFound desc = could not find container \"1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7\": container with ID starting with 1d071425c8edbb451cdefb69ba52104e4e85fcae80df9c307d2d3c46075f70d7 not found: ID does not exist"
Sep 19 11:08:32.737416 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.737394    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"]
Sep 19 11:08:32.740870 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.740848    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b52037-6f7f9f9b6c-lz9tf"]
Sep 19 11:08:32.750273 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.750251    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"]
Sep 19 11:08:32.764766 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:32.760720    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b52037-fc9c9697d-mgtnm"]
Sep 19 11:08:34.119191 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:34.119155    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="403786d8-13e2-45c9-8277-042457dc23a7" path="/var/lib/kubelet/pods/403786d8-13e2-45c9-8277-042457dc23a7/volumes"
Sep 19 11:08:34.119598 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:34.119510    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb" path="/var/lib/kubelet/pods/6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb/volumes"
Sep 19 11:08:34.119856 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:34.119843    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b" path="/var/lib/kubelet/pods/782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b/volumes"
Sep 19 11:08:38.679139 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:38.679105    2563 scope.go:117] "RemoveContainer" containerID="28c7744f99e7db3c2312e962971c0448fcc5df72235c1ff6311ca2ba4bbbc07b"
Sep 19 11:08:38.689309 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:08:38.689289    2563 scope.go:117] "RemoveContainer" containerID="5a63af6a3ff8e64880f40758456d697966570cdba7f8594366f4cc896bdfce66"
Sep 19 11:09:25.863697 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:25.863615    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"]
Sep 19 11:09:25.864155 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:25.863905    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy" containerID="cri-o://7722392f44bbab65a6be6f02b77f04e329ddf4a2d9ebf49d94acf831cfa6bbc2" gracePeriod=30
Sep 19 11:09:26.220385 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220307    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"]
Sep 19 11:09:26.220718 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220705    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb" containerName="revoke-keys"
Sep 19 11:09:26.220769 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220720    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb" containerName="revoke-keys"
Sep 19 11:09:26.220769 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220739    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403786d8-13e2-45c9-8277-042457dc23a7" containerName="payload-processing"
Sep 19 11:09:26.220769 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220745    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="403786d8-13e2-45c9-8277-042457dc23a7" containerName="payload-processing"
Sep 19 11:09:26.220769 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220760    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b" containerName="payload-pre-processing"
Sep 19 11:09:26.220769 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220765    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b" containerName="payload-pre-processing"
Sep 19 11:09:26.220927 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220823    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="403786d8-13e2-45c9-8277-042457dc23a7" containerName="payload-processing"
Sep 19 11:09:26.220927 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220833    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c08b42b-8cf6-4cd5-ace9-10ea1451a9bb" containerName="revoke-keys"
Sep 19 11:09:26.220927 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.220840    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="782fedcc-f0b3-4bb8-b9f4-f1f78b88b71b" containerName="payload-pre-processing"
Sep 19 11:09:26.222906 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.222891    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"
Sep 19 11:09:26.225276 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.225254    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:09:26.225416 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.225299    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:09:26.231407 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.231382    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"]
Sep 19 11:09:26.323886 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.323850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1587846-0a3b-4032-be9b-a3c66d2ec4ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7\" (UID: \"f1587846-0a3b-4032-be9b-a3c66d2ec4ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"
Sep 19 11:09:26.424872 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.424840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1587846-0a3b-4032-be9b-a3c66d2ec4ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7\" (UID: \"f1587846-0a3b-4032-be9b-a3c66d2ec4ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"
Sep 19 11:09:26.425445 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.425425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1587846-0a3b-4032-be9b-a3c66d2ec4ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7\" (UID: \"f1587846-0a3b-4032-be9b-a3c66d2ec4ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"
Sep 19 11:09:26.534357 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.534278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"
Sep 19 11:09:26.803771 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:26.803742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"]
Sep 19 11:09:26.804881 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:09:26.804855    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1587846_0a3b_4032_be9b_a3c66d2ec4ea.slice/crio-4ac674687698025c781c5f632900fb4931ee0ac511debcf9a4af07997553842c WatchSource:0}: Error finding container 4ac674687698025c781c5f632900fb4931ee0ac511debcf9a4af07997553842c: Status 404 returned error can't find the container with id 4ac674687698025c781c5f632900fb4931ee0ac511debcf9a4af07997553842c
Sep 19 11:09:27.024454 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:27.024424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7" event={"ID":"f1587846-0a3b-4032-be9b-a3c66d2ec4ea","Type":"ContainerStarted","Data":"4ac674687698025c781c5f632900fb4931ee0ac511debcf9a4af07997553842c"}
Sep 19 11:09:28.031643 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:28.031605    2563 generic.go:356] "Generic (PLEG): container finished" podID="f1587846-0a3b-4032-be9b-a3c66d2ec4ea" containerID="0e7d142fb9b1a98a63c98d629fe38cf29760de2ffaac86855a9d620ec4718615" exitCode=0
Sep 19 11:09:28.032035 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:28.031695    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7" event={"ID":"f1587846-0a3b-4032-be9b-a3c66d2ec4ea","Type":"ContainerDied","Data":"0e7d142fb9b1a98a63c98d629fe38cf29760de2ffaac86855a9d620ec4718615"}
Sep 19 11:09:29.171532 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:29.171506    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"
Sep 19 11:09:29.250816 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:29.250774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1587846-0a3b-4032-be9b-a3c66d2ec4ea-maas-api-service-ca\") pod \"f1587846-0a3b-4032-be9b-a3c66d2ec4ea\" (UID: \"f1587846-0a3b-4032-be9b-a3c66d2ec4ea\") "
Sep 19 11:09:29.251164 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:29.251141    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1587846-0a3b-4032-be9b-a3c66d2ec4ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1587846-0a3b-4032-be9b-a3c66d2ec4ea" (UID: "f1587846-0a3b-4032-be9b-a3c66d2ec4ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:09:29.351654 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:29.351620    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1587846-0a3b-4032-be9b-a3c66d2ec4ea-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:30.044803 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:30.044761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7" event={"ID":"f1587846-0a3b-4032-be9b-a3c66d2ec4ea","Type":"ContainerDied","Data":"4ac674687698025c781c5f632900fb4931ee0ac511debcf9a4af07997553842c"}
Sep 19 11:09:30.044803 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:30.044793    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"
Sep 19 11:09:30.045089 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:30.044844    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ac674687698025c781c5f632900fb4931ee0ac511debcf9a4af07997553842c"
Sep 19 11:09:30.868336 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:30.868296    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 11:09:30.868737 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:30.868371    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 11:09:31.053530 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.053501    2563 generic.go:356] "Generic (PLEG): container finished" podID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerID="7722392f44bbab65a6be6f02b77f04e329ddf4a2d9ebf49d94acf831cfa6bbc2" exitCode=0
Sep 19 11:09:31.053713 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.053589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" event={"ID":"e5072b42-9168-4900-ab91-fcc1e18662a6","Type":"ContainerDied","Data":"7722392f44bbab65a6be6f02b77f04e329ddf4a2d9ebf49d94acf831cfa6bbc2"}
Sep 19 11:09:31.053713 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.053665    2563 scope.go:117] "RemoveContainer" containerID="44a0fa7d4737d28e1d0c9dbababb485187aceb553ff6cd2cec95ca3b308bf027"
Sep 19 11:09:31.111146 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.111122    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:09:31.168498 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168424    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5072b42-9168-4900-ab91-fcc1e18662a6-istiod-ca-cert\") pod \"e5072b42-9168-4900-ab91-fcc1e18662a6\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") "
Sep 19 11:09:31.168498 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168466    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-certs\") pod \"e5072b42-9168-4900-ab91-fcc1e18662a6\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") "
Sep 19 11:09:31.168713 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168508    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-podinfo\") pod \"e5072b42-9168-4900-ab91-fcc1e18662a6\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") "
Sep 19 11:09:31.168713 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168688    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-data\") pod \"e5072b42-9168-4900-ab91-fcc1e18662a6\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") "
Sep 19 11:09:31.168830 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168758    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-envoy\") pod \"e5072b42-9168-4900-ab91-fcc1e18662a6\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") "
Sep 19 11:09:31.168830 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168796    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-socket\") pod \"e5072b42-9168-4900-ab91-fcc1e18662a6\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") "
Sep 19 11:09:31.168938 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168854    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-credential-socket\") pod \"e5072b42-9168-4900-ab91-fcc1e18662a6\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") "
Sep 19 11:09:31.168938 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168854    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5072b42-9168-4900-ab91-fcc1e18662a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5072b42-9168-4900-ab91-fcc1e18662a6" (UID: "e5072b42-9168-4900-ab91-fcc1e18662a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:09:31.168938 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168866    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5072b42-9168-4900-ab91-fcc1e18662a6" (UID: "e5072b42-9168-4900-ab91-fcc1e18662a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:09:31.169112 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168980    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-token\") pod \"e5072b42-9168-4900-ab91-fcc1e18662a6\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") "
Sep 19 11:09:31.169112 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.168974    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5072b42-9168-4900-ab91-fcc1e18662a6" (UID: "e5072b42-9168-4900-ab91-fcc1e18662a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:09:31.169112 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.169038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bczfb\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-kube-api-access-bczfb\") pod \"e5072b42-9168-4900-ab91-fcc1e18662a6\" (UID: \"e5072b42-9168-4900-ab91-fcc1e18662a6\") "
Sep 19 11:09:31.169112 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.169054    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5072b42-9168-4900-ab91-fcc1e18662a6" (UID: "e5072b42-9168-4900-ab91-fcc1e18662a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:09:31.169112 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.169083    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5072b42-9168-4900-ab91-fcc1e18662a6" (UID: "e5072b42-9168-4900-ab91-fcc1e18662a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:09:31.169341 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.169313    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:31.169341 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.169327    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5072b42-9168-4900-ab91-fcc1e18662a6-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:31.169341 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.169336    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:31.169341 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.169343    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:31.169514 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.169351    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:31.170959 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.170931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5072b42-9168-4900-ab91-fcc1e18662a6" (UID: "e5072b42-9168-4900-ab91-fcc1e18662a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:09:31.171127 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.171094    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-kube-api-access-bczfb" (OuterVolumeSpecName: "kube-api-access-bczfb") pod "e5072b42-9168-4900-ab91-fcc1e18662a6" (UID: "e5072b42-9168-4900-ab91-fcc1e18662a6"). InnerVolumeSpecName "kube-api-access-bczfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:09:31.171235 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.171158    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5072b42-9168-4900-ab91-fcc1e18662a6" (UID: "e5072b42-9168-4900-ab91-fcc1e18662a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:09:31.171235 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.171169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5072b42-9168-4900-ab91-fcc1e18662a6" (UID: "e5072b42-9168-4900-ab91-fcc1e18662a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:09:31.270631 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.270577    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bczfb\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-kube-api-access-bczfb\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:31.270631 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.270623    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:31.270631 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.270634    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:31.270631 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:31.270642    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5072b42-9168-4900-ab91-fcc1e18662a6-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:32.060766 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:32.060734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb" event={"ID":"e5072b42-9168-4900-ab91-fcc1e18662a6","Type":"ContainerDied","Data":"8ea88bcf18733bcbbe7f50895e98decdcdefe3b7b817ecf936bf35c699ef5cad"}
Sep 19 11:09:32.061210 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:32.060793    2563 scope.go:117] "RemoveContainer" containerID="7722392f44bbab65a6be6f02b77f04e329ddf4a2d9ebf49d94acf831cfa6bbc2"
Sep 19 11:09:32.061210 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:32.060746    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"
Sep 19 11:09:32.082434 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:32.082404    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"]
Sep 19 11:09:32.086086 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:32.086062    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b52037-openshift-default-5f587c756-bc6sb"]
Sep 19 11:09:32.118380 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:32.118354    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" path="/var/lib/kubelet/pods/e5072b42-9168-4900-ab91-fcc1e18662a6/volumes"
Sep 19 11:09:36.966927 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:36.966888    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"]
Sep 19 11:09:36.969135 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:36.969108    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-063e1d-gwxv7"]
Sep 19 11:09:38.118416 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:38.118388    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1587846-0a3b-4032-be9b-a3c66d2ec4ea" path="/var/lib/kubelet/pods/f1587846-0a3b-4032-be9b-a3c66d2ec4ea/volumes"
Sep 19 11:09:38.745626 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:38.745591    2563 scope.go:117] "RemoveContainer" containerID="03a912841b7c9543fd26bdd58d9152a52e44311eba9c28bcb361620c1c725214"
Sep 19 11:09:38.754498 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:38.754474    2563 scope.go:117] "RemoveContainer" containerID="6e5d195fe53bbb72789750c0d2581d46e5bee4de687f5c10161825b9f5f93479"
Sep 19 11:09:43.805753 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.805711    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"]
Sep 19 11:09:43.806297 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.806275    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy"
Sep 19 11:09:43.806383 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.806301    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy"
Sep 19 11:09:43.806383 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.806312    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1587846-0a3b-4032-be9b-a3c66d2ec4ea" containerName="revoke-keys"
Sep 19 11:09:43.806383 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.806322    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1587846-0a3b-4032-be9b-a3c66d2ec4ea" containerName="revoke-keys"
Sep 19 11:09:43.806541 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.806442    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy"
Sep 19 11:09:43.806541 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.806457    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1587846-0a3b-4032-be9b-a3c66d2ec4ea" containerName="revoke-keys"
Sep 19 11:09:43.806541 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.806467    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy"
Sep 19 11:09:43.809632 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.809608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"
Sep 19 11:09:43.812077 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.812055    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:09:43.812217 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.812114    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:09:43.816471 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.816442    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"]
Sep 19 11:09:43.889004 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.888959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd1df28-19a9-4fa9-be91-6e1ee47d3be4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw\" (UID: \"7fd1df28-19a9-4fa9-be91-6e1ee47d3be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"
Sep 19 11:09:43.990356 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.990313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd1df28-19a9-4fa9-be91-6e1ee47d3be4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw\" (UID: \"7fd1df28-19a9-4fa9-be91-6e1ee47d3be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"
Sep 19 11:09:43.991007 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:43.990987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd1df28-19a9-4fa9-be91-6e1ee47d3be4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw\" (UID: \"7fd1df28-19a9-4fa9-be91-6e1ee47d3be4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"
Sep 19 11:09:44.122179 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:44.122145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"
Sep 19 11:09:44.392133 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:44.392096    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"]
Sep 19 11:09:44.393817 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:09:44.393774    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd1df28_19a9_4fa9_be91_6e1ee47d3be4.slice/crio-2f5612afac53991602e5a60546533a25ffd5a068b45f39ceddc53588e1744240 WatchSource:0}: Error finding container 2f5612afac53991602e5a60546533a25ffd5a068b45f39ceddc53588e1744240: Status 404 returned error can't find the container with id 2f5612afac53991602e5a60546533a25ffd5a068b45f39ceddc53588e1744240
Sep 19 11:09:45.138488 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:45.138453    2563 generic.go:356] "Generic (PLEG): container finished" podID="7fd1df28-19a9-4fa9-be91-6e1ee47d3be4" containerID="48636fa6deaee63f5f7af820243c35f531677540199292c2baaeb25312555190" exitCode=0
Sep 19 11:09:45.138950 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:45.138536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw" event={"ID":"7fd1df28-19a9-4fa9-be91-6e1ee47d3be4","Type":"ContainerDied","Data":"48636fa6deaee63f5f7af820243c35f531677540199292c2baaeb25312555190"}
Sep 19 11:09:45.138950 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:45.138603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw" event={"ID":"7fd1df28-19a9-4fa9-be91-6e1ee47d3be4","Type":"ContainerStarted","Data":"2f5612afac53991602e5a60546533a25ffd5a068b45f39ceddc53588e1744240"}
Sep 19 11:09:46.309292 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:46.309266    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"
Sep 19 11:09:46.415236 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:46.415144    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd1df28-19a9-4fa9-be91-6e1ee47d3be4-maas-api-service-ca\") pod \"7fd1df28-19a9-4fa9-be91-6e1ee47d3be4\" (UID: \"7fd1df28-19a9-4fa9-be91-6e1ee47d3be4\") "
Sep 19 11:09:46.415568 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:46.415521    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fd1df28-19a9-4fa9-be91-6e1ee47d3be4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7fd1df28-19a9-4fa9-be91-6e1ee47d3be4" (UID: "7fd1df28-19a9-4fa9-be91-6e1ee47d3be4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:09:46.516050 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:46.516018    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd1df28-19a9-4fa9-be91-6e1ee47d3be4-maas-api-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:47.151331 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:47.151299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw" event={"ID":"7fd1df28-19a9-4fa9-be91-6e1ee47d3be4","Type":"ContainerDied","Data":"2f5612afac53991602e5a60546533a25ffd5a068b45f39ceddc53588e1744240"}
Sep 19 11:09:47.151331 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:47.151327    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"
Sep 19 11:09:47.151577 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:47.151348    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f5612afac53991602e5a60546533a25ffd5a068b45f39ceddc53588e1744240"
Sep 19 11:09:54.243353 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.243319    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64"]
Sep 19 11:09:54.246057 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.246030    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-137f88-29830260-2zx64"]
Sep 19 11:09:54.270529 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.270494    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"]
Sep 19 11:09:54.271094 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.271034    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462" podUID="79b67ef3-fcfc-4f57-b2b7-eae505b73071" containerName="payload-pre-processing" containerID="cri-o://8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf" gracePeriod=30
Sep 19 11:09:54.415127 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.415085    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"]
Sep 19 11:09:54.420241 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.420161    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-137f88-czwlw"]
Sep 19 11:09:54.534130 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.534100    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 11:09:54.701731 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.701693    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scbmc\" (UniqueName: \"kubernetes.io/projected/79b67ef3-fcfc-4f57-b2b7-eae505b73071-kube-api-access-scbmc\") pod \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\" (UID: \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\") "
Sep 19 11:09:54.701731 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.701734    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b67ef3-fcfc-4f57-b2b7-eae505b73071-plugins-config-volume\") pod \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\" (UID: \"79b67ef3-fcfc-4f57-b2b7-eae505b73071\") "
Sep 19 11:09:54.702159 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.702125    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79b67ef3-fcfc-4f57-b2b7-eae505b73071-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "79b67ef3-fcfc-4f57-b2b7-eae505b73071" (UID: "79b67ef3-fcfc-4f57-b2b7-eae505b73071"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:09:54.703897 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.703876    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b67ef3-fcfc-4f57-b2b7-eae505b73071-kube-api-access-scbmc" (OuterVolumeSpecName: "kube-api-access-scbmc") pod "79b67ef3-fcfc-4f57-b2b7-eae505b73071" (UID: "79b67ef3-fcfc-4f57-b2b7-eae505b73071"). InnerVolumeSpecName "kube-api-access-scbmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:09:54.802806 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.802718    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scbmc\" (UniqueName: \"kubernetes.io/projected/79b67ef3-fcfc-4f57-b2b7-eae505b73071-kube-api-access-scbmc\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:54.802806 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:54.802747    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b67ef3-fcfc-4f57-b2b7-eae505b73071-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:09:55.196802 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:55.196762    2563 generic.go:356] "Generic (PLEG): container finished" podID="79b67ef3-fcfc-4f57-b2b7-eae505b73071" containerID="8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf" exitCode=0
Sep 19 11:09:55.196996 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:55.196807    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"
Sep 19 11:09:55.196996 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:55.196855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462" event={"ID":"79b67ef3-fcfc-4f57-b2b7-eae505b73071","Type":"ContainerDied","Data":"8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf"}
Sep 19 11:09:55.196996 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:55.196906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462" event={"ID":"79b67ef3-fcfc-4f57-b2b7-eae505b73071","Type":"ContainerDied","Data":"9cdb50a48419edd01380d8ae5d6ff24eabcaa1b3724f54e8f4ac0ae8b5e9da33"}
Sep 19 11:09:55.196996 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:55.196933    2563 scope.go:117] "RemoveContainer" containerID="8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf"
Sep 19 11:09:55.206327 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:55.206303    2563 scope.go:117] "RemoveContainer" containerID="8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf"
Sep 19 11:09:55.206722 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:09:55.206691    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf\": container with ID starting with 8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf not found: ID does not exist" containerID="8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf"
Sep 19 11:09:55.206851 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:55.206726    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf"} err="failed to get container status \"8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf\": rpc error: code = NotFound desc = could not find container \"8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf\": container with ID starting with 8a446bbb6cdb4dfc874d98b45c9dfd79d2604a8c7f3f52c318430bf44ff7e6bf not found: ID does not exist"
Sep 19 11:09:55.225142 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:55.225099    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"]
Sep 19 11:09:55.228339 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:55.228306    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-137f88-677f48d654-pt462"]
Sep 19 11:09:56.118728 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:56.118698    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d03f4b0-41f8-464e-85a7-08f61a7ffd2b" path="/var/lib/kubelet/pods/2d03f4b0-41f8-464e-85a7-08f61a7ffd2b/volumes"
Sep 19 11:09:56.119082 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:56.119040    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79b67ef3-fcfc-4f57-b2b7-eae505b73071" path="/var/lib/kubelet/pods/79b67ef3-fcfc-4f57-b2b7-eae505b73071/volumes"
Sep 19 11:09:56.119323 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:09:56.119310    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fd1df28-19a9-4fa9-be91-6e1ee47d3be4" path="/var/lib/kubelet/pods/7fd1df28-19a9-4fa9-be91-6e1ee47d3be4/volumes"
Sep 19 11:10:11.749721 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:11.749680    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"]
Sep 19 11:10:11.750227 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:11.749959    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv" podUID="b8c96f84-ca8e-42c4-b7a1-be36ea215384" containerName="payload-pre-processing" containerID="cri-o://0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b" gracePeriod=30
Sep 19 11:10:12.016693 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.016508    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 11:10:12.059141 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.059111    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnrrq\" (UniqueName: \"kubernetes.io/projected/b8c96f84-ca8e-42c4-b7a1-be36ea215384-kube-api-access-tnrrq\") pod \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\" (UID: \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\") "
Sep 19 11:10:12.059309 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.059260    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8c96f84-ca8e-42c4-b7a1-be36ea215384-plugins-config-volume\") pod \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\" (UID: \"b8c96f84-ca8e-42c4-b7a1-be36ea215384\") "
Sep 19 11:10:12.059664 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.059642    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8c96f84-ca8e-42c4-b7a1-be36ea215384-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b8c96f84-ca8e-42c4-b7a1-be36ea215384" (UID: "b8c96f84-ca8e-42c4-b7a1-be36ea215384"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:10:12.061289 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.061266    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c96f84-ca8e-42c4-b7a1-be36ea215384-kube-api-access-tnrrq" (OuterVolumeSpecName: "kube-api-access-tnrrq") pod "b8c96f84-ca8e-42c4-b7a1-be36ea215384" (UID: "b8c96f84-ca8e-42c4-b7a1-be36ea215384"). InnerVolumeSpecName "kube-api-access-tnrrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:10:12.160529 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.160499    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8c96f84-ca8e-42c4-b7a1-be36ea215384-plugins-config-volume\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:10:12.160529 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.160525    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnrrq\" (UniqueName: \"kubernetes.io/projected/b8c96f84-ca8e-42c4-b7a1-be36ea215384-kube-api-access-tnrrq\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 19 11:10:12.296294 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.296200    2563 generic.go:356] "Generic (PLEG): container finished" podID="b8c96f84-ca8e-42c4-b7a1-be36ea215384" containerID="0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b" exitCode=0
Sep 19 11:10:12.296294 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.296245    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"
Sep 19 11:10:12.296541 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.296287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv" event={"ID":"b8c96f84-ca8e-42c4-b7a1-be36ea215384","Type":"ContainerDied","Data":"0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b"}
Sep 19 11:10:12.296541 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.296349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv" event={"ID":"b8c96f84-ca8e-42c4-b7a1-be36ea215384","Type":"ContainerDied","Data":"01f301079dbe114cea54481dd00cacfef05d2dbc9d9f15a4da2d0d709e73877b"}
Sep 19 11:10:12.296541 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.296377    2563 scope.go:117] "RemoveContainer" containerID="0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b"
Sep 19 11:10:12.305674 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.305651    2563 scope.go:117] "RemoveContainer" containerID="0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b"
Sep 19 11:10:12.305931 ip-10-0-138-7 kubenswrapper[2563]: E0919 11:10:12.305914    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b\": container with ID starting with 0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b not found: ID does not exist" containerID="0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b"
Sep 19 11:10:12.305987 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.305941    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b"} err="failed to get container status \"0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b\": rpc error: code = NotFound desc = could not find container \"0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b\": container with ID starting with 0048c8affd90a30ce24dbafad9bcf764796a6aa3f9f3064c420675c7840aae0b not found: ID does not exist"
Sep 19 11:10:12.314475 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.314442    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"]
Sep 19 11:10:12.317235 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:12.317212    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9b3bef-67474f46cd-2v4vv"]
Sep 19 11:10:14.118411 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:14.118378    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8c96f84-ca8e-42c4-b7a1-be36ea215384" path="/var/lib/kubelet/pods/b8c96f84-ca8e-42c4-b7a1-be36ea215384/volumes"
Sep 19 11:10:38.786905 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:10:38.786866    2563 scope.go:117] "RemoveContainer" containerID="e23f5a36767dd4136542a31c7481d151809816df52f24c721e0b1d89d095ebeb"
Sep 19 11:11:38.296506 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:11:38.296387    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 11:11:38.305468 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:11:38.305445    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 11:14:38.840839 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:14:38.840806    2563 scope.go:117] "RemoveContainer" containerID="f7b50f4f7d7a123a2d2603dab2147ca8892e05f4e1af30fe863006cc53ca95e7"
Sep 19 11:14:38.849660 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:14:38.849642    2563 scope.go:117] "RemoveContainer" containerID="d485df29309f1690143e5be056803e8e28e673c2b7f4c999bbb7aa46b99294b9"
Sep 19 11:15:00.131146 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131105    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v"]
Sep 19 11:15:00.131812 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131674    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd1df28-19a9-4fa9-be91-6e1ee47d3be4" containerName="revoke-keys"
Sep 19 11:15:00.131812 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131696    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd1df28-19a9-4fa9-be91-6e1ee47d3be4" containerName="revoke-keys"
Sep 19 11:15:00.131812 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131714    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b67ef3-fcfc-4f57-b2b7-eae505b73071" containerName="payload-pre-processing"
Sep 19 11:15:00.131812 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131723    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b67ef3-fcfc-4f57-b2b7-eae505b73071" containerName="payload-pre-processing"
Sep 19 11:15:00.131812 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131738    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy"
Sep 19 11:15:00.131812 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131747    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5072b42-9168-4900-ab91-fcc1e18662a6" containerName="istio-proxy"
Sep 19 11:15:00.131812 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131779    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c96f84-ca8e-42c4-b7a1-be36ea215384" containerName="payload-pre-processing"
Sep 19 11:15:00.131812 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131789    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c96f84-ca8e-42c4-b7a1-be36ea215384" containerName="payload-pre-processing"
Sep 19 11:15:00.132466 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131873    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c96f84-ca8e-42c4-b7a1-be36ea215384" containerName="payload-pre-processing"
Sep 19 11:15:00.132466 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131890    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b67ef3-fcfc-4f57-b2b7-eae505b73071" containerName="payload-pre-processing"
Sep 19 11:15:00.132466 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.131903    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd1df28-19a9-4fa9-be91-6e1ee47d3be4" containerName="revoke-keys"
Sep 19 11:15:00.136980 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.136953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v"
Sep 19 11:15:00.139385 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.139360    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7r42s\""
Sep 19 11:15:00.139933 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.139903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v"]
Sep 19 11:15:00.152149 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.152118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v"
Sep 19 11:15:00.429732 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.429460    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v"]
Sep 19 11:15:00.432798 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:15:00.432773    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd9734b_fbe6_4ce1_aa26_d3bc1d823f85.slice/crio-e78ab67e4f9f45df090b40ba9474bd5de8d21faf1fd7d23b5a6bb5602fa23402 WatchSource:0}: Error finding container e78ab67e4f9f45df090b40ba9474bd5de8d21faf1fd7d23b5a6bb5602fa23402: Status 404 returned error can't find the container with id e78ab67e4f9f45df090b40ba9474bd5de8d21faf1fd7d23b5a6bb5602fa23402
Sep 19 11:15:00.888659 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.888625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v" event={"ID":"4bd9734b-fbe6-4ce1-aa26-d3bc1d823f85","Type":"ContainerStarted","Data":"a9dbcaea5ebb4f5b4629b971184c21e472c5fcbc6fe1714e44a7e5ce931bc7f9"}
Sep 19 11:15:00.888848 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.888686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v" event={"ID":"4bd9734b-fbe6-4ce1-aa26-d3bc1d823f85","Type":"ContainerStarted","Data":"e78ab67e4f9f45df090b40ba9474bd5de8d21faf1fd7d23b5a6bb5602fa23402"}
Sep 19 11:15:00.902676 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:00.902620    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v" podStartSLOduration=0.902602928 podStartE2EDuration="902.602928ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:15:00.900699805 +0000 UTC m=+2304.834406039" watchObservedRunningTime="2026-09-19 11:15:00.902602928 +0000 UTC m=+2304.836309142"
Sep 19 11:15:01.895797 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:01.895767    2563 generic.go:356] "Generic (PLEG): container finished" podID="4bd9734b-fbe6-4ce1-aa26-d3bc1d823f85" containerID="a9dbcaea5ebb4f5b4629b971184c21e472c5fcbc6fe1714e44a7e5ce931bc7f9" exitCode=0
Sep 19 11:15:01.896203 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:01.895859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v" event={"ID":"4bd9734b-fbe6-4ce1-aa26-d3bc1d823f85","Type":"ContainerDied","Data":"a9dbcaea5ebb4f5b4629b971184c21e472c5fcbc6fe1714e44a7e5ce931bc7f9"}
Sep 19 11:15:03.033579 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:03.033527    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v"
Sep 19 11:15:03.908678 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:03.908641    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v"
Sep 19 11:15:03.908678 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:03.908671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29830275-wxt8v" event={"ID":"4bd9734b-fbe6-4ce1-aa26-d3bc1d823f85","Type":"ContainerDied","Data":"e78ab67e4f9f45df090b40ba9474bd5de8d21faf1fd7d23b5a6bb5602fa23402"}
Sep 19 11:15:03.908900 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:03.908717    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e78ab67e4f9f45df090b40ba9474bd5de8d21faf1fd7d23b5a6bb5602fa23402"
Sep 19 11:15:38.876253 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:15:38.876212    2563 scope.go:117] "RemoveContainer" containerID="0e7d142fb9b1a98a63c98d629fe38cf29760de2ffaac86855a9d620ec4718615"
Sep 19 11:16:17.290130 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:17.290104    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-r8wbq_d2f5bb63-eac7-416a-be8f-54a93e97b9d3/server/0.log"
Sep 19 11:16:17.526677 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:17.526640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4_4a8f1e93-960d-4bf7-8dd9-70a3e20720c0/copy-manifests/0.log"
Sep 19 11:16:17.532562 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:17.532518    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4_4a8f1e93-960d-4bf7-8dd9-70a3e20720c0/manager/0.log"
Sep 19 11:16:18.473153 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:18.473123    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29830275-wxt8v_4bd9734b-fbe6-4ce1-aa26-d3bc1d823f85/cleanup/0.log"
Sep 19 11:16:20.358670 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:20.358636    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk_3ed5d46a-9671-4b9b-91ff-5717a3a5adab/istio-proxy/0.log"
Sep 19 11:16:20.473979 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:20.473949    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q64nw_79fee166-4b5a-48b9-8430-535966b8c8bf/discovery/0.log"
Sep 19 11:16:20.794834 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:20.794754    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lrkbf_4facec1d-b9d5-4820-b551-ba291778cd05/istio-proxy/1.log"
Sep 19 11:16:21.023096 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:21.023064    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cmmq2_606edbe1-4a74-4ff6-923f-5b7c2be0a58c/payload-processing/0.log"
Sep 19 11:16:21.557285 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:21.557255    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2fwvj_8afe6e78-2089-4c67-b2da-a7cabde4c126/main/0.log"
Sep 19 11:16:21.784877 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:21.784843    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vghlg_8b8fafe9-b6d3-4b56-850c-dc69786eb862/main/0.log"
Sep 19 11:16:21.992770 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:21.992738    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qr299_002f6ba7-ec6f-42bd-b1af-eaccca4126ce/main/0.log"
Sep 19 11:16:30.347619 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:30.347587    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m94pc_1bf76517-aa49-4690-9df4-907efc1a73bb/global-pull-secret-syncer/0.log"
Sep 19 11:16:30.482990 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:30.482955    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-76xz7_86e5db16-04d9-4c47-b9ba-7b57a80fadab/konnectivity-agent/0.log"
Sep 19 11:16:30.556491 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:30.556465    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-7.ec2.internal_638288756fad3699123da181b4a12476/haproxy/0.log"
Sep 19 11:16:37.468562 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.468518    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mcn4m_74a8663e-3d20-4970-a20a-86e9561096e6/kube-state-metrics/0.log"
Sep 19 11:16:37.484629 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.484599    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mcn4m_74a8663e-3d20-4970-a20a-86e9561096e6/kube-rbac-proxy-main/0.log"
Sep 19 11:16:37.507221 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.507190    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mcn4m_74a8663e-3d20-4970-a20a-86e9561096e6/kube-rbac-proxy-self/0.log"
Sep 19 11:16:37.537309 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.537282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c9766869-7j5kc_da1cc8a5-a918-45c2-8822-739df8bf9f38/metrics-server/0.log"
Sep 19 11:16:37.596461 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.596421    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5v7jl_d67d6bb5-14af-4b45-869d-b885e38baf50/node-exporter/0.log"
Sep 19 11:16:37.623152 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.623124    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5v7jl_d67d6bb5-14af-4b45-869d-b885e38baf50/kube-rbac-proxy/0.log"
Sep 19 11:16:37.658695 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.658668    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5v7jl_d67d6bb5-14af-4b45-869d-b885e38baf50/init-textfile/0.log"
Sep 19 11:16:37.839243 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.839212    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-dvld4_268ecc34-0d8b-4d27-95e8-850fab8fe9f0/kube-rbac-proxy-main/0.log"
Sep 19 11:16:37.864522 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.864487    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-dvld4_268ecc34-0d8b-4d27-95e8-850fab8fe9f0/kube-rbac-proxy-self/0.log"
Sep 19 11:16:37.885909 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:37.885882    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-dvld4_268ecc34-0d8b-4d27-95e8-850fab8fe9f0/openshift-state-metrics/0.log"
Sep 19 11:16:38.137630 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:38.137559    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-zh29f_af834c89-5417-44da-ab71-88f4a9bca93c/prometheus-operator/0.log"
Sep 19 11:16:38.156562 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:38.156525    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-zh29f_af834c89-5417-44da-ab71-88f4a9bca93c/kube-rbac-proxy/0.log"
Sep 19 11:16:38.184561 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:38.184519    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-bgtbv_16a55a1a-274a-45e3-93a5-37e39915de99/prometheus-operator-admission-webhook/0.log"
Sep 19 11:16:38.335857 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:38.335832    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 11:16:38.346566 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:38.346521    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btf2g_ec0f034d-6f0b-41cb-bf7d-27ba74fcb047/ovn-acl-logging/0.log"
Sep 19 11:16:38.900420 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:38.900389    2563 scope.go:117] "RemoveContainer" containerID="48636fa6deaee63f5f7af820243c35f531677540199292c2baaeb25312555190"
Sep 19 11:16:40.151434 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:40.151401    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-9rsbs_127ade86-ef4e-4c60-8238-5e0a6dffa0d4/networking-console-plugin/0.log"
Sep 19 11:16:41.416391 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.416356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-7x6mm_657de118-63a3-48a5-a1ae-732a7f1eabef/download-server/0.log"
Sep 19 11:16:41.437810 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.437778    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"]
Sep 19 11:16:41.438260 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.438238    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd9734b-fbe6-4ce1-aa26-d3bc1d823f85" containerName="cleanup"
Sep 19 11:16:41.438260 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.438262    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd9734b-fbe6-4ce1-aa26-d3bc1d823f85" containerName="cleanup"
Sep 19 11:16:41.438411 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.438352    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd9734b-fbe6-4ce1-aa26-d3bc1d823f85" containerName="cleanup"
Sep 19 11:16:41.442984 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.442956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.445202 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.445179    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wp77\"/\"kube-root-ca.crt\""
Sep 19 11:16:41.445319 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.445180    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4wp77\"/\"default-dockercfg-5dxml\""
Sep 19 11:16:41.445319 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.445180    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wp77\"/\"openshift-service-ca.crt\""
Sep 19 11:16:41.449603 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.449574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"]
Sep 19 11:16:41.550937 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.550900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-lib-modules\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.550937 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.550937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-sys\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.551207 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.550973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bbfg\" (UniqueName: \"kubernetes.io/projected/596da8eb-f07f-4376-b8d5-b9839ea230de-kube-api-access-6bbfg\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.551207 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.551039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-proc\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.551207 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.551117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-podres\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.651905 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.651867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-lib-modules\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.651905 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.651908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-sys\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.652170 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.651955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bbfg\" (UniqueName: \"kubernetes.io/projected/596da8eb-f07f-4376-b8d5-b9839ea230de-kube-api-access-6bbfg\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.652170 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.651989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-proc\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.652170 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.652034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-podres\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.652170 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.652058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-lib-modules\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.652170 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.652058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-sys\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.652170 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.652082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-proc\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.652170 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.652165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/596da8eb-f07f-4376-b8d5-b9839ea230de-podres\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.659051 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.659026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bbfg\" (UniqueName: \"kubernetes.io/projected/596da8eb-f07f-4376-b8d5-b9839ea230de-kube-api-access-6bbfg\") pod \"perf-node-gather-daemonset-btm5x\" (UID: \"596da8eb-f07f-4376-b8d5-b9839ea230de\") " pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:41.754202 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:41.754105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:42.025040 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:42.025015    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"]
Sep 19 11:16:42.026453 ip-10-0-138-7 kubenswrapper[2563]: W0919 11:16:42.026430    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod596da8eb_f07f_4376_b8d5_b9839ea230de.slice/crio-2e90955cb510b84dff2fad0615e1c39ccfaf9e4e2f46e07168d93017807a358c WatchSource:0}: Error finding container 2e90955cb510b84dff2fad0615e1c39ccfaf9e4e2f46e07168d93017807a358c: Status 404 returned error can't find the container with id 2e90955cb510b84dff2fad0615e1c39ccfaf9e4e2f46e07168d93017807a358c
Sep 19 11:16:42.449257 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:42.449219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x" event={"ID":"596da8eb-f07f-4376-b8d5-b9839ea230de","Type":"ContainerStarted","Data":"551e032f919b5dad49fcb0abb90a76cffa6a6a5d2a73974bf5a639a5b45dc57a"}
Sep 19 11:16:42.449675 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:42.449283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x" event={"ID":"596da8eb-f07f-4376-b8d5-b9839ea230de","Type":"ContainerStarted","Data":"2e90955cb510b84dff2fad0615e1c39ccfaf9e4e2f46e07168d93017807a358c"}
Sep 19 11:16:42.449675 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:42.449356    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:42.465866 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:42.465816    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x" podStartSLOduration=1.465800027 podStartE2EDuration="1.465800027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:16:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:16:42.463368575 +0000 UTC m=+2406.397074789" watchObservedRunningTime="2026-09-19 11:16:42.465800027 +0000 UTC m=+2406.399506241"
Sep 19 11:16:43.331112 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:43.331084    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n62mk_89a38211-9d09-43df-8a79-fc1b09bbc395/dns/0.log"
Sep 19 11:16:43.352162 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:43.352137    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n62mk_89a38211-9d09-43df-8a79-fc1b09bbc395/kube-rbac-proxy/0.log"
Sep 19 11:16:43.462258 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:43.462233    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4dnbr_3f425e60-dd82-465b-a43e-70e197626980/dns-node-resolver/0.log"
Sep 19 11:16:44.075942 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:44.075904    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79c94b8b8b-psgnl_6fbcb24a-0b6f-4b50-906f-56ca6c64f8c0/registry/0.log"
Sep 19 11:16:44.143029 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:44.143002    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wf2sv_a7faa045-b0f1-47f4-b351-dae07815e965/node-ca/0.log"
Sep 19 11:16:45.079762 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:45.079728    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk_3ed5d46a-9671-4b9b-91ff-5717a3a5adab/istio-proxy/0.log"
Sep 19 11:16:45.521202 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:45.521115    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q64nw_79fee166-4b5a-48b9-8430-535966b8c8bf/discovery/0.log"
Sep 19 11:16:45.591229 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:45.591206    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lrkbf_4facec1d-b9d5-4820-b551-ba291778cd05/istio-proxy/0.log"
Sep 19 11:16:45.593846 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:45.593826    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lrkbf_4facec1d-b9d5-4820-b551-ba291778cd05/istio-proxy/1.log"
Sep 19 11:16:45.662535 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:45.662503    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cmmq2_606edbe1-4a74-4ff6-923f-5b7c2be0a58c/payload-processing/0.log"
Sep 19 11:16:46.595034 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:46.595007    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2tzrs_cbf61033-adcb-4c4a-9e75-30a5515907c2/serve-healthcheck-canary/0.log"
Sep 19 11:16:47.266569 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:47.266533    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txvkd_7d00e0c2-7919-4740-939b-f3dbf8380733/kube-rbac-proxy/0.log"
Sep 19 11:16:47.287982 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:47.287958    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txvkd_7d00e0c2-7919-4740-939b-f3dbf8380733/exporter/0.log"
Sep 19 11:16:47.314100 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:47.314072    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txvkd_7d00e0c2-7919-4740-939b-f3dbf8380733/extractor/0.log"
Sep 19 11:16:48.464802 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:48.464774    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4wp77/perf-node-gather-daemonset-btm5x"
Sep 19 11:16:50.149168 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:50.149145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-r8wbq_d2f5bb63-eac7-416a-be8f-54a93e97b9d3/server/0.log"
Sep 19 11:16:50.318595 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:50.318563    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4_4a8f1e93-960d-4bf7-8dd9-70a3e20720c0/manager/0.log"
Sep 19 11:16:50.339452 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:50.339425    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d7b84ccc8-jdhp4_4a8f1e93-960d-4bf7-8dd9-70a3e20720c0/copy-manifests/0.log"
Sep 19 11:16:52.041702 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:52.041630    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-749b85b68c-fgz45_bf57dea6-49e2-4b5f-9210-c42f5b283ac2/manager/0.log"
Sep 19 11:16:52.904767 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:52.904734    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk_3ed5d46a-9671-4b9b-91ff-5717a3a5adab/istio-proxy/0.log"
Sep 19 11:16:53.342981 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:53.342947    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q64nw_79fee166-4b5a-48b9-8430-535966b8c8bf/discovery/0.log"
Sep 19 11:16:53.386336 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:53.386303    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lrkbf_4facec1d-b9d5-4820-b551-ba291778cd05/istio-proxy/0.log"
Sep 19 11:16:53.392180 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:53.392159    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lrkbf_4facec1d-b9d5-4820-b551-ba291778cd05/istio-proxy/1.log"
Sep 19 11:16:53.439446 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:53.439421    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cmmq2_606edbe1-4a74-4ff6-923f-5b7c2be0a58c/payload-processing/0.log"
Sep 19 11:16:54.940971 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:54.940933    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-gmqsk_3ed5d46a-9671-4b9b-91ff-5717a3a5adab/istio-proxy/0.log"
Sep 19 11:16:55.401099 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:55.401069    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q64nw_79fee166-4b5a-48b9-8430-535966b8c8bf/discovery/0.log"
Sep 19 11:16:55.467031 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:55.467000    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lrkbf_4facec1d-b9d5-4820-b551-ba291778cd05/istio-proxy/0.log"
Sep 19 11:16:55.470103 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:55.470082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lrkbf_4facec1d-b9d5-4820-b551-ba291778cd05/istio-proxy/1.log"
Sep 19 11:16:55.533179 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:55.533147    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cmmq2_606edbe1-4a74-4ff6-923f-5b7c2be0a58c/payload-processing/0.log"
Sep 19 11:16:57.442565 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:57.442520    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-tjdwd_99c2b3d2-de8f-4390-bea7-71289cc2ffc2/migrator/0.log"
Sep 19 11:16:57.463232 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:57.463209    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-tjdwd_99c2b3d2-de8f-4390-bea7-71289cc2ffc2/graceful-termination/0.log"
Sep 19 11:16:58.975923 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:58.975896    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxzdw_06a78293-0523-4c11-8886-80b4cce2e7c8/kube-multus-additional-cni-plugins/0.log"
Sep 19 11:16:58.996448 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:58.996421    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxzdw_06a78293-0523-4c11-8886-80b4cce2e7c8/egress-router-binary-copy/0.log"
Sep 19 11:16:59.016480 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:59.016455    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxzdw_06a78293-0523-4c11-8886-80b4cce2e7c8/cni-plugins/0.log"
Sep 19 11:16:59.038859 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:59.038833    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxzdw_06a78293-0523-4c11-8886-80b4cce2e7c8/bond-cni-plugin/0.log"
Sep 19 11:16:59.059111 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:59.059084    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxzdw_06a78293-0523-4c11-8886-80b4cce2e7c8/routeoverride-cni/0.log"
Sep 19 11:16:59.083564 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:59.083520    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxzdw_06a78293-0523-4c11-8886-80b4cce2e7c8/whereabouts-cni-bincopy/0.log"
Sep 19 11:16:59.109704 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:59.109674    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wxzdw_06a78293-0523-4c11-8886-80b4cce2e7c8/whereabouts-cni/0.log"
Sep 19 11:16:59.362880 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:59.362848    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q5v2w_aca7d975-9133-44cd-90c8-065f6e4c0d68/kube-multus/0.log"
Sep 19 11:16:59.469440 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:59.469406    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8jnsk_2924b046-7224-4ebb-bbf5-c36501c96018/network-metrics-daemon/0.log"
Sep 19 11:16:59.487680 ip-10-0-138-7 kubenswrapper[2563]: I0919 11:16:59.487657    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8jnsk_2924b046-7224-4ebb-bbf5-c36501c96018/kube-rbac-proxy/0.log"