Sep 14 10:22:55.013919 ip-10-0-141-156 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 14 10:22:55.013932 ip-10-0-141-156 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 14 10:22:55.013942 ip-10-0-141-156 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 14 10:22:55.014258 ip-10-0-141-156 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 14 10:23:04.826272 ip-10-0-141-156 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Sep 14 10:23:04.826286 ip-10-0-141-156 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a3cc92df17de4a08ad306e249679e03c --
Sep 14 10:24:36.985155 ip-10-0-141-156 systemd[1]: Starting Kubernetes Kubelet...
Sep 14 10:24:37.430970 ip-10-0-141-156 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 10:24:37.430970 ip-10-0-141-156 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 14 10:24:37.430970 ip-10-0-141-156 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 10:24:37.430970 ip-10-0-141-156 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 14 10:24:37.430970 ip-10-0-141-156 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 10:24:37.433891 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.433792    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 14 10:24:37.438533 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438517    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:24:37.438533 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438534    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438538    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438542    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438547    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438550    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438553    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438556    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438559    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438561    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438564    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438566    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438569    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438571    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438574    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438576    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438579    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438581    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438584    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438586    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438589    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:24:37.438595 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438592    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438595    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438597    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438600    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438603    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438605    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438608    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438611    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438613    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438616    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438618    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438621    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438623    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438625    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438628    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438631    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438633    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438635    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438638    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438640    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:24:37.439105 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438642    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438645    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438647    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438650    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438652    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438656    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438660    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438662    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438665    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438668    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438670    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438673    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438675    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438678    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438681    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438683    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438686    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438688    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438691    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:24:37.439603 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438694    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438696    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438699    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438701    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438704    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438706    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438709    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438711    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438713    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438716    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438718    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438722    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438725    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438728    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438731    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438734    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438736    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438739    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438742    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:24:37.440078 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438745    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438749    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438751    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438754    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438756    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438759    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438761    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438765    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438768    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438771    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438773    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438776    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438779    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438781    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438783    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438786    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438788    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438791    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438793    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.438795    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:24:37.440569 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439524    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439531    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439534    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439537    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439541    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439543    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439546    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439549    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439552    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439554    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439557    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439559    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439562    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439564    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439567    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439569    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439572    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439574    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439577    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439579    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:24:37.441065 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439582    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439586    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439588    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439591    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439593    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439596    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439598    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439601    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439603    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439606    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439609    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439611    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439614    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439616    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439619    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439622    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439624    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439627    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439629    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:24:37.441561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439632    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439636    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439640    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439643    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439646    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439649    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439651    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439654    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439656    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439659    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439661    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439664    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439666    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439669    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439672    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439674    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439677    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439679    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439682    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439684    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:24:37.442033 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439687    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439689    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439692    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439694    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439697    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439699    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439701    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439704    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439707    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439710    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439712    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439715    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439718    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439721    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439724    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439727    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439730    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439732    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439735    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:24:37.442578 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439737    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439740    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439742    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439744    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439748    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439750    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439753    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439756    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439758    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439761    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439764    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439767    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439769    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439771    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439774    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439777    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439779    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439781    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439785    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:24:37.443289 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439788    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.439791    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440200    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440206    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440209    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440214    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440218    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440221    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440224    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440227    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440230    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440233    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440235    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440238    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440241    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440243    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440246    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440248    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440251    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440254    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:24:37.443805 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440257    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440259    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440263    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440267    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440269    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440272    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440274    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440277    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440280    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440282    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440285    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440287    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440290    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440292    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440295    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440297    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440300    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440302    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440305    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440307    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:24:37.444312 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440311    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440314    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440317    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440320    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440322    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440325    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440327    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440330    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440335    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440337    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440340    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440342    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440345    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440348    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440351    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440354    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440356    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440358    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440361    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:24:37.444800 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440363    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440366    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440368    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440371    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440373    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440376    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440379    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440381    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440384    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440386    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440388    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440391    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440393    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440397    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440399    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440401    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440404    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440406    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440408    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440411    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:24:37.445318 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440414    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440417    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440420    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440423    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440425    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440428    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440430    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440432    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440435    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440438    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440440    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440443    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440445    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440448    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440451    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440455    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440457    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440460    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440463    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:24:37.445794 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440465    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440468    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.440471    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440536    2574 flags.go:64] FLAG: --address="0.0.0.0"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440575    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440581    2574 flags.go:64] FLAG: --anonymous-auth="true"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440586    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440590    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440593    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440597    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440602    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440605    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440608    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440611    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440615    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440618    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440621    2574 flags.go:64] FLAG: --cgroup-root=""
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440624    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440626    2574 flags.go:64] FLAG: --client-ca-file=""
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440629    2574 flags.go:64] FLAG: --cloud-provider="external"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440633    2574 flags.go:64] FLAG: --cluster-dns="[]"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440637    2574 flags.go:64] FLAG: --cluster-domain=""
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440639    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440643    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 14 10:24:37.446269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440646    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440649    2574 flags.go:64] FLAG: --container-log-max-files="5"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440652    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440655    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440658    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440662    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440664    2574 flags.go:64] FLAG: --contention-profiling="false"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440667    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440670    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440673    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440676    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440680    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440683    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440685    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440688    2574 flags.go:64] FLAG: --enable-load-reader="false"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440691    2574 flags.go:64] FLAG: --enable-server="true"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440694    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440702    2574 flags.go:64] FLAG: --event-burst="100"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440706    2574 flags.go:64] FLAG: --event-qps="50"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440709    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440711    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440714    2574 flags.go:64] FLAG: --eviction-hard=""
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440718    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440721    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440724    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 14 10:24:37.446849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440727    2574 flags.go:64] FLAG: --eviction-soft=""
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440730    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440732    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440735    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440738    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440741    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440744    2574 flags.go:64] FLAG: --fail-swap-on="true"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440748    2574 flags.go:64] FLAG: --feature-gates=""
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440751    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440754    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440757    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440763    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440765    2574 flags.go:64] FLAG: --healthz-port="10248"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440768    2574 flags.go:64] FLAG: --help="false"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440771    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440774    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440777    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440780    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440783    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440786    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440789    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440792    2574 flags.go:64] FLAG: --image-service-endpoint=""
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440795    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 14 10:24:37.447479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440798    2574 flags.go:64] FLAG: --kube-api-burst="100"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440801    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440804    2574 flags.go:64] FLAG: --kube-api-qps="50"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440807    2574 flags.go:64] FLAG: --kube-reserved=""
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440810    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440813    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440816    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440818    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440821    2574 flags.go:64] FLAG: --lock-file=""
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440824    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440826    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440829    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440837    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440840    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440843    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440845    2574 flags.go:64] FLAG: --logging-format="text"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440848    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440852    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440854    2574 flags.go:64] FLAG: --manifest-url=""
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440857    2574 flags.go:64] FLAG: --manifest-url-header=""
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440863    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440880    2574 flags.go:64] FLAG: --max-open-files="1000000"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440884    2574 flags.go:64] FLAG: --max-pods="110"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440887    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440891    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 14 10:24:37.448071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440893    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440896    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440900    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440902    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440905    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440912    2574 flags.go:64] FLAG: --node-status-max-images="50"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440915    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440917    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440920    2574 flags.go:64] FLAG: --pod-cidr=""
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440923    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440928    2574 flags.go:64] FLAG: --pod-manifest-path=""
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440931    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440934    2574 flags.go:64] FLAG: --pods-per-core="0"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440937    2574 flags.go:64] FLAG: --port="10250"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440940    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440943    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a799939cf9c8ed7d"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440946    2574 flags.go:64] FLAG: --qos-reserved=""
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440949    2574 flags.go:64] FLAG: --read-only-port="10255"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440952    2574 flags.go:64] FLAG: --register-node="true"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440955    2574 flags.go:64] FLAG: --register-with-taints=""
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440958    2574 flags.go:64] FLAG: --registry-burst="10"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440961    2574 flags.go:64] FLAG: --registry-qps="5"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440964    2574 flags.go:64] FLAG: --reserved-cpus=""
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440966    2574 flags.go:64] FLAG: --reserved-memory=""
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440970    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 14 10:24:37.448668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440973    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440976    2574 flags.go:64] FLAG: --rotate-certificates="false"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440983    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440986    2574 flags.go:64] FLAG: --runonce="false"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440989    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440992    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440995    2574 flags.go:64] FLAG: --seccomp-default="false"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.440997    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441000    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441003    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441006    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441009    2574 flags.go:64] FLAG: --storage-driver-password="root"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441012    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441015    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441017    2574 flags.go:64] FLAG: --storage-driver-user="root"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441020    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441023    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441027    2574 flags.go:64] FLAG: --system-cgroups=""
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441030    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441035    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441038    2574 flags.go:64] FLAG: --tls-cert-file=""
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441041    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441045    2574 flags.go:64] FLAG: --tls-min-version=""
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441047    2574 flags.go:64] FLAG: --tls-private-key-file=""
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441050    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 14 10:24:37.449316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441053    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441056    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441058    2574 flags.go:64] FLAG: --v="2"
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441062    2574 flags.go:64] FLAG: --version="false"
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441066    2574 flags.go:64] FLAG: --vmodule=""
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441070    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.441073    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441202    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441207    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441212    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441215    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441218    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441221    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441224    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441227    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441230    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441233    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441235    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441238    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441240    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441243    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:24:37.449938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441245    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441248    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441250    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441254    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441257    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441259    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441262    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441264    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441267    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441269    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441272    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441274    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441277    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441280    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441284    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441287    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441290    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441293    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441295    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:24:37.450450 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441298    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441304    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441308    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441312    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441315    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441317    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441320    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441323    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441325    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441328    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441331    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441333    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441335    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441338    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441340    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441343    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441347    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441349    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441352    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:24:37.450955 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441354    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441357    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441359    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441362    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441364    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441367    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441369    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441372    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441374    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441377    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441379    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441382    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441384    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441387    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441391    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441393    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441396    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441398    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441401    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441404    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:24:37.451427 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441406    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441409    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441411    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441413    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441416    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441418    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441421    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441423    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441425    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441429    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441432    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441434    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441437    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441440    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441444    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441448    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441452    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441455    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441458    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441461    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:24:37.451938 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441463    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:24:37.452580 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441466    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:24:37.452580 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441469    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:24:37.452580 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441471    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:24:37.452580 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441473    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:24:37.452580 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441476    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:24:37.452580 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.441480    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:24:37.452580 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.442173    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 10:24:37.452580 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.452184    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 14 10:24:37.452580 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.452200    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 14 10:24:37.453108 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.453097    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 14 10:24:37.453139 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.453112    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 14 10:24:37.453172 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453167    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:24:37.453172 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453172    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453176    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453180    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453184    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453187    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453190    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453192    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453197    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453201    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453204    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453207    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453210    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453213    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453216    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453219    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453222    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453225    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453227    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453230    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:24:37.453228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453233    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453235    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453238    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453241    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453244    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453246    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453249    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453251    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453257    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453260    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453262    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453265    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453267    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453270    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453272    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453275    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453277    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453281    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453284    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:24:37.453686 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453287    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453290    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453293    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453296    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453298    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453301    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453304    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453307    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453309    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453312    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453314    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453317    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453319    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453322    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453325    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453328    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453332    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453335    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453337    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:24:37.454163 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453340    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453342    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453345    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453347    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453350    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453352    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453355    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453357    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453360    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453362    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453365    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453367    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453370    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453373    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453375    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453378    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453381    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453383    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453385    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453388    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:24:37.454628 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453390    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453394    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453397    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453399    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453402    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453404    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453407    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453409    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453412    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453415    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453418    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453420    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453423    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453425    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453428    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453430    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453433    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453435    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453438    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453440    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:24:37.455231 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453443    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.453448    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453555    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453561    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453564    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453567    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453570    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453573    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453575    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453578    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453580    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453583    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453586    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453588    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453591    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 10:24:37.455717 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453594    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453596    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453599    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453602    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453604    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453608    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453610    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453613    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453615    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453618    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453620    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453623    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453626    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453628    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453630    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453633    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453635    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453638    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453640    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 10:24:37.456101 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453643    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453646    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453658    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453660    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453663    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453665    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453668    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453671    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453673    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453676    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453678    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453681    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453683    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453686    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453689    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453692    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453694    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453697    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453701    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453703    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 10:24:37.456558 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453706    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453708    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453711    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453714    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453716    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453719    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453721    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453723    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453727    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453730    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453733    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453736    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453739    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453741    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453744    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453747    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453750    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453753    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453756    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453758    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 10:24:37.457059 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453761    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453763    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453765    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453768    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453770    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453773    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453776    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453778    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453781    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453783    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453786    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453789    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453793    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453796    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453799    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453802    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453804    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453807    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453809    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 10:24:37.457577 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453812    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453814    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453817    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453820    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453822    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453824    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453827    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:37.453829    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.453834    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.453959    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 14 10:24:37.458056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.457229    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 14 10:24:37.458361 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.458243    2574 server.go:1019] "Starting client certificate rotation"
Sep 14 10:24:37.458409 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.458366    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 10:24:37.458454 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.458419    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 10:24:37.461729 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.461713    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 10:24:37.462831 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.462813    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 10:24:37.474052 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.474038    2574 log.go:25] "Validated CRI v1 runtime API"
Sep 14 10:24:37.478286 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.478264    2574 log.go:25] "Validated CRI v1 image API"
Sep 14 10:24:37.479235 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.479217    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 14 10:24:37.485547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.485526    2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8289f794-74d3-48ad-80fe-2215d238d3b1:/dev/nvme0n1p4 d306b305-68b3-45a1-bd4d-7c4fe66db2f9:/dev/nvme0n1p3]
Sep 14 10:24:37.485607 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.485547    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 14 10:24:37.490491 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.490473    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 10:24:37.490657 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.490532    2574 manager.go:216] Machine: {Timestamp:2026-09-14 10:24:37.489212598 +0000 UTC m=+0.374281696 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3053918 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b36573eedb6c5a071a32353b687b3 SystemUUID:ec2b3657-3eed-b6c5-a071-a32353b687b3 BootID:a3cc92df-17de-4a08-ad30-6e249679e03c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c8:86:7b:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c8:86:7b:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:98:6c:69:3d:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 14 10:24:37.490657 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.490655    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 14 10:24:37.490751 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.490742    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 14 10:24:37.494670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.494639    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 14 10:24:37.494810 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.494675    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-156.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 14 10:24:37.495493 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.495483    2574 topology_manager.go:138] "Creating topology manager with none policy"
Sep 14 10:24:37.495534 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.495496    2574 container_manager_linux.go:309] "Creating device plugin manager"
Sep 14 10:24:37.495534 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.495504    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 10:24:37.496222 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.496211    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 10:24:37.497390 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.497381    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 14 10:24:37.502959 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.502947    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 10:24:37.503089 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.503079    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 14 10:24:37.503122 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.503113    2574 kubelet.go:486] "Attempting to sync node with API server"
Sep 14 10:24:37.503154 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.503127    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 14 10:24:37.503154 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.503150    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 14 10:24:37.503206 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.503163    2574 kubelet.go:398] "Adding apiserver pod source"
Sep 14 10:24:37.503206 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.503175    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 14 10:24:37.503626 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.503614    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 10:24:37.503663 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.503638    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 10:24:37.506834 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.506817    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 14 10:24:37.509222 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.509201    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 14 10:24:37.509310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.509250    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 14 10:24:37.511473 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511461    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 14 10:24:37.511537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511479    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 14 10:24:37.511537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511485    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 14 10:24:37.511537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511491    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 14 10:24:37.511537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511500    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 14 10:24:37.511537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511505    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 14 10:24:37.511537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511523    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 14 10:24:37.511537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511529    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 14 10:24:37.511537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511535    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 14 10:24:37.511537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511540    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 14 10:24:37.511772 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511549    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 14 10:24:37.511772 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.511554    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 14 10:24:37.513257 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.513245    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 14 10:24:37.513257 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.513257    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 14 10:24:37.514817 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.514793    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 14 10:24:37.514817 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.514797    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 14 10:24:37.516075 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.516057    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-156.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 14 10:24:37.517361 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.517345    2574 server.go:1268] "Started kubelet"
Sep 14 10:24:37.517441 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.517413    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 14 10:24:37.517565 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.517510    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 14 10:24:37.517615 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.517592    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 14 10:24:37.518170 ip-10-0-141-156 systemd[1]: Started Kubernetes Kubelet.
Sep 14 10:24:37.519486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.519462    2574 server.go:310] "Adding debug handlers to kubelet server"
Sep 14 10:24:37.519602 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.519585    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 14 10:24:37.526256 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.526235    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 14 10:24:37.526397 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.526236    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 14 10:24:37.526549 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.526538    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 14 10:24:37.526850 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.526826    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:37.527473 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.527408    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 14 10:24:37.527540 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.527484    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 14 10:24:37.527775 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.527409    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 14 10:24:37.527859 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.527836    2574 reconstruct.go:97] "Volume reconstruction finished"
Sep 14 10:24:37.527859 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.527853    2574 reconciler.go:29] "Reconciler: start to sync state"
Sep 14 10:24:37.528033 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.527842    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 14 10:24:37.528033 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.527896    2574 factory.go:55] Registering systemd factory
Sep 14 10:24:37.528033 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.527906    2574 factory.go:223] Registration of the systemd container factory successfully
Sep 14 10:24:37.528175 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.528160    2574 factory.go:153] Registering CRI-O factory
Sep 14 10:24:37.528228 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.528179    2574 factory.go:223] Registration of the crio container factory successfully
Sep 14 10:24:37.528228 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.528199    2574 factory.go:103] Registering Raw factory
Sep 14 10:24:37.528228 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.528225    2574 manager.go:1196] Started watching for new ooms in manager
Sep 14 10:24:37.528554 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.528537    2574 manager.go:349] Starting recovery of all containers
Sep 14 10:24:37.532963 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.532935    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 14 10:24:37.533104 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.533069    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 14 10:24:37.534038 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.532894    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-156.ec2.internal.18d528f927154556  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-156.ec2.internal,UID:ip-10-0-141-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-156.ec2.internal,},FirstTimestamp:2026-09-14 10:24:37.517313366 +0000 UTC m=+0.402382465,LastTimestamp:2026-09-14 10:24:37.517313366 +0000 UTC m=+0.402382465,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-156.ec2.internal,}"
Sep 14 10:24:37.538631 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.538456    2574 manager.go:354] Recovery completed
Sep 14 10:24:37.542968 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.542956    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:24:37.544822 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.544796    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r9qt4"
Sep 14 10:24:37.545079 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.545063    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:24:37.545147 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.545093    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:24:37.545147 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.545107    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:24:37.546405 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.546391    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 14 10:24:37.546405 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.546406    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 14 10:24:37.546536 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.546397    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:24:37.546536 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.546425    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 10:24:37.547119 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.547106    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:24:37.547165 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.547132    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:24:37.547165 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.547143    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:24:37.547863 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.547797    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-156.ec2.internal.18d528f928bcecb6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-156.ec2.internal,UID:ip-10-0-141-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-156.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-156.ec2.internal,},FirstTimestamp:2026-09-14 10:24:37.545077942 +0000 UTC m=+0.430147040,LastTimestamp:2026-09-14 10:24:37.545077942 +0000 UTC m=+0.430147040,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-156.ec2.internal,}"
Sep 14 10:24:37.548606 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.548593    2574 policy_none.go:49] "None policy: Start"
Sep 14 10:24:37.548670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.548614    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 14 10:24:37.548670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.548628    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 14 10:24:37.550635 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.550623    2574 policy_none.go:47] "Start"
Sep 14 10:24:37.553124 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.553106    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r9qt4"
Sep 14 10:24:37.557231 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.557171    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-156.ec2.internal.18d528f928bd4193  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-156.ec2.internal,UID:ip-10-0-141-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-156.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-156.ec2.internal,},FirstTimestamp:2026-09-14 10:24:37.545099667 +0000 UTC m=+0.430168767,LastTimestamp:2026-09-14 10:24:37.545099667 +0000 UTC m=+0.430168767,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-156.ec2.internal,}"
Sep 14 10:24:37.585518 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.585501    2574 manager.go:337] "Starting Device Plugin manager"
Sep 14 10:24:37.585628 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.585539    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 14 10:24:37.585628 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.585550    2574 server.go:87] "Starting device plugin registration server"
Sep 14 10:24:37.586016 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.585985    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 14 10:24:37.586016 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.585999    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.586160    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.586239    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.586248    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.587018    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.587090    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.600394    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.601718    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.601761    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.601782    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.601884    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 14 10:24:37.612431 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.604267    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:24:37.687157 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.687071    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:24:37.688088 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.688070    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:24:37.688169 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.688104    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:24:37.688169 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.688115    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:24:37.688169 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.688141    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.698463 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.698448    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.698519 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.698471    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-156.ec2.internal\": node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:37.702030 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.702012    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal"]
Sep 14 10:24:37.702091 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.702076    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:24:37.703647 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.703629    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:24:37.703729 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.703657    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:24:37.703729 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.703668    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:24:37.705921 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.705909    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:24:37.706047 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.706033    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.706081 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.706076    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:24:37.706682 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.706663    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:24:37.706780 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.706696    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:24:37.706780 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.706706    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:24:37.706780 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.706663    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:24:37.706780 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.706765    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:24:37.706780 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.706778    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:24:37.708936 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.708922    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.709010 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.708947    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 10:24:37.709624 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.709609    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 10:24:37.709702 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.709635    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 10:24:37.709702 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.709646    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeHasSufficientPID"
Sep 14 10:24:37.729096 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.729078    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:37.743715 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.743694    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-156.ec2.internal\" not found" node="ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.748300 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.748286    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-156.ec2.internal\" not found" node="ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.829371 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.829324    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:37.829546 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.829412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2bada25af9431b9c44a9cfd351263f89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal\" (UID: \"2bada25af9431b9c44a9cfd351263f89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.829546 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.829434    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bada25af9431b9c44a9cfd351263f89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal\" (UID: \"2bada25af9431b9c44a9cfd351263f89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.829546 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.829451    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e272105baf092ca2ccbcf8e39766ef49-config\") pod \"kube-apiserver-proxy-ip-10-0-141-156.ec2.internal\" (UID: \"e272105baf092ca2ccbcf8e39766ef49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.929959 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:37.929924    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:37.930117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.930001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bada25af9431b9c44a9cfd351263f89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal\" (UID: \"2bada25af9431b9c44a9cfd351263f89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.930117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.930037    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e272105baf092ca2ccbcf8e39766ef49-config\") pod \"kube-apiserver-proxy-ip-10-0-141-156.ec2.internal\" (UID: \"e272105baf092ca2ccbcf8e39766ef49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.930117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.930061    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2bada25af9431b9c44a9cfd351263f89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal\" (UID: \"2bada25af9431b9c44a9cfd351263f89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.930117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.930115    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bada25af9431b9c44a9cfd351263f89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal\" (UID: \"2bada25af9431b9c44a9cfd351263f89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.930272 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.930120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e272105baf092ca2ccbcf8e39766ef49-config\") pod \"kube-apiserver-proxy-ip-10-0-141-156.ec2.internal\" (UID: \"e272105baf092ca2ccbcf8e39766ef49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:37.930272 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:37.930136    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2bada25af9431b9c44a9cfd351263f89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal\" (UID: \"2bada25af9431b9c44a9cfd351263f89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:38.030697 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.030619    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:38.046812 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.046778    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:38.052158 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.052007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:38.131601 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.131556    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:38.231985 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.231956    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:38.332509 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.332421    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-156.ec2.internal\" not found"
Sep 14 10:24:38.429517 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.429486    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:24:38.457547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.457513    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 14 10:24:38.458058 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.457679    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 14 10:24:38.458058 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.457693    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 14 10:24:38.503811 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.503778    2574 apiserver.go:52] "Watching apiserver"
Sep 14 10:24:38.525887 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.525850    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 14 10:24:38.526204 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.526186    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-qfb4q","kube-system/global-pull-secret-syncer-kfv78","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n","openshift-cluster-node-tuning-operator/tuned-pgm6h","openshift-dns/node-resolver-zjzt4","openshift-image-registry/node-ca-jbkd8","openshift-multus/multus-additional-cni-plugins-8mkjw","openshift-network-diagnostics/network-check-target-tdj5q","openshift-network-operator/iptables-alerter-mfbn8","kube-system/konnectivity-agent-thqbm","openshift-multus/multus-nnkhl","openshift-multus/network-metrics-daemon-g8jfb"]
Sep 14 10:24:38.527241 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.527225    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:38.527320 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.527224    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 14 10:24:38.528712 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.528695    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.531125 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.531103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.533196 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.533175    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4nms4\""
Sep 14 10:24:38.533295 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.533178    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 14 10:24:38.533295 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.533241    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.533397 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.533385    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 14 10:24:38.533473 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.533386    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 14 10:24:38.533587 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.533570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87a193a1-7c8e-49cd-8c5b-0a885657e21d-host\") pod \"node-ca-jbkd8\" (UID: \"87a193a1-7c8e-49cd-8c5b-0a885657e21d\") " pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.533646 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.533602    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87a193a1-7c8e-49cd-8c5b-0a885657e21d-serviceca\") pod \"node-ca-jbkd8\" (UID: \"87a193a1-7c8e-49cd-8c5b-0a885657e21d\") " pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.533646 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.533627    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp4zh\" (UniqueName: \"kubernetes.io/projected/87a193a1-7c8e-49cd-8c5b-0a885657e21d-kube-api-access-pp4zh\") pod \"node-ca-jbkd8\" (UID: \"87a193a1-7c8e-49cd-8c5b-0a885657e21d\") " pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.534743 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.534728    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 14 10:24:38.534831 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.534752    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 14 10:24:38.535322 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.535293    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 14 10:24:38.537738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.536066    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:38.537738 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.536153    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:38.537738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.536322    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hrxx4\""
Sep 14 10:24:38.537738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.537200    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 14 10:24:38.537738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.537460    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 14 10:24:38.538048 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.538023    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 14 10:24:38.538102 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.538072    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r29bk\""
Sep 14 10:24:38.538489 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.538467    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 14 10:24:38.538763 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.538746    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 14 10:24:38.539895 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.539840    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 14 10:24:38.539986 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.539971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.540045 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.540023    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 14 10:24:38.541609 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.541592    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 14 10:24:38.542354 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.542332    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.544560 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.544542    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.546822 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.546805    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:38.546937 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.546881    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:38.547540 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.547518    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 10:24:38.547623 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.547611    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"
Sep 14 10:24:38.547910 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.547892    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 14 10:24:38.549261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.549088    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 14 10:24:38.549261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.549088    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 14 10:24:38.549261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.549184    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2l6tm\""
Sep 14 10:24:38.549261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.549122    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 14 10:24:38.549261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.549214    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.551692 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.551674    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:24:38.551990 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.551970    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:24:38.552073 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.552005    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qv9v6\""
Sep 14 10:24:38.552127 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.552093    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v9pk9\""
Sep 14 10:24:38.552265 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.552252    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 14 10:24:38.552307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.552258    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 14 10:24:38.553229 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.553215    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:24:38.553307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.553246    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 14 10:24:38.553307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.553281    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b7nj6\""
Sep 14 10:24:38.553380 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.553285    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 14 10:24:38.554165 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.554153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.555328 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.555315    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 14 10:24:38.555657 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.555642    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 14 10:24:38.556131 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.556118    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2kppw\""
Sep 14 10:24:38.556339 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.556319    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal"]
Sep 14 10:24:38.556410 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.556393    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:38.556457 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.556441    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:38.556829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.556816    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 14 10:24:38.557206 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.557193    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9zl2s\""
Sep 14 10:24:38.558623 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.558590    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-13 10:19:37 +0000 UTC" deadline="2028-03-17 12:22:15.06820695 +0000 UTC"
Sep 14 10:24:38.558663 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.558624    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13201h57m36.509585371s"
Sep 14 10:24:38.561908 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.561891    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 10:24:38.568895 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.568853    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 10:24:38.569054 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.569037    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal"]
Sep 14 10:24:38.583760 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.583703    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hdtdd"
Sep 14 10:24:38.593800 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.593742    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hdtdd"
Sep 14 10:24:38.630615 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.629904    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 14 10:24:38.634706 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-system-cni-dir\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.634823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634711    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-etc-kubernetes\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.634823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634728    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.634823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6fm8\" (UniqueName: \"kubernetes.io/projected/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-kube-api-access-d6fm8\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.634823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634761    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:38.634823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28411147-5c17-42e2-91a5-2558eea261f3-konnectivity-ca\") pod \"konnectivity-agent-thqbm\" (UID: \"28411147-5c17-42e2-91a5-2558eea261f3\") " pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634831    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-cni-bin\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-sysctl-conf\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgl59\" (UniqueName: \"kubernetes.io/projected/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-kube-api-access-cgl59\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634937    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-cni-dir\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634961    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-run-k8s-cni-cncf-io\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.634984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-run-netns\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-run-multus-certs\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-run-openvswitch\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-lib-modules\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6fzk\" (UniqueName: \"kubernetes.io/projected/051ca948-ae4f-47a9-b04e-919e83e571a2-kube-api-access-r6fzk\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.635097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-device-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635119    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-hostroot\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635142    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-modprobe-d\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635163    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-sysconfig\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635185    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/edaf9e65-4df9-4d03-8371-8349eb66dfbd-kubelet-config\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635207    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-sys-fs\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635231    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2547c7e1-a00d-4746-be71-7db0fe44dab3-cni-binary-copy\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635253    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-node-log\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-run\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635313    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28411147-5c17-42e2-91a5-2558eea261f3-agent-certs\") pod \"konnectivity-agent-thqbm\" (UID: \"28411147-5c17-42e2-91a5-2558eea261f3\") " pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq78v\" (UniqueName: \"kubernetes.io/projected/be40853d-ecb0-4226-b63d-2e9b514a7124-kube-api-access-fq78v\") pod \"node-resolver-zjzt4\" (UID: \"be40853d-ecb0-4226-b63d-2e9b514a7124\") " pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5fp7\" (UniqueName: \"kubernetes.io/projected/72f769c8-aaf4-4b60-9a6a-afbe278338bc-kube-api-access-r5fp7\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635408    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-slash\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635432    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/051ca948-ae4f-47a9-b04e-919e83e571a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635470    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-registration-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.635543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635521    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-daemon-config\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635564    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-ovn-node-metrics-cert\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/051ca948-ae4f-47a9-b04e-919e83e571a2-system-cni-dir\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635617    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/051ca948-ae4f-47a9-b04e-919e83e571a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be40853d-ecb0-4226-b63d-2e9b514a7124-hosts-file\") pod \"node-resolver-zjzt4\" (UID: \"be40853d-ecb0-4226-b63d-2e9b514a7124\") " pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635660    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39c8ff7d-ac27-42f6-b599-95faaf70ea65-iptables-alerter-script\") pod \"iptables-alerter-mfbn8\" (UID: \"39c8ff7d-ac27-42f6-b599-95faaf70ea65\") " pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-conf-dir\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635729    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-systemd\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be40853d-ecb0-4226-b63d-2e9b514a7124-tmp-dir\") pod \"node-resolver-zjzt4\" (UID: \"be40853d-ecb0-4226-b63d-2e9b514a7124\") " pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-var-lib-cni-multus\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635799    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-kubelet\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635828    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-var-lib-kubelet\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pxbn\" (UniqueName: \"kubernetes.io/projected/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-kube-api-access-8pxbn\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp4zh\" (UniqueName: \"kubernetes.io/projected/87a193a1-7c8e-49cd-8c5b-0a885657e21d-kube-api-access-pp4zh\") pod \"node-ca-jbkd8\" (UID: \"87a193a1-7c8e-49cd-8c5b-0a885657e21d\") " pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635929    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj8vk\" (UniqueName: \"kubernetes.io/projected/39c8ff7d-ac27-42f6-b599-95faaf70ea65-kube-api-access-dj8vk\") pod \"iptables-alerter-mfbn8\" (UID: \"39c8ff7d-ac27-42f6-b599-95faaf70ea65\") " pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.636104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.635978    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-systemd-units\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-env-overrides\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-ovnkube-script-lib\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87a193a1-7c8e-49cd-8c5b-0a885657e21d-host\") pod \"node-ca-jbkd8\" (UID: \"87a193a1-7c8e-49cd-8c5b-0a885657e21d\") " pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-etc-openvswitch\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-sys\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636125    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87a193a1-7c8e-49cd-8c5b-0a885657e21d-host\") pod \"node-ca-jbkd8\" (UID: \"87a193a1-7c8e-49cd-8c5b-0a885657e21d\") " pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636146    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/051ca948-ae4f-47a9-b04e-919e83e571a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636208    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-host\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/051ca948-ae4f-47a9-b04e-919e83e571a2-cnibin\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/051ca948-ae4f-47a9-b04e-919e83e571a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636287    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-cnibin\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636300    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-run-ovn\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636323    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-log-socket\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-cni-netd\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-socket-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.636650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlctn\" (UniqueName: \"kubernetes.io/projected/2547c7e1-a00d-4746-be71-7db0fe44dab3-kube-api-access-dlctn\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636433    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-var-lib-openvswitch\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636447    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-ovnkube-config\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-kubernetes\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636488    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87a193a1-7c8e-49cd-8c5b-0a885657e21d-serviceca\") pod \"node-ca-jbkd8\" (UID: \"87a193a1-7c8e-49cd-8c5b-0a885657e21d\") " pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636519    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-var-lib-cni-bin\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636612    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-var-lib-kubelet\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636636    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-run-netns\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-tuned\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636702    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/edaf9e65-4df9-4d03-8371-8349eb66dfbd-dbus\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636728    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39c8ff7d-ac27-42f6-b599-95faaf70ea65-host-slash\") pod \"iptables-alerter-mfbn8\" (UID: \"39c8ff7d-ac27-42f6-b599-95faaf70ea65\") " pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636755    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-socket-dir-parent\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-run-systemd\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636842    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.637429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636892    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87a193a1-7c8e-49cd-8c5b-0a885657e21d-serviceca\") pod \"node-ca-jbkd8\" (UID: \"87a193a1-7c8e-49cd-8c5b-0a885657e21d\") " pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.637986 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-sysctl-d\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.637986 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.636923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-tmp\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.643114 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.643088    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 14 10:24:38.646530 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.646509    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp4zh\" (UniqueName: \"kubernetes.io/projected/87a193a1-7c8e-49cd-8c5b-0a885657e21d-kube-api-access-pp4zh\") pod \"node-ca-jbkd8\" (UID: \"87a193a1-7c8e-49cd-8c5b-0a885657e21d\") " pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.656300 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.656267    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode272105baf092ca2ccbcf8e39766ef49.slice/crio-774249c8d06064e9e62d6beafe64cef8f008b84c7f3ef666f3feffd899b94892 WatchSource:0}: Error finding container 774249c8d06064e9e62d6beafe64cef8f008b84c7f3ef666f3feffd899b94892: Status 404 returned error can't find the container with id 774249c8d06064e9e62d6beafe64cef8f008b84c7f3ef666f3feffd899b94892
Sep 14 10:24:38.657235 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.657211    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bada25af9431b9c44a9cfd351263f89.slice/crio-a2dad91ef2c1979597e5d4ffc36e14d88c1527c1ace5d250804c3d852ac4c623 WatchSource:0}: Error finding container a2dad91ef2c1979597e5d4ffc36e14d88c1527c1ace5d250804c3d852ac4c623: Status 404 returned error can't find the container with id a2dad91ef2c1979597e5d4ffc36e14d88c1527c1ace5d250804c3d852ac4c623
Sep 14 10:24:38.661927 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.661899    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:24:38.737592 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-host\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.737592 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737590    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/051ca948-ae4f-47a9-b04e-919e83e571a2-cnibin\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/051ca948-ae4f-47a9-b04e-919e83e571a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-cnibin\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737651    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-run-ovn\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-log-socket\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737685    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-host\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/051ca948-ae4f-47a9-b04e-919e83e571a2-cnibin\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737719    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-run-ovn\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737723    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-cnibin\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-cni-netd\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737722    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-log-socket\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-socket-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737780    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlctn\" (UniqueName: \"kubernetes.io/projected/2547c7e1-a00d-4746-be71-7db0fe44dab3-kube-api-access-dlctn\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737792    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-cni-netd\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737798    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-var-lib-openvswitch\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.737818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737828    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-ovnkube-config\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-kubernetes\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737893    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737914    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-var-lib-cni-bin\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-var-lib-openvswitch\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737925    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-socket-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737953    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-var-lib-cni-bin\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737967    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.737983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-var-lib-kubelet\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738017    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-run-netns\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738039    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-kubernetes\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738049    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-var-lib-kubelet\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-tuned\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738084    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/edaf9e65-4df9-4d03-8371-8349eb66dfbd-dbus\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738102    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39c8ff7d-ac27-42f6-b599-95faaf70ea65-host-slash\") pod \"iptables-alerter-mfbn8\" (UID: \"39c8ff7d-ac27-42f6-b599-95faaf70ea65\") " pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738131    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-socket-dir-parent\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738137    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39c8ff7d-ac27-42f6-b599-95faaf70ea65-host-slash\") pod \"iptables-alerter-mfbn8\" (UID: \"39c8ff7d-ac27-42f6-b599-95faaf70ea65\") " pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.738476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738099    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-run-netns\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738156    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738184    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-run-systemd\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-socket-dir-parent\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738152    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/edaf9e65-4df9-4d03-8371-8349eb66dfbd-dbus\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738217    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-sysctl-d\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738266    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738274    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/051ca948-ae4f-47a9-b04e-919e83e571a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738278    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-tmp\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738311    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-run-systemd\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.738351    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738336    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-system-cni-dir\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738390    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-etc-kubernetes\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738418    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738436    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-sysctl-d\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738445    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-ovnkube-config\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6fm8\" (UniqueName: \"kubernetes.io/projected/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-kube-api-access-d6fm8\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.739393 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738475    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-etc-kubernetes\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.738507    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs podName:72f769c8-aaf4-4b60-9a6a-afbe278338bc nodeName:}" failed. No retries permitted until 2026-09-14 10:24:39.238485348 +0000 UTC m=+2.123554450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs") pod "network-metrics-daemon-g8jfb" (UID: "72f769c8-aaf4-4b60-9a6a-afbe278338bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738520    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-system-cni-dir\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738550    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28411147-5c17-42e2-91a5-2558eea261f3-konnectivity-ca\") pod \"konnectivity-agent-thqbm\" (UID: \"28411147-5c17-42e2-91a5-2558eea261f3\") " pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-cni-bin\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-sysctl-conf\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738619    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgl59\" (UniqueName: \"kubernetes.io/projected/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-kube-api-access-cgl59\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-cni-dir\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738669    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-run-k8s-cni-cncf-io\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738690    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-run-netns\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-cni-bin\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-run-multus-certs\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-run-k8s-cni-cncf-io\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-run-openvswitch\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738794    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-run-multus-certs\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.740252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-lib-modules\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-sysctl-conf\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738861    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-cni-dir\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738946    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-lib-modules\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738957    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-run-openvswitch\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.738909    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-run-netns\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739067    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6fzk\" (UniqueName: \"kubernetes.io/projected/051ca948-ae4f-47a9-b04e-919e83e571a2-kube-api-access-r6fzk\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28411147-5c17-42e2-91a5-2558eea261f3-konnectivity-ca\") pod \"konnectivity-agent-thqbm\" (UID: \"28411147-5c17-42e2-91a5-2558eea261f3\") " pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-device-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-hostroot\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739182    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-modprobe-d\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-device-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739212    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-hostroot\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739208    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-sysconfig\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739296    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/edaf9e65-4df9-4d03-8371-8349eb66dfbd-kubelet-config\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739304    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-modprobe-d\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739323    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-sys-fs\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739329    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-sysconfig\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.741117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2547c7e1-a00d-4746-be71-7db0fe44dab3-cni-binary-copy\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/edaf9e65-4df9-4d03-8371-8349eb66dfbd-kubelet-config\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739379    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-node-log\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-sys-fs\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-run\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28411147-5c17-42e2-91a5-2558eea261f3-agent-certs\") pod \"konnectivity-agent-thqbm\" (UID: \"28411147-5c17-42e2-91a5-2558eea261f3\") " pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq78v\" (UniqueName: \"kubernetes.io/projected/be40853d-ecb0-4226-b63d-2e9b514a7124-kube-api-access-fq78v\") pod \"node-resolver-zjzt4\" (UID: \"be40853d-ecb0-4226-b63d-2e9b514a7124\") " pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5fp7\" (UniqueName: \"kubernetes.io/projected/72f769c8-aaf4-4b60-9a6a-afbe278338bc-kube-api-access-r5fp7\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739476    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-run\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739427    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-node-log\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-slash\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/051ca948-ae4f-47a9-b04e-919e83e571a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739663    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-slash\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739683    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-registration-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-daemon-config\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739789    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-registration-dir\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-ovn-node-metrics-cert\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.741773 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/051ca948-ae4f-47a9-b04e-919e83e571a2-system-cni-dir\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/051ca948-ae4f-47a9-b04e-919e83e571a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739913    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2547c7e1-a00d-4746-be71-7db0fe44dab3-cni-binary-copy\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739937    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/051ca948-ae4f-47a9-b04e-919e83e571a2-system-cni-dir\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739963    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be40853d-ecb0-4226-b63d-2e9b514a7124-hosts-file\") pod \"node-resolver-zjzt4\" (UID: \"be40853d-ecb0-4226-b63d-2e9b514a7124\") " pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.739989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39c8ff7d-ac27-42f6-b599-95faaf70ea65-iptables-alerter-script\") pod \"iptables-alerter-mfbn8\" (UID: \"39c8ff7d-ac27-42f6-b599-95faaf70ea65\") " pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740015    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-conf-dir\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-systemd\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be40853d-ecb0-4226-b63d-2e9b514a7124-tmp-dir\") pod \"node-resolver-zjzt4\" (UID: \"be40853d-ecb0-4226-b63d-2e9b514a7124\") " pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740087    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-var-lib-cni-multus\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740110    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-kubelet\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-var-lib-kubelet\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740160    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pxbn\" (UniqueName: \"kubernetes.io/projected/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-kube-api-access-8pxbn\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740195    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-host-var-lib-cni-multus\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj8vk\" (UniqueName: \"kubernetes.io/projected/39c8ff7d-ac27-42f6-b599-95faaf70ea65-kube-api-access-dj8vk\") pod \"iptables-alerter-mfbn8\" (UID: \"39c8ff7d-ac27-42f6-b599-95faaf70ea65\") " pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740232    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-systemd-units\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.742330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740244    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-systemd\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740257    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-env-overrides\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/051ca948-ae4f-47a9-b04e-919e83e571a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740281    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-ovnkube-script-lib\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-etc-openvswitch\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740318    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-conf-dir\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740328    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-sys\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740353    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/051ca948-ae4f-47a9-b04e-919e83e571a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740360    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-host-kubelet\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740405    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-var-lib-kubelet\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740417    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2547c7e1-a00d-4746-be71-7db0fe44dab3-multus-daemon-config\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.740472    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740493    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be40853d-ecb0-4226-b63d-2e9b514a7124-tmp-dir\") pod \"node-resolver-zjzt4\" (UID: \"be40853d-ecb0-4226-b63d-2e9b514a7124\") " pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.740523    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret podName:edaf9e65-4df9-4d03-8371-8349eb66dfbd nodeName:}" failed. No retries permitted until 2026-09-14 10:24:39.240505887 +0000 UTC m=+2.125574974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret") pod "global-pull-secret-syncer-kfv78" (UID: "edaf9e65-4df9-4d03-8371-8349eb66dfbd") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740599    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-etc-selinux\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740609    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-etc-openvswitch\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.742844 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/051ca948-ae4f-47a9-b04e-919e83e571a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740641    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39c8ff7d-ac27-42f6-b599-95faaf70ea65-iptables-alerter-script\") pod \"iptables-alerter-mfbn8\" (UID: \"39c8ff7d-ac27-42f6-b599-95faaf70ea65\") " pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740664    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-systemd-units\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740644    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-sys\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.740714    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be40853d-ecb0-4226-b63d-2e9b514a7124-hosts-file\") pod \"node-resolver-zjzt4\" (UID: \"be40853d-ecb0-4226-b63d-2e9b514a7124\") " pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.741013    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-ovnkube-script-lib\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.741094    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-etc-tuned\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.741106    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/051ca948-ae4f-47a9-b04e-919e83e571a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.741112    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-env-overrides\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.741216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-tmp\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.743084    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-ovn-node-metrics-cert\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.743388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.743134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28411147-5c17-42e2-91a5-2558eea261f3-agent-certs\") pod \"konnectivity-agent-thqbm\" (UID: \"28411147-5c17-42e2-91a5-2558eea261f3\") " pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:24:38.749832 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.749811    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlctn\" (UniqueName: \"kubernetes.io/projected/2547c7e1-a00d-4746-be71-7db0fe44dab3-kube-api-access-dlctn\") pod \"multus-nnkhl\" (UID: \"2547c7e1-a00d-4746-be71-7db0fe44dab3\") " pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.749971 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.749934    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6fm8\" (UniqueName: \"kubernetes.io/projected/739a7a19-dcaf-4fda-9ae8-8cc646ac27fa-kube-api-access-d6fm8\") pod \"ovnkube-node-qfb4q\" (UID: \"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.752064 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.752039    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq78v\" (UniqueName: \"kubernetes.io/projected/be40853d-ecb0-4226-b63d-2e9b514a7124-kube-api-access-fq78v\") pod \"node-resolver-zjzt4\" (UID: \"be40853d-ecb0-4226-b63d-2e9b514a7124\") " pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.752211 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.752187    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgl59\" (UniqueName: \"kubernetes.io/projected/0bd9fb5f-2f9d-4dab-9928-400fee3e1237-kube-api-access-cgl59\") pod \"aws-ebs-csi-driver-node-m6n4n\" (UID: \"0bd9fb5f-2f9d-4dab-9928-400fee3e1237\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.752803 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.752785    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6fzk\" (UniqueName: \"kubernetes.io/projected/051ca948-ae4f-47a9-b04e-919e83e571a2-kube-api-access-r6fzk\") pod \"multus-additional-cni-plugins-8mkjw\" (UID: \"051ca948-ae4f-47a9-b04e-919e83e571a2\") " pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.753522 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.753507    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:24:38.753578 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.753530    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:24:38.753578 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.753544    2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmnxr for pod openshift-network-diagnostics/network-check-target-tdj5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:38.753675 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:38.753629    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr podName:3d686589-36c1-4553-a44f-c6d817392c26 nodeName:}" failed. No retries permitted until 2026-09-14 10:24:39.253617462 +0000 UTC m=+2.138686567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xmnxr" (UniqueName: "kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr") pod "network-check-target-tdj5q" (UID: "3d686589-36c1-4553-a44f-c6d817392c26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:38.753905 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.753888    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj8vk\" (UniqueName: \"kubernetes.io/projected/39c8ff7d-ac27-42f6-b599-95faaf70ea65-kube-api-access-dj8vk\") pod \"iptables-alerter-mfbn8\" (UID: \"39c8ff7d-ac27-42f6-b599-95faaf70ea65\") " pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.757968 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.757951    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5fp7\" (UniqueName: \"kubernetes.io/projected/72f769c8-aaf4-4b60-9a6a-afbe278338bc-kube-api-access-r5fp7\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:38.759318 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.759296    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pxbn\" (UniqueName: \"kubernetes.io/projected/4c1a707c-a8b1-49a2-8b8e-7affa349df9e-kube-api-access-8pxbn\") pod \"tuned-pgm6h\" (UID: \"4c1a707c-a8b1-49a2-8b8e-7affa349df9e\") " pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.779451 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.777634    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:24:38.849719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.849644    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jbkd8"
Sep 14 10:24:38.859949 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.859928    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a193a1_7c8e_49cd_8c5b_0a885657e21d.slice/crio-ddcdffb4b5e14aeb0eeba66b7b6e323a7e49bd9ef98b22b92ee783ca0ec406ee WatchSource:0}: Error finding container ddcdffb4b5e14aeb0eeba66b7b6e323a7e49bd9ef98b22b92ee783ca0ec406ee: Status 404 returned error can't find the container with id ddcdffb4b5e14aeb0eeba66b7b6e323a7e49bd9ef98b22b92ee783ca0ec406ee
Sep 14 10:24:38.865080 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.865062    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8mkjw"
Sep 14 10:24:38.873022 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.873004    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051ca948_ae4f_47a9_b04e_919e83e571a2.slice/crio-31d2b26bfd08afb27bc22ffbdf83b8df9a33174e3f9d358677565be6a9273095 WatchSource:0}: Error finding container 31d2b26bfd08afb27bc22ffbdf83b8df9a33174e3f9d358677565be6a9273095: Status 404 returned error can't find the container with id 31d2b26bfd08afb27bc22ffbdf83b8df9a33174e3f9d358677565be6a9273095
Sep 14 10:24:38.879011 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.878995    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:24:38.886886 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.886847    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739a7a19_dcaf_4fda_9ae8_8cc646ac27fa.slice/crio-2d831c851b58fcb3839bd4da4f9fa9c5f7c9260d18f797eca274c185ae7c5239 WatchSource:0}: Error finding container 2d831c851b58fcb3839bd4da4f9fa9c5f7c9260d18f797eca274c185ae7c5239: Status 404 returned error can't find the container with id 2d831c851b58fcb3839bd4da4f9fa9c5f7c9260d18f797eca274c185ae7c5239
Sep 14 10:24:38.891309 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.890941    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n"
Sep 14 10:24:38.899127 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.899106    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd9fb5f_2f9d_4dab_9928_400fee3e1237.slice/crio-5e254a624c27d0e373370e6c28f2d55065c2f1490a6116a4695e89e2aaf260b2 WatchSource:0}: Error finding container 5e254a624c27d0e373370e6c28f2d55065c2f1490a6116a4695e89e2aaf260b2: Status 404 returned error can't find the container with id 5e254a624c27d0e373370e6c28f2d55065c2f1490a6116a4695e89e2aaf260b2
Sep 14 10:24:38.909440 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.909421    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pgm6h"
Sep 14 10:24:38.917092 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.917073    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1a707c_a8b1_49a2_8b8e_7affa349df9e.slice/crio-3a56b8a0f14cc996294ae2838ddfe6d0ba942fc82a05fb2f819e65dec015c393 WatchSource:0}: Error finding container 3a56b8a0f14cc996294ae2838ddfe6d0ba942fc82a05fb2f819e65dec015c393: Status 404 returned error can't find the container with id 3a56b8a0f14cc996294ae2838ddfe6d0ba942fc82a05fb2f819e65dec015c393
Sep 14 10:24:38.925208 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.925189    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zjzt4"
Sep 14 10:24:38.933653 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.933625    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe40853d_ecb0_4226_b63d_2e9b514a7124.slice/crio-949b4fcb4d90c8736bddb79368e9b4485954d1504d330e5ff983a8959f2087c0 WatchSource:0}: Error finding container 949b4fcb4d90c8736bddb79368e9b4485954d1504d330e5ff983a8959f2087c0: Status 404 returned error can't find the container with id 949b4fcb4d90c8736bddb79368e9b4485954d1504d330e5ff983a8959f2087c0
Sep 14 10:24:38.941760 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.941744    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mfbn8"
Sep 14 10:24:38.949792 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.949768    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c8ff7d_ac27_42f6_b599_95faaf70ea65.slice/crio-44aa821f70f4cc7892a17406cb6142815fb6152f515d188b9920566707099380 WatchSource:0}: Error finding container 44aa821f70f4cc7892a17406cb6142815fb6152f515d188b9920566707099380: Status 404 returned error can't find the container with id 44aa821f70f4cc7892a17406cb6142815fb6152f515d188b9920566707099380
Sep 14 10:24:38.953916 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.953901    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:24:38.958534 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:38.958520    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nnkhl"
Sep 14 10:24:38.962995 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.962975    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28411147_5c17_42e2_91a5_2558eea261f3.slice/crio-c9681834d637b00cd18c95f11d3d8999ee375d6903373b1e7263e29c715d874b WatchSource:0}: Error finding container c9681834d637b00cd18c95f11d3d8999ee375d6903373b1e7263e29c715d874b: Status 404 returned error can't find the container with id c9681834d637b00cd18c95f11d3d8999ee375d6903373b1e7263e29c715d874b
Sep 14 10:24:38.967941 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:24:38.967766    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2547c7e1_a00d_4746_be71_7db0fe44dab3.slice/crio-43d029d648c34861b23134b5caf5a4310c75228c6948db89b58a0526308b3349 WatchSource:0}: Error finding container 43d029d648c34861b23134b5caf5a4310c75228c6948db89b58a0526308b3349: Status 404 returned error can't find the container with id 43d029d648c34861b23134b5caf5a4310c75228c6948db89b58a0526308b3349
Sep 14 10:24:39.091288 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.091262    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:24:39.243670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.243632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:39.243869 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.243691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:39.243869 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:39.243807    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:39.243869 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:39.243826    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:39.244016 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:39.243878    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret podName:edaf9e65-4df9-4d03-8371-8349eb66dfbd nodeName:}" failed. No retries permitted until 2026-09-14 10:24:40.243861506 +0000 UTC m=+3.128930610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret") pod "global-pull-secret-syncer-kfv78" (UID: "edaf9e65-4df9-4d03-8371-8349eb66dfbd") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:39.244016 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:39.243909    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs podName:72f769c8-aaf4-4b60-9a6a-afbe278338bc nodeName:}" failed. No retries permitted until 2026-09-14 10:24:40.243901425 +0000 UTC m=+3.128970513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs") pod "network-metrics-daemon-g8jfb" (UID: "72f769c8-aaf4-4b60-9a6a-afbe278338bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:39.344579 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.344528    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:39.344766 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:39.344737    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:24:39.344766 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:39.344765    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:24:39.344971 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:39.344780    2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmnxr for pod openshift-network-diagnostics/network-check-target-tdj5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:39.344971 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:39.344848    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr podName:3d686589-36c1-4553-a44f-c6d817392c26 nodeName:}" failed. No retries permitted until 2026-09-14 10:24:40.344828539 +0000 UTC m=+3.229897631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmnxr" (UniqueName: "kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr") pod "network-check-target-tdj5q" (UID: "3d686589-36c1-4553-a44f-c6d817392c26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:39.596895 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.596772    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 10:19:38 +0000 UTC" deadline="2028-03-15 20:21:16.090579129 +0000 UTC"
Sep 14 10:24:39.596895 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.596842    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13161h56m36.493741348s"
Sep 14 10:24:39.627637 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.627569    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n" event={"ID":"0bd9fb5f-2f9d-4dab-9928-400fee3e1237","Type":"ContainerStarted","Data":"5e254a624c27d0e373370e6c28f2d55065c2f1490a6116a4695e89e2aaf260b2"}
Sep 14 10:24:39.641914 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.641872    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal" event={"ID":"e272105baf092ca2ccbcf8e39766ef49","Type":"ContainerStarted","Data":"774249c8d06064e9e62d6beafe64cef8f008b84c7f3ef666f3feffd899b94892"}
Sep 14 10:24:39.652321 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.652277    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nnkhl" event={"ID":"2547c7e1-a00d-4746-be71-7db0fe44dab3","Type":"ContainerStarted","Data":"43d029d648c34861b23134b5caf5a4310c75228c6948db89b58a0526308b3349"}
Sep 14 10:24:39.691018 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.690971    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-thqbm" event={"ID":"28411147-5c17-42e2-91a5-2558eea261f3","Type":"ContainerStarted","Data":"c9681834d637b00cd18c95f11d3d8999ee375d6903373b1e7263e29c715d874b"}
Sep 14 10:24:39.709731 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.709686    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mfbn8" event={"ID":"39c8ff7d-ac27-42f6-b599-95faaf70ea65","Type":"ContainerStarted","Data":"44aa821f70f4cc7892a17406cb6142815fb6152f515d188b9920566707099380"}
Sep 14 10:24:39.727897 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.727853    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pgm6h" event={"ID":"4c1a707c-a8b1-49a2-8b8e-7affa349df9e","Type":"ContainerStarted","Data":"3a56b8a0f14cc996294ae2838ddfe6d0ba942fc82a05fb2f819e65dec015c393"}
Sep 14 10:24:39.745261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.745173    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" event={"ID":"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa","Type":"ContainerStarted","Data":"2d831c851b58fcb3839bd4da4f9fa9c5f7c9260d18f797eca274c185ae7c5239"}
Sep 14 10:24:39.757654 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.757611    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8mkjw" event={"ID":"051ca948-ae4f-47a9-b04e-919e83e571a2","Type":"ContainerStarted","Data":"31d2b26bfd08afb27bc22ffbdf83b8df9a33174e3f9d358677565be6a9273095"}
Sep 14 10:24:39.771168 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.771129    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jbkd8" event={"ID":"87a193a1-7c8e-49cd-8c5b-0a885657e21d","Type":"ContainerStarted","Data":"ddcdffb4b5e14aeb0eeba66b7b6e323a7e49bd9ef98b22b92ee783ca0ec406ee"}
Sep 14 10:24:39.785638 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.785532    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal" event={"ID":"2bada25af9431b9c44a9cfd351263f89","Type":"ContainerStarted","Data":"a2dad91ef2c1979597e5d4ffc36e14d88c1527c1ace5d250804c3d852ac4c623"}
Sep 14 10:24:39.808435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.808398    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zjzt4" event={"ID":"be40853d-ecb0-4226-b63d-2e9b514a7124","Type":"ContainerStarted","Data":"949b4fcb4d90c8736bddb79368e9b4485954d1504d330e5ff983a8959f2087c0"}
Sep 14 10:24:39.852687 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:39.852605    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:24:40.253157 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:40.253064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:40.253337 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:40.253166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:40.253411 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.253366    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:40.253473 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.253437    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret podName:edaf9e65-4df9-4d03-8371-8349eb66dfbd nodeName:}" failed. No retries permitted until 2026-09-14 10:24:42.253417879 +0000 UTC m=+5.138486968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret") pod "global-pull-secret-syncer-kfv78" (UID: "edaf9e65-4df9-4d03-8371-8349eb66dfbd") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:40.253879 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.253856    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:40.253998 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.253922    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs podName:72f769c8-aaf4-4b60-9a6a-afbe278338bc nodeName:}" failed. No retries permitted until 2026-09-14 10:24:42.253903527 +0000 UTC m=+5.138972622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs") pod "network-metrics-daemon-g8jfb" (UID: "72f769c8-aaf4-4b60-9a6a-afbe278338bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:40.354116 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:40.354080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:40.354297 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.354268    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:24:40.354297 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.354291    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:24:40.354424 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.354307    2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmnxr for pod openshift-network-diagnostics/network-check-target-tdj5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:40.354424 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.354372    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr podName:3d686589-36c1-4553-a44f-c6d817392c26 nodeName:}" failed. No retries permitted until 2026-09-14 10:24:42.354348961 +0000 UTC m=+5.239418069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmnxr" (UniqueName: "kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr") pod "network-check-target-tdj5q" (UID: "3d686589-36c1-4553-a44f-c6d817392c26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:40.598043 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:40.597942    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 10:19:38 +0000 UTC" deadline="2028-05-25 00:50:37.123434258 +0000 UTC"
Sep 14 10:24:40.598043 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:40.597992    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14846h25m56.525448302s"
Sep 14 10:24:40.602427 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:40.602388    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:40.602558 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.602532    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:40.602999 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:40.602979    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:40.603117 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.603093    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:40.603209 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:40.603195    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:40.603407 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:40.603384    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:41.411327 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:41.408118    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 10:24:42.277452 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:42.277413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:42.277942 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:42.277483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:42.277942 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.277636    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:42.277942 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.277715    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs podName:72f769c8-aaf4-4b60-9a6a-afbe278338bc nodeName:}" failed. No retries permitted until 2026-09-14 10:24:46.277678526 +0000 UTC m=+9.162747617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs") pod "network-metrics-daemon-g8jfb" (UID: "72f769c8-aaf4-4b60-9a6a-afbe278338bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:42.278188 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.278166    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:42.278261 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.278227    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret podName:edaf9e65-4df9-4d03-8371-8349eb66dfbd nodeName:}" failed. No retries permitted until 2026-09-14 10:24:46.278211706 +0000 UTC m=+9.163280795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret") pod "global-pull-secret-syncer-kfv78" (UID: "edaf9e65-4df9-4d03-8371-8349eb66dfbd") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:42.378969 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:42.378313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:42.378969 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.378482    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:24:42.378969 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.378500    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:24:42.378969 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.378512    2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmnxr for pod openshift-network-diagnostics/network-check-target-tdj5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:42.378969 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.378567    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr podName:3d686589-36c1-4553-a44f-c6d817392c26 nodeName:}" failed. No retries permitted until 2026-09-14 10:24:46.37854998 +0000 UTC m=+9.263619069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmnxr" (UniqueName: "kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr") pod "network-check-target-tdj5q" (UID: "3d686589-36c1-4553-a44f-c6d817392c26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:42.602426 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:42.602348    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:42.602591 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.602480    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:42.602917 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:42.602896    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:42.603030 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.602996    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:42.603099 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:42.603057    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:42.603150 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:42.603128    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:44.602782 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:44.602314    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:44.602782 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:44.602351    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:44.602782 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:44.602329    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:44.602782 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:44.602453    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:44.602782 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:44.602520    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:44.602782 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:44.602604    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:46.314163 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:46.314123    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:46.314705 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:46.314186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:46.314705 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.314368    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:46.314705 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.314443    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs podName:72f769c8-aaf4-4b60-9a6a-afbe278338bc nodeName:}" failed. No retries permitted until 2026-09-14 10:24:54.314423053 +0000 UTC m=+17.199492157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs") pod "network-metrics-daemon-g8jfb" (UID: "72f769c8-aaf4-4b60-9a6a-afbe278338bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:46.314891 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.314822    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:46.314891 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.314865    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret podName:edaf9e65-4df9-4d03-8371-8349eb66dfbd nodeName:}" failed. No retries permitted until 2026-09-14 10:24:54.314850649 +0000 UTC m=+17.199919750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret") pod "global-pull-secret-syncer-kfv78" (UID: "edaf9e65-4df9-4d03-8371-8349eb66dfbd") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:46.414714 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:46.414622    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:46.414894 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.414784    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:24:46.414894 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.414803    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:24:46.414894 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.414816    2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmnxr for pod openshift-network-diagnostics/network-check-target-tdj5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:46.414894 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.414893    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr podName:3d686589-36c1-4553-a44f-c6d817392c26 nodeName:}" failed. No retries permitted until 2026-09-14 10:24:54.414856678 +0000 UTC m=+17.299925769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmnxr" (UniqueName: "kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr") pod "network-check-target-tdj5q" (UID: "3d686589-36c1-4553-a44f-c6d817392c26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:46.602091 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:46.602057    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:46.602271 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.602228    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:46.602335 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:46.602290    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:46.602384 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.602336    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:46.602384 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:46.602372    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:46.602489 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:46.602417    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:48.602128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:48.602097    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:48.602558 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:48.602128    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:48.602558 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:48.602215    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:48.602558 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:48.602237    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:48.602558 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:48.602323    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:48.602558 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:48.602406    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:50.602830 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:50.602794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:50.603351 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:50.602893    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:50.603351 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:50.603039    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:50.603351 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:50.603047    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:50.603351 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:50.603141    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:50.603351 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:50.603235    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:52.602421 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:52.602387    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:52.602934 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:52.602425    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:52.602934 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:52.602489    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:52.602934 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:52.602504    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:52.602934 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:52.602585    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:52.602934 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:52.602652    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:54.373304 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:54.373272    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:54.373691 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:54.373323    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:54.373691 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.373413    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:54.373691 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.373425    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:54.373691 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.373475    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret podName:edaf9e65-4df9-4d03-8371-8349eb66dfbd nodeName:}" failed. No retries permitted until 2026-09-14 10:25:10.373460411 +0000 UTC m=+33.258529497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret") pod "global-pull-secret-syncer-kfv78" (UID: "edaf9e65-4df9-4d03-8371-8349eb66dfbd") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:24:54.373691 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.373491    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs podName:72f769c8-aaf4-4b60-9a6a-afbe278338bc nodeName:}" failed. No retries permitted until 2026-09-14 10:25:10.373483193 +0000 UTC m=+33.258552278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs") pod "network-metrics-daemon-g8jfb" (UID: "72f769c8-aaf4-4b60-9a6a-afbe278338bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:24:54.474032 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:54.473991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:54.474183 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.474125    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:24:54.474183 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.474142    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:24:54.474183 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.474151    2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmnxr for pod openshift-network-diagnostics/network-check-target-tdj5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:54.474270 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.474203    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr podName:3d686589-36c1-4553-a44f-c6d817392c26 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:10.474188732 +0000 UTC m=+33.359257835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmnxr" (UniqueName: "kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr") pod "network-check-target-tdj5q" (UID: "3d686589-36c1-4553-a44f-c6d817392c26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:24:54.602181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:54.602088    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:54.602181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:54.602105    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:54.602395 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.602212    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:54.602395 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.602295    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:54.602395 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:54.602318    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:54.602526 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:54.602406    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:56.602788 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:56.602748    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:56.603279 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:56.602796    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:56.603279 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:56.602796    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:56.603279 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:56.602928    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:56.603279 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:56.603003    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:56.603279 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:56.603086    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:58.603028 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:58.602992    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:24:58.603447 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:58.602992    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:24:58.603447 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:58.603115    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:24:58.603447 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:58.603172    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:24:58.603447 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:58.602992    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:24:58.603447 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:24:58.603281    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:24:59.870019 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.869548    2574 generic.go:356] "Generic (PLEG): container finished" podID="2bada25af9431b9c44a9cfd351263f89" containerID="7c4c812ba5719cea6cb7844471d136cbc1f1ebbfa48893a57d26cd2e00e92572" exitCode=0
Sep 14 10:24:59.870821 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.869639    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal" event={"ID":"2bada25af9431b9c44a9cfd351263f89","Type":"ContainerDied","Data":"7c4c812ba5719cea6cb7844471d136cbc1f1ebbfa48893a57d26cd2e00e92572"}
Sep 14 10:24:59.871710 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.871679    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zjzt4" event={"ID":"be40853d-ecb0-4226-b63d-2e9b514a7124","Type":"ContainerStarted","Data":"4f5834220471a7686b8290b6b0bcad68a67760f7b2139f31e07a8297a383acad"}
Sep 14 10:24:59.873219 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.873202    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n" event={"ID":"0bd9fb5f-2f9d-4dab-9928-400fee3e1237","Type":"ContainerStarted","Data":"895de8e26bb3a939522615991794ca62fef91083ef96f9b96dbae8c135936d9f"}
Sep 14 10:24:59.874865 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.874837    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal" event={"ID":"e272105baf092ca2ccbcf8e39766ef49","Type":"ContainerStarted","Data":"c323b2f97849bfcf34732240ab359e7cca41e8db385f2406d8a4f07ce8db1eb5"}
Sep 14 10:24:59.876489 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.876460    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nnkhl" event={"ID":"2547c7e1-a00d-4746-be71-7db0fe44dab3","Type":"ContainerStarted","Data":"dd712d62784dd62db0ab6ea26885c6e06e981291ebbdc93aedd418d36cb16060"}
Sep 14 10:24:59.877972 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.877939    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-thqbm" event={"ID":"28411147-5c17-42e2-91a5-2558eea261f3","Type":"ContainerStarted","Data":"4ba5cafab47e67b5664367d07093cec006fb387ce25a909297998089e26dc635"}
Sep 14 10:24:59.879348 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.879327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pgm6h" event={"ID":"4c1a707c-a8b1-49a2-8b8e-7affa349df9e","Type":"ContainerStarted","Data":"2fdc0319d0f34b0ed7a2d52d89aa8eb82dd85b4db7906670eab8beefe870c81e"}
Sep 14 10:24:59.882563 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.882542    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" event={"ID":"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa","Type":"ContainerStarted","Data":"afd8fb849e3fa808ab8de527aab47c1510d1664f621f7cdc2c5b31a005e8ef84"}
Sep 14 10:24:59.882670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.882628    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" event={"ID":"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa","Type":"ContainerStarted","Data":"84b07e31e188683d67d4426fe2f05720d9e1c36b62b8f46d8c153255abbb9e33"}
Sep 14 10:24:59.882717 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.882671    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" event={"ID":"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa","Type":"ContainerStarted","Data":"6d45c14d628d58137861d4de6ce2a10297ee32bc4f17eb01754750c7584006e7"}
Sep 14 10:24:59.882717 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.882707    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" event={"ID":"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa","Type":"ContainerStarted","Data":"5bcc02160ac0b3e3873c35582b7400531810331bf072bfac0d5b7db1dacbbb25"}
Sep 14 10:24:59.882806 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.882754    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" event={"ID":"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa","Type":"ContainerStarted","Data":"f358b2171c255d264d5a8cc453e0c465394f7e14df2feec334aa33e541277285"}
Sep 14 10:24:59.882806 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.882787    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" event={"ID":"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa","Type":"ContainerStarted","Data":"a331f2ee4c49cb422b249665121c2457fc9743343f7569b86d27082d7756a801"}
Sep 14 10:24:59.884126 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.884103    2574 generic.go:356] "Generic (PLEG): container finished" podID="051ca948-ae4f-47a9-b04e-919e83e571a2" containerID="d792109173fcace14f93fa81835a75dbdaae5f814618f1c000e2411f0317b44c" exitCode=0
Sep 14 10:24:59.884225 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.884171    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8mkjw" event={"ID":"051ca948-ae4f-47a9-b04e-919e83e571a2","Type":"ContainerDied","Data":"d792109173fcace14f93fa81835a75dbdaae5f814618f1c000e2411f0317b44c"}
Sep 14 10:24:59.888183 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.888156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jbkd8" event={"ID":"87a193a1-7c8e-49cd-8c5b-0a885657e21d","Type":"ContainerStarted","Data":"ae69425d43f7f27fa5d94e5cdff7d45b152ed549888484473db5f86ee0ddbaa0"}
Sep 14 10:24:59.906024 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.905975    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pgm6h" podStartSLOduration=2.098708427 podStartE2EDuration="21.905961108s" totalImagesPullingTime="19.807252681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:24:59.905638013 +0000 UTC m=+22.790707316" watchObservedRunningTime="2026-09-14 10:24:59.905961108 +0000 UTC m=+22.791030229"
Sep 14 10:24:59.923628 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.923569    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zjzt4" podStartSLOduration=2.134381063 podStartE2EDuration="21.923549845s" totalImagesPullingTime="19.789168782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:24:59.922692227 +0000 UTC m=+22.807761336" watchObservedRunningTime="2026-09-14 10:24:59.923549845 +0000 UTC m=+22.808618956"
Sep 14 10:24:59.942041 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.941985    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-thqbm" podStartSLOduration=2.27647284 podStartE2EDuration="21.941967772s" totalImagesPullingTime="19.665494932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:24:59.941708946 +0000 UTC m=+22.826778054" watchObservedRunningTime="2026-09-14 10:24:59.941967772 +0000 UTC m=+22.827036876"
Sep 14 10:24:59.963015 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.962958    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nnkhl" podStartSLOduration=1.717243794 podStartE2EDuration="21.962936326s" totalImagesPullingTime="20.245692532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:24:59.962907254 +0000 UTC m=+22.847976362" watchObservedRunningTime="2026-09-14 10:24:59.962936326 +0000 UTC m=+22.848005431"
Sep 14 10:24:59.978702 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:24:59.978601    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-156.ec2.internal" podStartSLOduration=21.978585262 podStartE2EDuration="21.978585262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:24:59.978360272 +0000 UTC m=+22.863429382" watchObservedRunningTime="2026-09-14 10:24:59.978585262 +0000 UTC m=+22.863654369"
Sep 14 10:25:00.023821 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:00.023714    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jbkd8" podStartSLOduration=3.255358007 podStartE2EDuration="23.023697158s" totalImagesPullingTime="19.768339151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:00.023508788 +0000 UTC m=+22.908577887" watchObservedRunningTime="2026-09-14 10:25:00.023697158 +0000 UTC m=+22.908766267"
Sep 14 10:25:00.602130 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:00.602057    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:00.602130 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:00.602080    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:00.602320 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:00.602061    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:00.602320 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:00.602187    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:25:00.602407 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:00.602314    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:25:00.602407 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:00.602382    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:25:00.892750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:00.892710    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mfbn8" event={"ID":"39c8ff7d-ac27-42f6-b599-95faaf70ea65","Type":"ContainerStarted","Data":"c4bde27b1856d8364ce07e6c4afeb11f0e6bedb07c73989265104cfde8c6c0c4"}
Sep 14 10:25:00.894964 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:00.894894    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal" event={"ID":"2bada25af9431b9c44a9cfd351263f89","Type":"ContainerStarted","Data":"685a1289e85014f86e10bb351fe3fd550c85b5d513fb706aa0436b22d9c8f8d8"}
Sep 14 10:25:00.909069 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:00.909011    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mfbn8" podStartSLOduration=3.23038635 podStartE2EDuration="22.908994601s" totalImagesPullingTime="19.678608251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:00.908500002 +0000 UTC m=+23.793569110" watchObservedRunningTime="2026-09-14 10:25:00.908994601 +0000 UTC m=+23.794063710"
Sep 14 10:25:00.928786 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:00.928733    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-156.ec2.internal" podStartSLOduration=22.928716182 podStartE2EDuration="22.928716182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:00.928532397 +0000 UTC m=+23.813601509" watchObservedRunningTime="2026-09-14 10:25:00.928716182 +0000 UTC m=+23.813785289"
Sep 14 10:25:01.054935 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:01.054885    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 14 10:25:01.266156 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:01.266068    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:25:01.601108 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:01.600936    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-14T10:25:01.054906835Z","UUID":"6357f9da-6fad-4d26-98cc-f2dd695fdeb5","Handler":null,"Name":"","Endpoint":""}
Sep 14 10:25:01.602939 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:01.602910    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 14 10:25:01.603071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:01.602946    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 14 10:25:01.899199 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:01.899113    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n" event={"ID":"0bd9fb5f-2f9d-4dab-9928-400fee3e1237","Type":"ContainerStarted","Data":"dacfe9927e5293f49c16f3cfa92eef74ab25cb8fbf9e7f691e4b194cd43dfc3f"}
Sep 14 10:25:02.490711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:02.490381    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:25:02.491076 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:02.491059    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:25:02.602984 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:02.602947    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:02.603190 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:02.603067    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:02.603190 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:02.603078    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:25:02.603190 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:02.603092    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:02.603355 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:02.603194    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:25:02.603355 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:02.603296    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:25:02.904462 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:02.904375    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n" event={"ID":"0bd9fb5f-2f9d-4dab-9928-400fee3e1237","Type":"ContainerStarted","Data":"e89c3d1b2c9e90f8f66138fba76e16aa72fe14fa472424467a829f5845dcd8b4"}
Sep 14 10:25:02.908258 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:02.908228    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" event={"ID":"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa","Type":"ContainerStarted","Data":"af2c0d2c1ac43329b774b56aec2cf83ccccb2abafd6b75c76d85b838dfba9d33"}
Sep 14 10:25:02.909022 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:02.908997    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-thqbm"
Sep 14 10:25:02.950598 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:02.950552    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m6n4n" podStartSLOduration=2.535589318 podStartE2EDuration="24.950535636s" totalImagesPullingTime="22.414946318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:02.930193167 +0000 UTC m=+25.815262276" watchObservedRunningTime="2026-09-14 10:25:02.950535636 +0000 UTC m=+25.835604743"
Sep 14 10:25:04.602950 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:04.602919    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:04.603404 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:04.602916    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:04.603404 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:04.603059    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:25:04.603404 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:04.603124    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:25:04.603404 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:04.602914    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:04.603404 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:04.603240    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:25:05.918830 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:05.918601    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" event={"ID":"739a7a19-dcaf-4fda-9ae8-8cc646ac27fa","Type":"ContainerStarted","Data":"8f5eea5d52b91ac2af58973009193096f216a1ec5a724e0ae400b6d338ac62a6"}
Sep 14 10:25:05.919370 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:05.918958    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:25:05.919370 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:05.919021    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:25:05.919370 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:05.919070    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:25:05.920919 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:05.920890    2574 generic.go:356] "Generic (PLEG): container finished" podID="051ca948-ae4f-47a9-b04e-919e83e571a2" containerID="753b37ad3005cd993911e9a66ca209436c5f5c27d7e54ffc362e92ef23aa4fd8" exitCode=0
Sep 14 10:25:05.921058 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:05.920940    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8mkjw" event={"ID":"051ca948-ae4f-47a9-b04e-919e83e571a2","Type":"ContainerDied","Data":"753b37ad3005cd993911e9a66ca209436c5f5c27d7e54ffc362e92ef23aa4fd8"}
Sep 14 10:25:05.935735 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:05.935709    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:25:05.935918 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:05.935809    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:25:05.954211 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:05.954158    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q" podStartSLOduration=8.107939959 podStartE2EDuration="27.954143281s" totalImagesPullingTime="19.846203322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:05.952635264 +0000 UTC m=+28.837704372" watchObservedRunningTime="2026-09-14 10:25:05.954143281 +0000 UTC m=+28.839212384"
Sep 14 10:25:06.603056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:06.603022    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:06.603056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:06.603051    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:06.603248 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:06.603133    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:06.603248 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:06.603150    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:25:06.603248 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:06.603216    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:25:06.603388 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:06.603298    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:25:07.184769 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:07.184678    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kfv78"]
Sep 14 10:25:07.185443 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:07.184804    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:07.185443 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:07.184970    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:25:07.187609 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:07.187556    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8jfb"]
Sep 14 10:25:07.187730 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:07.187681    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:07.187813 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:07.187794    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:25:07.194349 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:07.194327    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tdj5q"]
Sep 14 10:25:07.194446 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:07.194425    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:07.194530 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:07.194513    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:25:07.927840 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:07.927801    2574 generic.go:356] "Generic (PLEG): container finished" podID="051ca948-ae4f-47a9-b04e-919e83e571a2" containerID="0bbfa9993b5c363e857da9dab663f31913a613fbc49a3b3802e308316b6008d3" exitCode=0
Sep 14 10:25:07.928002 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:07.927895    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8mkjw" event={"ID":"051ca948-ae4f-47a9-b04e-919e83e571a2","Type":"ContainerDied","Data":"0bbfa9993b5c363e857da9dab663f31913a613fbc49a3b3802e308316b6008d3"}
Sep 14 10:25:08.602478 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:08.602438    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:08.602960 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:08.602578    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:25:08.933706 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:08.933516    2574 generic.go:356] "Generic (PLEG): container finished" podID="051ca948-ae4f-47a9-b04e-919e83e571a2" containerID="ed5660b5e8f362fab4309c1ba9807e326adf107e392c84416c5f0bb915aca04a" exitCode=0
Sep 14 10:25:08.933864 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:08.933580    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8mkjw" event={"ID":"051ca948-ae4f-47a9-b04e-919e83e571a2","Type":"ContainerDied","Data":"ed5660b5e8f362fab4309c1ba9807e326adf107e392c84416c5f0bb915aca04a"}
Sep 14 10:25:09.602525 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:09.602437    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:09.602525 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:09.602484    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:09.603130 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:09.602594    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:25:09.603130 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:09.602719    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:25:10.396740 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:10.396645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:10.396740 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:10.396711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:10.396992 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:10.396823    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:10.396992 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:10.396840    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:10.396992 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:10.396921    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs podName:72f769c8-aaf4-4b60-9a6a-afbe278338bc nodeName:}" failed. No retries permitted until 2026-09-14 10:25:42.396897784 +0000 UTC m=+65.281966869 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs") pod "network-metrics-daemon-g8jfb" (UID: "72f769c8-aaf4-4b60-9a6a-afbe278338bc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 10:25:10.396992 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:10.396943    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret podName:edaf9e65-4df9-4d03-8371-8349eb66dfbd nodeName:}" failed. No retries permitted until 2026-09-14 10:25:42.396932718 +0000 UTC m=+65.282001992 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret") pod "global-pull-secret-syncer-kfv78" (UID: "edaf9e65-4df9-4d03-8371-8349eb66dfbd") : object "kube-system"/"original-pull-secret" not registered
Sep 14 10:25:10.497684 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:10.497652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:10.497898 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:10.497797    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 10:25:10.497898 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:10.497816    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 10:25:10.497898 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:10.497828    2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmnxr for pod openshift-network-diagnostics/network-check-target-tdj5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:10.498070 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:10.497917    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr podName:3d686589-36c1-4553-a44f-c6d817392c26 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:42.497887134 +0000 UTC m=+65.382956240 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmnxr" (UniqueName: "kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr") pod "network-check-target-tdj5q" (UID: "3d686589-36c1-4553-a44f-c6d817392c26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 10:25:10.602462 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:10.602421    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:10.602677 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:10.602562    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfv78" podUID="edaf9e65-4df9-4d03-8371-8349eb66dfbd"
Sep 14 10:25:11.602358 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.602320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:11.602583 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.602319    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:11.602583 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:11.602454    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdj5q" podUID="3d686589-36c1-4553-a44f-c6d817392c26"
Sep 14 10:25:11.602696 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:11.602584    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jfb" podUID="72f769c8-aaf4-4b60-9a6a-afbe278338bc"
Sep 14 10:25:11.886486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.886403    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-156.ec2.internal" event="NodeReady"
Sep 14 10:25:11.886638 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.886565    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 14 10:25:11.926982 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.926947    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7677d5d4c7-f5kgt"]
Sep 14 10:25:11.944480 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.944443    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-thbpk"]
Sep 14 10:25:11.944665 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.944569    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:11.947261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.947235    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 14 10:25:11.947445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.947331    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp2lw\""
Sep 14 10:25:11.947445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.947417    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 14 10:25:11.947558 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.947473    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 14 10:25:11.957342 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.957138    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 14 10:25:11.962115 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.962088    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-54hlz"]
Sep 14 10:25:11.962251 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.962214    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:11.964831 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.964801    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 14 10:25:11.964831 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.964806    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dh7mm\""
Sep 14 10:25:11.965037 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.964827    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 14 10:25:11.981973 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.981940    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7677d5d4c7-f5kgt"]
Sep 14 10:25:11.982132 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.981982    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-thbpk"]
Sep 14 10:25:11.982132 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.982009    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-54hlz"]
Sep 14 10:25:11.982132 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.982057    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-54hlz"
Sep 14 10:25:11.984833 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.984812    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 14 10:25:11.984976 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.984813    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 14 10:25:11.984976 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.984927    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k6n66\""
Sep 14 10:25:11.985091 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:11.984985    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 14 10:25:12.111485 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-image-registry-private-configuration\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.111485 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-certificates\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.111747 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111521    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-config-volume\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.111747 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.111747 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.111747 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h526g\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-kube-api-access-h526g\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.111977 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111750    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-trusted-ca\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.111977 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111769    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-installation-pull-secrets\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.111977 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111798    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-ca-trust-extracted\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.111977 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111898    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/165e36cd-48b6-4cdc-bb57-aeef5ce536de-cert\") pod \"ingress-canary-54hlz\" (UID: \"165e36cd-48b6-4cdc-bb57-aeef5ce536de\") " pod="openshift-ingress-canary/ingress-canary-54hlz"
Sep 14 10:25:12.111977 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111929    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf8hd\" (UniqueName: \"kubernetes.io/projected/165e36cd-48b6-4cdc-bb57-aeef5ce536de-kube-api-access-gf8hd\") pod \"ingress-canary-54hlz\" (UID: \"165e36cd-48b6-4cdc-bb57-aeef5ce536de\") " pod="openshift-ingress-canary/ingress-canary-54hlz"
Sep 14 10:25:12.111977 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.111969    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-tmp-dir\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.112208 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.112012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8kkw\" (UniqueName: \"kubernetes.io/projected/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-kube-api-access-b8kkw\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.112208 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.112038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-bound-sa-token\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.212796 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.212761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-image-registry-private-configuration\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.212796 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.212804    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-certificates\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.213063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.212828    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-config-volume\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.213063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.212858    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.213063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.212898    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.213063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.212919    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h526g\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-kube-api-access-h526g\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.213063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.212952    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-trusted-ca\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.213063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.212973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-installation-pull-secrets\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.213063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.212998    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-ca-trust-extracted\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.213063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.213030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/165e36cd-48b6-4cdc-bb57-aeef5ce536de-cert\") pod \"ingress-canary-54hlz\" (UID: \"165e36cd-48b6-4cdc-bb57-aeef5ce536de\") " pod="openshift-ingress-canary/ingress-canary-54hlz"
Sep 14 10:25:12.213063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.213054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf8hd\" (UniqueName: \"kubernetes.io/projected/165e36cd-48b6-4cdc-bb57-aeef5ce536de-kube-api-access-gf8hd\") pod \"ingress-canary-54hlz\" (UID: \"165e36cd-48b6-4cdc-bb57-aeef5ce536de\") " pod="openshift-ingress-canary/ingress-canary-54hlz"
Sep 14 10:25:12.213457 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.213088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-tmp-dir\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.213457 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.213122    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8kkw\" (UniqueName: \"kubernetes.io/projected/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-kube-api-access-b8kkw\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.213457 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.213144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-bound-sa-token\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.213598 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.213452    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-certificates\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.214134 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.213743    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 10:25:12.214134 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.213765    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7677d5d4c7-f5kgt: secret "image-registry-tls" not found
Sep 14 10:25:12.214134 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.213804    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-ca-trust-extracted\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.214134 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.213813    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:25:12.214134 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.213840    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls podName:3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:12.713818301 +0000 UTC m=+35.598887399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls") pod "image-registry-7677d5d4c7-f5kgt" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922") : secret "image-registry-tls" not found
Sep 14 10:25:12.214134 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.213909    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls podName:6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b nodeName:}" failed. No retries permitted until 2026-09-14 10:25:12.713889646 +0000 UTC m=+35.598958732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls") pod "dns-default-thbpk" (UID: "6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b") : secret "dns-default-metrics-tls" not found
Sep 14 10:25:12.214134 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.214016    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-config-volume\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.214542 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.214237    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-tmp-dir\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.214672 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.214623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-trusted-ca\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.217923 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.217901    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/165e36cd-48b6-4cdc-bb57-aeef5ce536de-cert\") pod \"ingress-canary-54hlz\" (UID: \"165e36cd-48b6-4cdc-bb57-aeef5ce536de\") " pod="openshift-ingress-canary/ingress-canary-54hlz"
Sep 14 10:25:12.218049 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.217904    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-image-registry-private-configuration\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.218049 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.217955    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-installation-pull-secrets\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.225264 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.225235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h526g\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-kube-api-access-h526g\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.225560 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.225535    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8kkw\" (UniqueName: \"kubernetes.io/projected/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-kube-api-access-b8kkw\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.226528 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.226503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf8hd\" (UniqueName: \"kubernetes.io/projected/165e36cd-48b6-4cdc-bb57-aeef5ce536de-kube-api-access-gf8hd\") pod \"ingress-canary-54hlz\" (UID: \"165e36cd-48b6-4cdc-bb57-aeef5ce536de\") " pod="openshift-ingress-canary/ingress-canary-54hlz"
Sep 14 10:25:12.227134 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.227114    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-bound-sa-token\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.291550 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.291506    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-54hlz"
Sep 14 10:25:12.602024 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.601943    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:12.604929 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.604906    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 10:25:12.716715 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.716679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:12.716952 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.716724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:12.716952 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.716855    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:25:12.716952 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.716934    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 10:25:12.716952 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.716946    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls podName:6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b nodeName:}" failed. No retries permitted until 2026-09-14 10:25:13.716930281 +0000 UTC m=+36.601999388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls") pod "dns-default-thbpk" (UID: "6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b") : secret "dns-default-metrics-tls" not found
Sep 14 10:25:12.716952 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.716948    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7677d5d4c7-f5kgt: secret "image-registry-tls" not found
Sep 14 10:25:12.717232 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:12.716997    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls podName:3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:13.716981074 +0000 UTC m=+36.602050180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls") pod "image-registry-7677d5d4c7-f5kgt" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922") : secret "image-registry-tls" not found
Sep 14 10:25:12.931485 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:12.931436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:13.084299 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.084111    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:13.148345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.148312    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"]
Sep 14 10:25:13.170183 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.170151    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-9gmht"]
Sep 14 10:25:13.170349 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.170276    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.173308 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.173281    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 14 10:25:13.173948 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.173926    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 14 10:25:13.174075 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.173962    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 14 10:25:13.176085 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.176060    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 14 10:25:13.178073 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.178054    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rznpt\""
Sep 14 10:25:13.184311 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.184293    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"]
Sep 14 10:25:13.184434 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.184324    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"]
Sep 14 10:25:13.184434 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.184415    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.187348 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.187329    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 14 10:25:13.190101 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.190070    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 14 10:25:13.190101 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.190089    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:25:13.190275 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.190121    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vjfrn\""
Sep 14 10:25:13.192739 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.192705    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 14 10:25:13.193075 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.193049    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:13.195856 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.195837    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 14 10:25:13.200671 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.200644    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-9gmht"]
Sep 14 10:25:13.200792 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.200704    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"]
Sep 14 10:25:13.200859 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.200808    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.204029 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.204004    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 14 10:25:13.204029 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.204032    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 14 10:25:13.204196 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.204055    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mtfwc\""
Sep 14 10:25:13.204273 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.204258    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 14 10:25:13.204407 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.204394    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:25:13.209452 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.209427    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4"]
Sep 14 10:25:13.235119 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.235095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4"]
Sep 14 10:25:13.235212 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.235138    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-54hlz"]
Sep 14 10:25:13.235368 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.235206    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4"
Sep 14 10:25:13.238072 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:13.238046    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165e36cd_48b6_4cdc_bb57_aeef5ce536de.slice/crio-3390f0a523bd96cefc5df6ab037e0221b87a20a78a323a18cc6ea62b2244522b WatchSource:0}: Error finding container 3390f0a523bd96cefc5df6ab037e0221b87a20a78a323a18cc6ea62b2244522b: Status 404 returned error can't find the container with id 3390f0a523bd96cefc5df6ab037e0221b87a20a78a323a18cc6ea62b2244522b
Sep 14 10:25:13.238218 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.238202    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:25:13.238947 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.238896    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 14 10:25:13.239007 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.238946    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r96xc\""
Sep 14 10:25:13.270171 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.270146    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-xwpfk"]
Sep 14 10:25:13.295666 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.295639    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bbc499686-jdqd8"]
Sep 14 10:25:13.295856 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.295836    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.300902 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.300860    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 14 10:25:13.303637 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.303431    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 14 10:25:13.304098 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.304068    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ll8zc\""
Sep 14 10:25:13.304298 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.304281    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 14 10:25:13.304967 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.304949    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 14 10:25:13.311467 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.311441    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 14 10:25:13.313676 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.313654    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt"]
Sep 14 10:25:13.313819 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.313798    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.317246 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.317222    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 14 10:25:13.317367 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.317254    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 14 10:25:13.317429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.317416    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 14 10:25:13.317502 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.317482    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 14 10:25:13.317699 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.317683    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9d42q\""
Sep 14 10:25:13.317794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.317723    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 14 10:25:13.318078 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.318058    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 14 10:25:13.322229 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.322207    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.322385 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.322360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5wjs\" (UniqueName: \"kubernetes.io/projected/1df802cf-5d9c-48a8-bf65-3f527b45d319-kube-api-access-z5wjs\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.322509 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.322415    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7545b769-2bd9-4233-8670-d659be985d44-config\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.322509 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.322439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrccp\" (UniqueName: \"kubernetes.io/projected/4ec1881a-938a-44c1-b8ff-022c8d261a68-kube-api-access-mrccp\") pod \"volume-data-source-validator-86695b7cc7-smhg4\" (UID: \"4ec1881a-938a-44c1-b8ff-022c8d261a68\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4"
Sep 14 10:25:13.322509 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.322468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7545b769-2bd9-4233-8670-d659be985d44-serving-cert\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.322666 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.322611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l9rb\" (UniqueName: \"kubernetes.io/projected/38918036-e719-4ab8-b090-4f3b82832bd5-kube-api-access-8l9rb\") pod \"service-ca-operator-cf7c776b7-frxdm\" (UID: \"38918036-e719-4ab8-b090-4f3b82832bd5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.322666 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.322636    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7545b769-2bd9-4233-8670-d659be985d44-trusted-ca\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.322666 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.322662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38918036-e719-4ab8-b090-4f3b82832bd5-config\") pod \"service-ca-operator-cf7c776b7-frxdm\" (UID: \"38918036-e719-4ab8-b090-4f3b82832bd5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.322821 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.322689    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1df802cf-5d9c-48a8-bf65-3f527b45d319-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.323048 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.323025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl8gs\" (UniqueName: \"kubernetes.io/projected/7545b769-2bd9-4233-8670-d659be985d44-kube-api-access-xl8gs\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.323129 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.323076    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38918036-e719-4ab8-b090-4f3b82832bd5-serving-cert\") pod \"service-ca-operator-cf7c776b7-frxdm\" (UID: \"38918036-e719-4ab8-b090-4f3b82832bd5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.335859 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.335835    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"]
Sep 14 10:25:13.336024 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.335965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt"
Sep 14 10:25:13.339643 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.339620    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 14 10:25:13.339770 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.339704    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q5bpf\""
Sep 14 10:25:13.339770 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.339747    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 14 10:25:13.349939 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.349914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:13.353933 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.353915    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"]
Sep 14 10:25:13.354042 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.354026    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:13.358520 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.358502    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 14 10:25:13.358622 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.358555    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jkc74\""
Sep 14 10:25:13.358826 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.358811    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:25:13.359073 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.359059    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 14 10:25:13.378258 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.378230    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt"]
Sep 14 10:25:13.378258 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.378263    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-xwpfk"]
Sep 14 10:25:13.378445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.378285    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bbc499686-jdqd8"]
Sep 14 10:25:13.378445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.378306    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"]
Sep 14 10:25:13.378445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.378318    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"]
Sep 14 10:25:13.378445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.378374    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.384380 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.384340    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 14 10:25:13.384579 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.384562    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w4tcj\""
Sep 14 10:25:13.384657 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.384577    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 14 10:25:13.384657 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.384613    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 14 10:25:13.384847 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.384831    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 14 10:25:13.423668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.423639    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l9rb\" (UniqueName: \"kubernetes.io/projected/38918036-e719-4ab8-b090-4f3b82832bd5-kube-api-access-8l9rb\") pod \"service-ca-operator-cf7c776b7-frxdm\" (UID: \"38918036-e719-4ab8-b090-4f3b82832bd5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.423668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.423671    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7545b769-2bd9-4233-8670-d659be985d44-trusted-ca\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.423918 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.423696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.423918 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.423791    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:13.423918 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.423846    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls podName:1df802cf-5d9c-48a8-bf65-3f527b45d319 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:13.923827036 +0000 UTC m=+36.808896125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2dbtk" (UID: "1df802cf-5d9c-48a8-bf65-3f527b45d319") : secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:13.423918 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.423849    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7224b4b8-bcb6-40e7-bade-a29550063f2f-tmp\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.424138 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.423926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6844x\" (UniqueName: \"kubernetes.io/projected/5b0355c4-dff0-48ff-8088-d9c454bdc922-kube-api-access-6844x\") pod \"network-check-source-6f8b768455-vdqgt\" (UID: \"5b0355c4-dff0-48ff-8088-d9c454bdc922\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt"
Sep 14 10:25:13.424138 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-stats-auth\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.424138 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424041    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7545b769-2bd9-4233-8670-d659be985d44-config\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.424138 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7224b4b8-bcb6-40e7-bade-a29550063f2f-trusted-ca-bundle\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.424138 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38918036-e719-4ab8-b090-4f3b82832bd5-config\") pod \"service-ca-operator-cf7c776b7-frxdm\" (UID: \"38918036-e719-4ab8-b090-4f3b82832bd5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.424365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1df802cf-5d9c-48a8-bf65-3f527b45d319-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.424365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl8gs\" (UniqueName: \"kubernetes.io/projected/7545b769-2bd9-4233-8670-d659be985d44-kube-api-access-xl8gs\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.424365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424197    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38918036-e719-4ab8-b090-4f3b82832bd5-serving-cert\") pod \"service-ca-operator-cf7c776b7-frxdm\" (UID: \"38918036-e719-4ab8-b090-4f3b82832bd5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.424365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424230    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5wjs\" (UniqueName: \"kubernetes.io/projected/1df802cf-5d9c-48a8-bf65-3f527b45d319-kube-api-access-z5wjs\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.424365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.424365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrccp\" (UniqueName: \"kubernetes.io/projected/4ec1881a-938a-44c1-b8ff-022c8d261a68-kube-api-access-mrccp\") pod \"volume-data-source-validator-86695b7cc7-smhg4\" (UID: \"4ec1881a-938a-44c1-b8ff-022c8d261a68\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4"
Sep 14 10:25:13.424365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424318    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.424365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424344    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2g9\" (UniqueName: \"kubernetes.io/projected/b3188e21-0cb0-486e-9746-30bdf61825ac-kube-api-access-6f2g9\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.424758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424375    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7545b769-2bd9-4233-8670-d659be985d44-serving-cert\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.424758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424398    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7224b4b8-bcb6-40e7-bade-a29550063f2f-serving-cert\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.424758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7224b4b8-bcb6-40e7-bade-a29550063f2f-snapshots\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.424758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424462    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htq74\" (UniqueName: \"kubernetes.io/projected/7224b4b8-bcb6-40e7-bade-a29550063f2f-kube-api-access-htq74\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.424758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7224b4b8-bcb6-40e7-bade-a29550063f2f-service-ca-bundle\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.424758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-default-certificate\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.424758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424645    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7545b769-2bd9-4233-8670-d659be985d44-config\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.424758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.424694    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7545b769-2bd9-4233-8670-d659be985d44-trusted-ca\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.425114 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.425093    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1df802cf-5d9c-48a8-bf65-3f527b45d319-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.425151 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.425094    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38918036-e719-4ab8-b090-4f3b82832bd5-config\") pod \"service-ca-operator-cf7c776b7-frxdm\" (UID: \"38918036-e719-4ab8-b090-4f3b82832bd5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.427794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.427737    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38918036-e719-4ab8-b090-4f3b82832bd5-serving-cert\") pod \"service-ca-operator-cf7c776b7-frxdm\" (UID: \"38918036-e719-4ab8-b090-4f3b82832bd5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.427907 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.427797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7545b769-2bd9-4233-8670-d659be985d44-serving-cert\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.441040 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.441011    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5wjs\" (UniqueName: \"kubernetes.io/projected/1df802cf-5d9c-48a8-bf65-3f527b45d319-kube-api-access-z5wjs\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.441721 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.441690    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl8gs\" (UniqueName: \"kubernetes.io/projected/7545b769-2bd9-4233-8670-d659be985d44-kube-api-access-xl8gs\") pod \"console-operator-696884fb9c-9gmht\" (UID: \"7545b769-2bd9-4233-8670-d659be985d44\") " pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.441916 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.441721    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrccp\" (UniqueName: \"kubernetes.io/projected/4ec1881a-938a-44c1-b8ff-022c8d261a68-kube-api-access-mrccp\") pod \"volume-data-source-validator-86695b7cc7-smhg4\" (UID: \"4ec1881a-938a-44c1-b8ff-022c8d261a68\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4"
Sep 14 10:25:13.442002 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.441984    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l9rb\" (UniqueName: \"kubernetes.io/projected/38918036-e719-4ab8-b090-4f3b82832bd5-kube-api-access-8l9rb\") pod \"service-ca-operator-cf7c776b7-frxdm\" (UID: \"38918036-e719-4ab8-b090-4f3b82832bd5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.487559 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.487529    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:13.494408 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.494381    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:13.511342 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.511317    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"
Sep 14 10:25:13.525804 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.525778    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7224b4b8-bcb6-40e7-bade-a29550063f2f-tmp\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.525934 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.525819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6844x\" (UniqueName: \"kubernetes.io/projected/5b0355c4-dff0-48ff-8088-d9c454bdc922-kube-api-access-6844x\") pod \"network-check-source-6f8b768455-vdqgt\" (UID: \"5b0355c4-dff0-48ff-8088-d9c454bdc922\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt"
Sep 14 10:25:13.525934 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.525848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/866357bc-923e-4c1b-aa65-3e34fafdbb6a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jcvw4\" (UID: \"866357bc-923e-4c1b-aa65-3e34fafdbb6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.525934 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.525892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sxvp\" (UniqueName: \"kubernetes.io/projected/8439ebe5-6434-4287-b93a-f622111ce8b3-kube-api-access-5sxvp\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:13.525934 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.525921    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-stats-auth\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.526146 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.525946    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:13.526146 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7224b4b8-bcb6-40e7-bade-a29550063f2f-trusted-ca-bundle\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.526146 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssndj\" (UniqueName: \"kubernetes.io/projected/866357bc-923e-4c1b-aa65-3e34fafdbb6a-kube-api-access-ssndj\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jcvw4\" (UID: \"866357bc-923e-4c1b-aa65-3e34fafdbb6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.526146 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526106    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/866357bc-923e-4c1b-aa65-3e34fafdbb6a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jcvw4\" (UID: \"866357bc-923e-4c1b-aa65-3e34fafdbb6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.526338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526192    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.526338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526236    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.526338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7224b4b8-bcb6-40e7-bade-a29550063f2f-tmp\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.526338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526262    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2g9\" (UniqueName: \"kubernetes.io/projected/b3188e21-0cb0-486e-9746-30bdf61825ac-kube-api-access-6f2g9\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.526338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7224b4b8-bcb6-40e7-bade-a29550063f2f-serving-cert\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.526570 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7224b4b8-bcb6-40e7-bade-a29550063f2f-snapshots\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.526570 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.526360    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:25:13.526570 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.526394    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:14.026375311 +0000 UTC m=+36.911444415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : configmap references non-existent config key: service-ca.crt
Sep 14 10:25:13.526570 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.526436    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:14.026410984 +0000 UTC m=+36.911480070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : secret "router-metrics-certs-default" not found
Sep 14 10:25:13.526570 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htq74\" (UniqueName: \"kubernetes.io/projected/7224b4b8-bcb6-40e7-bade-a29550063f2f-kube-api-access-htq74\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.526570 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7224b4b8-bcb6-40e7-bade-a29550063f2f-service-ca-bundle\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.526570 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.526519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-default-certificate\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.527209 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.527153    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7224b4b8-bcb6-40e7-bade-a29550063f2f-trusted-ca-bundle\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.527681 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.527656    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7224b4b8-bcb6-40e7-bade-a29550063f2f-service-ca-bundle\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.527796 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.527778    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7224b4b8-bcb6-40e7-bade-a29550063f2f-snapshots\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.529274 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.529253    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-default-certificate\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.529374 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.529360    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-stats-auth\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.529464 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.529448    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7224b4b8-bcb6-40e7-bade-a29550063f2f-serving-cert\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.543250 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.543226    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htq74\" (UniqueName: \"kubernetes.io/projected/7224b4b8-bcb6-40e7-bade-a29550063f2f-kube-api-access-htq74\") pod \"insights-operator-5844b856db-xwpfk\" (UID: \"7224b4b8-bcb6-40e7-bade-a29550063f2f\") " pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.543547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.543524    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2g9\" (UniqueName: \"kubernetes.io/projected/b3188e21-0cb0-486e-9746-30bdf61825ac-kube-api-access-6f2g9\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:13.545662 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.545640    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6844x\" (UniqueName: \"kubernetes.io/projected/5b0355c4-dff0-48ff-8088-d9c454bdc922-kube-api-access-6844x\") pod \"network-check-source-6f8b768455-vdqgt\" (UID: \"5b0355c4-dff0-48ff-8088-d9c454bdc922\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt"
Sep 14 10:25:13.549052 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.549031    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4"
Sep 14 10:25:13.587093 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.587060    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:13.603161 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.603043    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:13.603665 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.603608    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:13.608750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.608379    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsz5x\""
Sep 14 10:25:13.608750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.608613    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 10:25:13.608750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.608631    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-xwpfk"
Sep 14 10:25:13.609593 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.608863    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rjh76\""
Sep 14 10:25:13.627602 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.627575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/866357bc-923e-4c1b-aa65-3e34fafdbb6a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jcvw4\" (UID: \"866357bc-923e-4c1b-aa65-3e34fafdbb6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.627732 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.627614    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxvp\" (UniqueName: \"kubernetes.io/projected/8439ebe5-6434-4287-b93a-f622111ce8b3-kube-api-access-5sxvp\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:13.627779 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.627728    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:13.627819 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.627774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssndj\" (UniqueName: \"kubernetes.io/projected/866357bc-923e-4c1b-aa65-3e34fafdbb6a-kube-api-access-ssndj\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jcvw4\" (UID: \"866357bc-923e-4c1b-aa65-3e34fafdbb6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.627891 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.627819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/866357bc-923e-4c1b-aa65-3e34fafdbb6a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jcvw4\" (UID: \"866357bc-923e-4c1b-aa65-3e34fafdbb6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.628225 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.628171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/866357bc-923e-4c1b-aa65-3e34fafdbb6a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jcvw4\" (UID: \"866357bc-923e-4c1b-aa65-3e34fafdbb6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.629029 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.628548    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 10:25:13.629029 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.628633    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls podName:8439ebe5-6434-4287-b93a-f622111ce8b3 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:14.128610985 +0000 UTC m=+37.013680087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-vnvn9" (UID: "8439ebe5-6434-4287-b93a-f622111ce8b3") : secret "samples-operator-tls" not found
Sep 14 10:25:13.631694 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.631671    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/866357bc-923e-4c1b-aa65-3e34fafdbb6a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jcvw4\" (UID: \"866357bc-923e-4c1b-aa65-3e34fafdbb6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.640857 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.640811    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssndj\" (UniqueName: \"kubernetes.io/projected/866357bc-923e-4c1b-aa65-3e34fafdbb6a-kube-api-access-ssndj\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jcvw4\" (UID: \"866357bc-923e-4c1b-aa65-3e34fafdbb6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.641232 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.641208    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sxvp\" (UniqueName: \"kubernetes.io/projected/8439ebe5-6434-4287-b93a-f622111ce8b3-kube-api-access-5sxvp\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:13.648865 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.648844    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt"
Sep 14 10:25:13.671008 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.670974    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:13.686983 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.686938    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"
Sep 14 10:25:13.729257 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.729229    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:13.729403 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.729376    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:13.729505 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.729407    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:25:13.729505 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.729471    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls podName:6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b nodeName:}" failed. No retries permitted until 2026-09-14 10:25:15.72945111 +0000 UTC m=+38.614520200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls") pod "dns-default-thbpk" (UID: "6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b") : secret "dns-default-metrics-tls" not found
Sep 14 10:25:13.729661 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.729569    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 10:25:13.729661 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.729589    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7677d5d4c7-f5kgt: secret "image-registry-tls" not found
Sep 14 10:25:13.729964 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.729686    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls podName:3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:15.729622984 +0000 UTC m=+38.614692087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls") pod "image-registry-7677d5d4c7-f5kgt" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922") : secret "image-registry-tls" not found
Sep 14 10:25:13.794137 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.794107    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-9gmht"]
Sep 14 10:25:13.796766 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:13.796725    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7545b769_2bd9_4233_8670_d659be985d44.slice/crio-26762bd7dbdcb9a3de3e76f261c3c9ac9448d145fbb6a15a5aa0a624e1b614c5 WatchSource:0}: Error finding container 26762bd7dbdcb9a3de3e76f261c3c9ac9448d145fbb6a15a5aa0a624e1b614c5: Status 404 returned error can't find the container with id 26762bd7dbdcb9a3de3e76f261c3c9ac9448d145fbb6a15a5aa0a624e1b614c5
Sep 14 10:25:13.817401 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.817380    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm"]
Sep 14 10:25:13.819635 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:13.819605    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38918036_e719_4ab8_b090_4f3b82832bd5.slice/crio-36f21f256018f5e3c8f0f225e8f78c58d5750455e26d27350631ddf0b68a7e37 WatchSource:0}: Error finding container 36f21f256018f5e3c8f0f225e8f78c58d5750455e26d27350631ddf0b68a7e37: Status 404 returned error can't find the container with id 36f21f256018f5e3c8f0f225e8f78c58d5750455e26d27350631ddf0b68a7e37
Sep 14 10:25:13.854193 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.854167    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4"]
Sep 14 10:25:13.857534 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:13.857509    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec1881a_938a_44c1_b8ff_022c8d261a68.slice/crio-ef45a0161734a6202256b411f629d146c5eb37e858ed00cabfa7054f7f0b50a3 WatchSource:0}: Error finding container ef45a0161734a6202256b411f629d146c5eb37e858ed00cabfa7054f7f0b50a3: Status 404 returned error can't find the container with id ef45a0161734a6202256b411f629d146c5eb37e858ed00cabfa7054f7f0b50a3
Sep 14 10:25:13.917433 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.917403    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-xwpfk"]
Sep 14 10:25:13.920675 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:13.920645    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7224b4b8_bcb6_40e7_bade_a29550063f2f.slice/crio-f9eea476a40c1eb6e25bf8b974822db4c2280dc90280a9bc0d7684b06cf15bd8 WatchSource:0}: Error finding container f9eea476a40c1eb6e25bf8b974822db4c2280dc90280a9bc0d7684b06cf15bd8: Status 404 returned error can't find the container with id f9eea476a40c1eb6e25bf8b974822db4c2280dc90280a9bc0d7684b06cf15bd8
Sep 14 10:25:13.930672 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.930619    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:13.930773 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.930756    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:13.930822 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:13.930814    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls podName:1df802cf-5d9c-48a8-bf65-3f527b45d319 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:14.930800343 +0000 UTC m=+37.815869442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2dbtk" (UID: "1df802cf-5d9c-48a8-bf65-3f527b45d319") : secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:13.948212 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.948173    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-xwpfk" event={"ID":"7224b4b8-bcb6-40e7-bade-a29550063f2f","Type":"ContainerStarted","Data":"f9eea476a40c1eb6e25bf8b974822db4c2280dc90280a9bc0d7684b06cf15bd8"}
Sep 14 10:25:13.950904 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.950856    2574 generic.go:356] "Generic (PLEG): container finished" podID="051ca948-ae4f-47a9-b04e-919e83e571a2" containerID="72d468dcf4bcf1702395396ffee9ffe217e4cc63657d3f45f4542a890c71b856" exitCode=0
Sep 14 10:25:13.951023 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.950903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8mkjw" event={"ID":"051ca948-ae4f-47a9-b04e-919e83e571a2","Type":"ContainerDied","Data":"72d468dcf4bcf1702395396ffee9ffe217e4cc63657d3f45f4542a890c71b856"}
Sep 14 10:25:13.952157 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.952132    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-54hlz" event={"ID":"165e36cd-48b6-4cdc-bb57-aeef5ce536de","Type":"ContainerStarted","Data":"3390f0a523bd96cefc5df6ab037e0221b87a20a78a323a18cc6ea62b2244522b"}
Sep 14 10:25:13.953321 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.953303    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4" event={"ID":"4ec1881a-938a-44c1-b8ff-022c8d261a68","Type":"ContainerStarted","Data":"ef45a0161734a6202256b411f629d146c5eb37e858ed00cabfa7054f7f0b50a3"}
Sep 14 10:25:13.955027 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.954487    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm" event={"ID":"38918036-e719-4ab8-b090-4f3b82832bd5","Type":"ContainerStarted","Data":"36f21f256018f5e3c8f0f225e8f78c58d5750455e26d27350631ddf0b68a7e37"}
Sep 14 10:25:13.956273 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.956249    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt"]
Sep 14 10:25:13.956592 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.956515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9gmht" event={"ID":"7545b769-2bd9-4233-8670-d659be985d44","Type":"ContainerStarted","Data":"26762bd7dbdcb9a3de3e76f261c3c9ac9448d145fbb6a15a5aa0a624e1b614c5"}
Sep 14 10:25:13.958855 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:13.958836    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0355c4_dff0_48ff_8088_d9c454bdc922.slice/crio-4a7348f469bee8a3fea635a6b077e34bc8531e750ac0c5ebcc2467c0b2ff00af WatchSource:0}: Error finding container 4a7348f469bee8a3fea635a6b077e34bc8531e750ac0c5ebcc2467c0b2ff00af: Status 404 returned error can't find the container with id 4a7348f469bee8a3fea635a6b077e34bc8531e750ac0c5ebcc2467c0b2ff00af
Sep 14 10:25:13.999916 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:13.998964    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4"]
Sep 14 10:25:14.003606 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:14.003572    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866357bc_923e_4c1b_aa65_3e34fafdbb6a.slice/crio-b1a66f264b2c59e2b64c7012e7a90eeda1479f5ad0fe5ffae215b60855c85f00 WatchSource:0}: Error finding container b1a66f264b2c59e2b64c7012e7a90eeda1479f5ad0fe5ffae215b60855c85f00: Status 404 returned error can't find the container with id b1a66f264b2c59e2b64c7012e7a90eeda1479f5ad0fe5ffae215b60855c85f00
Sep 14 10:25:14.031442 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.031402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:14.031573 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.031452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:14.031640 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:14.031569    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:15.03154712 +0000 UTC m=+37.916616219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : configmap references non-existent config key: service-ca.crt
Sep 14 10:25:14.031640 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:14.031594    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:25:14.031640 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:14.031640    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:15.03162543 +0000 UTC m=+37.916694530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : secret "router-metrics-certs-default" not found
Sep 14 10:25:14.032833 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.032808    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:14.134912 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.132785    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:14.134912 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:14.133341    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 10:25:14.134912 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:14.133415    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls podName:8439ebe5-6434-4287-b93a-f622111ce8b3 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:15.133389753 +0000 UTC m=+38.018458854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-vnvn9" (UID: "8439ebe5-6434-4287-b93a-f622111ce8b3") : secret "samples-operator-tls" not found
Sep 14 10:25:14.137864 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.137831    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:14.479563 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.479512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:14.554052 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.553970    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:14.941532 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.941489    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:14.942006 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:14.941736    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:14.942006 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:14.941808    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls podName:1df802cf-5d9c-48a8-bf65-3f527b45d319 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:16.941785159 +0000 UTC m=+39.826854246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2dbtk" (UID: "1df802cf-5d9c-48a8-bf65-3f527b45d319") : secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:14.968375 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.968338    2574 generic.go:356] "Generic (PLEG): container finished" podID="051ca948-ae4f-47a9-b04e-919e83e571a2" containerID="c4c4f947cedc1492d2b76bc47cb1f040fef48f0dedfb0c8f212745cc6eb5d674" exitCode=0
Sep 14 10:25:14.968558 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.968444    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8mkjw" event={"ID":"051ca948-ae4f-47a9-b04e-919e83e571a2","Type":"ContainerDied","Data":"c4c4f947cedc1492d2b76bc47cb1f040fef48f0dedfb0c8f212745cc6eb5d674"}
Sep 14 10:25:14.978364 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.978303    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4" event={"ID":"866357bc-923e-4c1b-aa65-3e34fafdbb6a","Type":"ContainerStarted","Data":"b1a66f264b2c59e2b64c7012e7a90eeda1479f5ad0fe5ffae215b60855c85f00"}
Sep 14 10:25:14.980034 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:14.979976    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt" event={"ID":"5b0355c4-dff0-48ff-8088-d9c454bdc922","Type":"ContainerStarted","Data":"4a7348f469bee8a3fea635a6b077e34bc8531e750ac0c5ebcc2467c0b2ff00af"}
Sep 14 10:25:15.042219 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:15.042165    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:15.042443 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:15.042238    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:15.042443 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.042417    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:25:15.042688 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.042479    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:17.042459627 +0000 UTC m=+39.927528726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : secret "router-metrics-certs-default" not found
Sep 14 10:25:15.042986 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.042883    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:17.042853471 +0000 UTC m=+39.927922570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : configmap references non-existent config key: service-ca.crt
Sep 14 10:25:15.144472 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:15.142807    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:15.144472 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.143521    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 10:25:15.144472 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.143581    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls podName:8439ebe5-6434-4287-b93a-f622111ce8b3 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:17.143563949 +0000 UTC m=+40.028633050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-vnvn9" (UID: "8439ebe5-6434-4287-b93a-f622111ce8b3") : secret "samples-operator-tls" not found
Sep 14 10:25:15.751445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:15.750523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:15.751445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:15.750636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:15.751445 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.750840    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:25:15.751445 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.750923    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls podName:6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b nodeName:}" failed. No retries permitted until 2026-09-14 10:25:19.750902138 +0000 UTC m=+42.635971224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls") pod "dns-default-thbpk" (UID: "6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b") : secret "dns-default-metrics-tls" not found
Sep 14 10:25:15.751445 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.751345    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 10:25:15.751445 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.751359    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7677d5d4c7-f5kgt: secret "image-registry-tls" not found
Sep 14 10:25:15.751445 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:15.751406    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls podName:3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:19.75139016 +0000 UTC m=+42.636459261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls") pod "image-registry-7677d5d4c7-f5kgt" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922") : secret "image-registry-tls" not found
Sep 14 10:25:15.996549 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:15.995643    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8mkjw" event={"ID":"051ca948-ae4f-47a9-b04e-919e83e571a2","Type":"ContainerStarted","Data":"ff738e266506af98cb7ce68236704808d5c1f878a1501541c1b06810d0df759f"}
Sep 14 10:25:16.030068 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:16.029953    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8mkjw" podStartSLOduration=7.678724248 podStartE2EDuration="39.029933575s" totalImagesPullingTime="31.351209327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:16.029591244 +0000 UTC m=+38.914660354" watchObservedRunningTime="2026-09-14 10:25:16.029933575 +0000 UTC m=+38.915002684"
Sep 14 10:25:16.160635 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:16.160515    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:16.290266 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:16.290173    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:16.962407 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:16.962367    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:16.962610 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:16.962543    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:16.962679 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:16.962628    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls podName:1df802cf-5d9c-48a8-bf65-3f527b45d319 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:20.962606798 +0000 UTC m=+43.847675942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2dbtk" (UID: "1df802cf-5d9c-48a8-bf65-3f527b45d319") : secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:17.063897 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:17.063786    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:17.063897 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:17.063847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:17.064370 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:17.064008    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:21.063984695 +0000 UTC m=+43.949053795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : configmap references non-existent config key: service-ca.crt
Sep 14 10:25:17.064370 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:17.064055    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:25:17.064370 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:17.064096    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:21.064084857 +0000 UTC m=+43.949153943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : secret "router-metrics-certs-default" not found
Sep 14 10:25:17.165516 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:17.165478    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:17.165691 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:17.165659    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 10:25:17.165757 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:17.165742    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls podName:8439ebe5-6434-4287-b93a-f622111ce8b3 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:21.16572192 +0000 UTC m=+44.050791026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-vnvn9" (UID: "8439ebe5-6434-4287-b93a-f622111ce8b3") : secret "samples-operator-tls" not found
Sep 14 10:25:17.347356 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:17.347272    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:17.417731 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:17.417690    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:19.788341 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:19.788299    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:19.788753 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:19.788393    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:19.788753 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:19.788454    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:25:19.788753 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:19.788476    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 10:25:19.788753 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:19.788488    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7677d5d4c7-f5kgt: secret "image-registry-tls" not found
Sep 14 10:25:19.788753 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:19.788523    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls podName:6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b nodeName:}" failed. No retries permitted until 2026-09-14 10:25:27.788506051 +0000 UTC m=+50.673575162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls") pod "dns-default-thbpk" (UID: "6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b") : secret "dns-default-metrics-tls" not found
Sep 14 10:25:19.788753 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:19.788537    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls podName:3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:27.788531648 +0000 UTC m=+50.673600734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls") pod "image-registry-7677d5d4c7-f5kgt" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922") : secret "image-registry-tls" not found
Sep 14 10:25:19.878088 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:19.878052    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"]
Sep 14 10:25:19.909546 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:19.909505    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"]
Sep 14 10:25:19.909729 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:19.909633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:19.912645 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:19.912619    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mb9gf\""
Sep 14 10:25:19.912645 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:19.912641    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 14 10:25:19.913612 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:19.913593    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 14 10:25:20.007635 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.007602    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:20.091602 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.091515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:20.091602 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.091594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:20.107667 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.107621    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:20.183682 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.183645    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:20.192754 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.192717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:20.192943 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.192795    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:20.192943 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:20.192855    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 10:25:20.193057 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:20.192959    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert podName:a9baf0bd-67d4-43e7-a332-f07090b1b9d6 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:20.692937082 +0000 UTC m=+43.578006192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-v6dkv" (UID: "a9baf0bd-67d4-43e7-a332-f07090b1b9d6") : secret "networking-console-plugin-cert" not found
Sep 14 10:25:20.193569 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.193545    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:20.697126 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.697075    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:20.697299 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:20.697259    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 10:25:20.697364 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:20.697350    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert podName:a9baf0bd-67d4-43e7-a332-f07090b1b9d6 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:21.697325046 +0000 UTC m=+44.582394145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-v6dkv" (UID: "a9baf0bd-67d4-43e7-a332-f07090b1b9d6") : secret "networking-console-plugin-cert" not found
Sep 14 10:25:20.999513 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:20.999484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:20.999797 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:20.999628    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:20.999797 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:20.999694    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls podName:1df802cf-5d9c-48a8-bf65-3f527b45d319 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:28.999676093 +0000 UTC m=+51.884745184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2dbtk" (UID: "1df802cf-5d9c-48a8-bf65-3f527b45d319") : secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:21.100769 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:21.100730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:21.100769 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:21.100772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:21.101045 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:21.100902    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:29.100887307 +0000 UTC m=+51.985956407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : configmap references non-existent config key: service-ca.crt
Sep 14 10:25:21.101045 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:21.100963    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:25:21.101045 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:21.101020    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:29.101008358 +0000 UTC m=+51.986077444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : secret "router-metrics-certs-default" not found
Sep 14 10:25:21.201606 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:21.201535    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:21.201715 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:21.201638    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 10:25:21.201715 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:21.201690    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls podName:8439ebe5-6434-4287-b93a-f622111ce8b3 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:29.201675773 +0000 UTC m=+52.086744859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-vnvn9" (UID: "8439ebe5-6434-4287-b93a-f622111ce8b3") : secret "samples-operator-tls" not found
Sep 14 10:25:21.707209 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:21.707107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:21.707391 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:21.707293    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 10:25:21.707391 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:21.707371    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert podName:a9baf0bd-67d4-43e7-a332-f07090b1b9d6 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:23.707348748 +0000 UTC m=+46.592417837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-v6dkv" (UID: "a9baf0bd-67d4-43e7-a332-f07090b1b9d6") : secret "networking-console-plugin-cert" not found
Sep 14 10:25:22.014611 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.014543    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/0.log"
Sep 14 10:25:22.014611 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.014584    2574 generic.go:356] "Generic (PLEG): container finished" podID="7545b769-2bd9-4233-8670-d659be985d44" containerID="78e56a797dc4d28e75c2c15e4ebbf4dda80b6453415c24c56ae5f4eff126d993" exitCode=255
Sep 14 10:25:22.015060 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.014789    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9gmht" event={"ID":"7545b769-2bd9-4233-8670-d659be985d44","Type":"ContainerDied","Data":"78e56a797dc4d28e75c2c15e4ebbf4dda80b6453415c24c56ae5f4eff126d993"}
Sep 14 10:25:22.015060 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.014896    2574 scope.go:117] "RemoveContainer" containerID="78e56a797dc4d28e75c2c15e4ebbf4dda80b6453415c24c56ae5f4eff126d993"
Sep 14 10:25:22.016637 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.016581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-xwpfk" event={"ID":"7224b4b8-bcb6-40e7-bade-a29550063f2f","Type":"ContainerStarted","Data":"7660946ce45c86e7e5e057b37eeacccdb396541e559465af3785a55a55eb0d35"}
Sep 14 10:25:22.018182 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.018155    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-54hlz" event={"ID":"165e36cd-48b6-4cdc-bb57-aeef5ce536de","Type":"ContainerStarted","Data":"24b36e1e0139d43f8992f5acc210328df311660f620f429f99735e985bc6a548"}
Sep 14 10:25:22.019805 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.019777    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4" event={"ID":"4ec1881a-938a-44c1-b8ff-022c8d261a68","Type":"ContainerStarted","Data":"ba5648de1e4fb5587809a546c38bd9736583e0667547cc8a3a5601a5265a040b"}
Sep 14 10:25:22.021329 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.021308    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm" event={"ID":"38918036-e719-4ab8-b090-4f3b82832bd5","Type":"ContainerStarted","Data":"d25cb00a04bb1a072e547813e9a385328f1ad8aa75346e0f815e351f99e8d80f"}
Sep 14 10:25:22.023126 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.022945    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4" event={"ID":"866357bc-923e-4c1b-aa65-3e34fafdbb6a","Type":"ContainerStarted","Data":"1d389f9297bb951ecc5927b8b52bd7024d626b7d62523c4f2ed15b75d5adaa60"}
Sep 14 10:25:22.024596 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.024574    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt" event={"ID":"5b0355c4-dff0-48ff-8088-d9c454bdc922","Type":"ContainerStarted","Data":"04be44ead5ef0571c9c5e6199332d722e329a6d50ba41a9712b3e29f94cb0b3e"}
Sep 14 10:25:22.052404 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.052344    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-smhg4" podStartSLOduration=1.950306609 podStartE2EDuration="9.052323694s" totalImagesPullingTime="7.102017085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:22.05148979 +0000 UTC m=+44.936558897" watchObservedRunningTime="2026-09-14 10:25:22.052323694 +0000 UTC m=+44.937392795"
Sep 14 10:25:22.073717 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.073673    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-xwpfk" podStartSLOduration=1.815522144 podStartE2EDuration="9.073650984s" totalImagesPullingTime="7.25812884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:22.072468645 +0000 UTC m=+44.957537753" watchObservedRunningTime="2026-09-14 10:25:22.073650984 +0000 UTC m=+44.958720091"
Sep 14 10:25:22.128045 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.127156    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vdqgt" podStartSLOduration=1.897596697 podStartE2EDuration="9.12713441s" totalImagesPullingTime="7.229537713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:22.090805204 +0000 UTC m=+44.975874313" watchObservedRunningTime="2026-09-14 10:25:22.12713441 +0000 UTC m=+45.012203519"
Sep 14 10:25:22.128045 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.127663    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-54hlz" podStartSLOduration=3.187500237 podStartE2EDuration="11.127654353s" totalImagesPullingTime="7.940154116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:22.126645539 +0000 UTC m=+45.011714649" watchObservedRunningTime="2026-09-14 10:25:22.127654353 +0000 UTC m=+45.012723462"
Sep 14 10:25:22.153536 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.152609    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm" podStartSLOduration=1.7936018310000001 podStartE2EDuration="9.152586343s" totalImagesPullingTime="7.358984512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:22.151200091 +0000 UTC m=+45.036269200" watchObservedRunningTime="2026-09-14 10:25:22.152586343 +0000 UTC m=+45.037655453"
Sep 14 10:25:22.206897 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.205725    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:22.289313 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.289202    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:22.510698 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.510636    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4" podStartSLOduration=2.335860102 podStartE2EDuration="9.510616858s" totalImagesPullingTime="7.174756756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:22.178983525 +0000 UTC m=+45.064052636" watchObservedRunningTime="2026-09-14 10:25:22.510616858 +0000 UTC m=+45.395686003"
Sep 14 10:25:22.510955 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.510778    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5j2fs"]
Sep 14 10:25:22.531262 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.531230    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5j2fs"]
Sep 14 10:25:22.531456 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.531401    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.533839 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.533807    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:22.536071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.536029    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-msf85\""
Sep 14 10:25:22.536213 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.536029    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 14 10:25:22.536213 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.536053    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 14 10:25:22.617023 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.616927    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fda6cb-d549-4076-bc65-4638d564bbc9-data-volume\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.617194 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.617024    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knwls\" (UniqueName: \"kubernetes.io/projected/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-api-access-knwls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.617194 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.617068    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.617194 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.617151    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.617357 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.617197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9fda6cb-d549-4076-bc65-4638d564bbc9-crio-socket\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.663645 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.663586    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:22.718115 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.718068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.718318 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.718137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9fda6cb-d549-4076-bc65-4638d564bbc9-crio-socket\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.718318 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:22.718246    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:22.718428 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:22.718334    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:23.218310587 +0000 UTC m=+46.103379685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:22.718428 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.718260    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fda6cb-d549-4076-bc65-4638d564bbc9-data-volume\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.718428 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.718395    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9fda6cb-d549-4076-bc65-4638d564bbc9-crio-socket\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.718591 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.718449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwls\" (UniqueName: \"kubernetes.io/projected/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-api-access-knwls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.718591 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.718478    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.718591 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:22.718559    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:25:22.718735 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.718597    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fda6cb-d549-4076-bc65-4638d564bbc9-data-volume\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.718735 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:22.718605    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:23.218594482 +0000 UTC m=+46.103663581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : configmap "kube-rbac-proxy" not found
Sep 14 10:25:22.736006 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.735977    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf"]
Sep 14 10:25:22.742630 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.742563    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knwls\" (UniqueName: \"kubernetes.io/projected/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-api-access-knwls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:22.753058 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.753030    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf"
Sep 14 10:25:22.759375 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.759351    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 14 10:25:22.759516 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.759411    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8ttxv\""
Sep 14 10:25:22.761839 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.761811    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf"]
Sep 14 10:25:22.764132 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.764111    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 14 10:25:22.786085 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.786053    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:22.819535 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.819500    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5zh5\" (UniqueName: \"kubernetes.io/projected/8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a-kube-api-access-f5zh5\") pod \"migrator-8b4d697c5-24ghf\" (UID: \"8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf"
Sep 14 10:25:22.903059 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.903019    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:22.921240 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.921199    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5zh5\" (UniqueName: \"kubernetes.io/projected/8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a-kube-api-access-f5zh5\") pod \"migrator-8b4d697c5-24ghf\" (UID: \"8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf"
Sep 14 10:25:22.932120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:22.932081    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5zh5\" (UniqueName: \"kubernetes.io/projected/8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a-kube-api-access-f5zh5\") pod \"migrator-8b4d697c5-24ghf\" (UID: \"8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf"
Sep 14 10:25:23.035005 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.034968    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:25:23.035636 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.035615    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/0.log"
Sep 14 10:25:23.035758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.035656    2574 generic.go:356] "Generic (PLEG): container finished" podID="7545b769-2bd9-4233-8670-d659be985d44" containerID="53fa43730b61747b88ad9044b0b4a890636812a869787c15eb4ca510db43534b" exitCode=255
Sep 14 10:25:23.035825 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.035785    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9gmht" event={"ID":"7545b769-2bd9-4233-8670-d659be985d44","Type":"ContainerDied","Data":"53fa43730b61747b88ad9044b0b4a890636812a869787c15eb4ca510db43534b"}
Sep 14 10:25:23.035906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.035885    2574 scope.go:117] "RemoveContainer" containerID="78e56a797dc4d28e75c2c15e4ebbf4dda80b6453415c24c56ae5f4eff126d993"
Sep 14 10:25:23.036035 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.036015    2574 scope.go:117] "RemoveContainer" containerID="53fa43730b61747b88ad9044b0b4a890636812a869787c15eb4ca510db43534b"
Sep 14 10:25:23.036746 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:23.036493    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-9gmht_openshift-console-operator(7545b769-2bd9-4233-8670-d659be985d44)\"" pod="openshift-console-operator/console-operator-696884fb9c-9gmht" podUID="7545b769-2bd9-4233-8670-d659be985d44"
Sep 14 10:25:23.064862 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.064837    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf"
Sep 14 10:25:23.188104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.188008    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:23.225288 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.225246    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:23.225465 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.225333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:23.225465 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:23.225361    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:25:23.225465 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:23.225419    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:24.22540409 +0000 UTC m=+47.110473192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : configmap "kube-rbac-proxy" not found
Sep 14 10:25:23.225602 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:23.225471    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:23.225602 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:23.225525    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:24.22551096 +0000 UTC m=+47.110580069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:23.292156 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.292103    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:23.370719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.370686    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf"]
Sep 14 10:25:23.375635 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:23.375606    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5f2204_c5bd_45e0_b716_51fbc2bb1b7a.slice/crio-f565c44e6fdafb2f1d729a69b16d8b7ee8f0af0d522d8d98e2e6a2eff4626afa WatchSource:0}: Error finding container f565c44e6fdafb2f1d729a69b16d8b7ee8f0af0d522d8d98e2e6a2eff4626afa: Status 404 returned error can't find the container with id f565c44e6fdafb2f1d729a69b16d8b7ee8f0af0d522d8d98e2e6a2eff4626afa
Sep 14 10:25:23.383023 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.382995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:23.494607 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.494525    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:23.494607 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.494575    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:23.635409 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.635373    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:23.731121 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.731085    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:23.731263 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:23.731197    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 10:25:23.731263 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:23.731256    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert podName:a9baf0bd-67d4-43e7-a332-f07090b1b9d6 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:27.731240113 +0000 UTC m=+50.616309211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-v6dkv" (UID: "a9baf0bd-67d4-43e7-a332-f07090b1b9d6") : secret "networking-console-plugin-cert" not found
Sep 14 10:25:23.868015 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.867951    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zjzt4_be40853d-ecb0-4226-b63d-2e9b514a7124/dns-node-resolver/0.log"
Sep 14 10:25:23.902621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:23.902588    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:24.013258 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:24.013219    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:24.041301 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:24.041262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf" event={"ID":"8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a","Type":"ContainerStarted","Data":"f565c44e6fdafb2f1d729a69b16d8b7ee8f0af0d522d8d98e2e6a2eff4626afa"}
Sep 14 10:25:24.043228 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:24.043201    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:25:24.043644 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:24.043625    2574 scope.go:117] "RemoveContainer" containerID="53fa43730b61747b88ad9044b0b4a890636812a869787c15eb4ca510db43534b"
Sep 14 10:25:24.043828 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:24.043806    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-9gmht_openshift-console-operator(7545b769-2bd9-4233-8670-d659be985d44)\"" pod="openshift-console-operator/console-operator-696884fb9c-9gmht" podUID="7545b769-2bd9-4233-8670-d659be985d44"
Sep 14 10:25:24.236940 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:24.236893    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:24.237113 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:24.236983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:24.237113 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:24.237029    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:25:24.237113 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:24.237107    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:26.237087115 +0000 UTC m=+49.122156223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : configmap "kube-rbac-proxy" not found
Sep 14 10:25:24.237299 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:24.237149    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:24.237299 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:24.237226    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:26.237208614 +0000 UTC m=+49.122277714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:24.242616 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:24.242588    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:24.342813 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:24.342760    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:24.866675 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:24.866648    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jbkd8_87a193a1-7c8e-49cd-8c5b-0a885657e21d/node-ca/0.log"
Sep 14 10:25:25.046400 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.046376    2574 scope.go:117] "RemoveContainer" containerID="53fa43730b61747b88ad9044b0b4a890636812a869787c15eb4ca510db43534b"
Sep 14 10:25:25.046744 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:25.046547    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-9gmht_openshift-console-operator(7545b769-2bd9-4233-8670-d659be985d44)\"" pod="openshift-console-operator/console-operator-696884fb9c-9gmht" podUID="7545b769-2bd9-4233-8670-d659be985d44"
Sep 14 10:25:25.267813 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.267777    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-54hlz_165e36cd-48b6-4cdc-bb57-aeef5ce536de/serve-healthcheck-canary/0.log"
Sep 14 10:25:25.346233 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.346200    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:25.412437 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.412399    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:25.514986 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.514951    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-vs8jk"]
Sep 14 10:25:25.536696 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.536669    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-vs8jk"]
Sep 14 10:25:25.536833 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.536770    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.539704 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.539679    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 14 10:25:25.540832 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.540810    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 14 10:25:25.540980 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.540808    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fwl7f\""
Sep 14 10:25:25.540980 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.540808    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 14 10:25:25.540980 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.540840    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 14 10:25:25.566885 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.566850    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:25.649203 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.649175    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9b007158-23be-4b9c-a2a1-0574a91e53ad-signing-cabundle\") pod \"service-ca-568869fdc5-vs8jk\" (UID: \"9b007158-23be-4b9c-a2a1-0574a91e53ad\") " pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.649356 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.649240    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c645\" (UniqueName: \"kubernetes.io/projected/9b007158-23be-4b9c-a2a1-0574a91e53ad-kube-api-access-7c645\") pod \"service-ca-568869fdc5-vs8jk\" (UID: \"9b007158-23be-4b9c-a2a1-0574a91e53ad\") " pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.649356 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.649259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9b007158-23be-4b9c-a2a1-0574a91e53ad-signing-key\") pod \"service-ca-568869fdc5-vs8jk\" (UID: \"9b007158-23be-4b9c-a2a1-0574a91e53ad\") " pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.652783 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.652756    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:25.750758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.750673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c645\" (UniqueName: \"kubernetes.io/projected/9b007158-23be-4b9c-a2a1-0574a91e53ad-kube-api-access-7c645\") pod \"service-ca-568869fdc5-vs8jk\" (UID: \"9b007158-23be-4b9c-a2a1-0574a91e53ad\") " pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.750758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.750706    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9b007158-23be-4b9c-a2a1-0574a91e53ad-signing-key\") pod \"service-ca-568869fdc5-vs8jk\" (UID: \"9b007158-23be-4b9c-a2a1-0574a91e53ad\") " pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.751016 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.750996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9b007158-23be-4b9c-a2a1-0574a91e53ad-signing-cabundle\") pod \"service-ca-568869fdc5-vs8jk\" (UID: \"9b007158-23be-4b9c-a2a1-0574a91e53ad\") " pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.751621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.751604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9b007158-23be-4b9c-a2a1-0574a91e53ad-signing-cabundle\") pod \"service-ca-568869fdc5-vs8jk\" (UID: \"9b007158-23be-4b9c-a2a1-0574a91e53ad\") " pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.753224 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.753204    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9b007158-23be-4b9c-a2a1-0574a91e53ad-signing-key\") pod \"service-ca-568869fdc5-vs8jk\" (UID: \"9b007158-23be-4b9c-a2a1-0574a91e53ad\") " pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.762738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.762714    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c645\" (UniqueName: \"kubernetes.io/projected/9b007158-23be-4b9c-a2a1-0574a91e53ad-kube-api-access-7c645\") pod \"service-ca-568869fdc5-vs8jk\" (UID: \"9b007158-23be-4b9c-a2a1-0574a91e53ad\") " pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:25.846364 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:25.846326    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-vs8jk"
Sep 14 10:25:26.054516 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:26.054431    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf" event={"ID":"8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a","Type":"ContainerStarted","Data":"2ede71ad728ccf5c7a29fb6d0558767236e04841ae4535f029d7fece34ba0452"}
Sep 14 10:25:26.054516 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:26.054507    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf" event={"ID":"8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a","Type":"ContainerStarted","Data":"1343e420c60059e08aa6426a32771a3ffaadba2d698b257caf4eb9cb3edf6977"}
Sep 14 10:25:26.086684 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:26.086635    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-24ghf" podStartSLOduration=2.47437429 podStartE2EDuration="4.08661795s" totalImagesPullingTime="1.61224366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:26.085951062 +0000 UTC m=+48.971020172" watchObservedRunningTime="2026-09-14 10:25:26.08661795 +0000 UTC m=+48.971687080"
Sep 14 10:25:26.133084 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:26.133049    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-vs8jk"]
Sep 14 10:25:26.136579 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:26.136551    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b007158_23be_4b9c_a2a1_0574a91e53ad.slice/crio-92bfe348ce04772b4f7c50fe415b98f0c358c0bcbc7f5373992989fa33fd293e WatchSource:0}: Error finding container 92bfe348ce04772b4f7c50fe415b98f0c358c0bcbc7f5373992989fa33fd293e: Status 404 returned error can't find the container with id 92bfe348ce04772b4f7c50fe415b98f0c358c0bcbc7f5373992989fa33fd293e
Sep 14 10:25:26.255816 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:26.255788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:26.255980 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:26.255847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:26.255980 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:26.255941    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:25:26.256099 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:26.256007    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:30.255991198 +0000 UTC m=+53.141060301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : configmap "kube-rbac-proxy" not found
Sep 14 10:25:26.256099 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:26.256011    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:26.256099 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:26.256085    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:30.256066463 +0000 UTC m=+53.141135555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:26.361909 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:26.361812    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:27.060057 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:27.060014    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-vs8jk" event={"ID":"9b007158-23be-4b9c-a2a1-0574a91e53ad","Type":"ContainerStarted","Data":"30100f38e2970905849bd59aacd6bb9e2bd58568bcdf93b3b450c20aae26d95c"}
Sep 14 10:25:27.060514 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:27.060077    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-vs8jk" event={"ID":"9b007158-23be-4b9c-a2a1-0574a91e53ad","Type":"ContainerStarted","Data":"92bfe348ce04772b4f7c50fe415b98f0c358c0bcbc7f5373992989fa33fd293e"}
Sep 14 10:25:27.086330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:27.086274    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-vs8jk" podStartSLOduration=2.086255163 podStartE2EDuration="2.086255163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:27.084758698 +0000 UTC m=+49.969827817" watchObservedRunningTime="2026-09-14 10:25:27.086255163 +0000 UTC m=+49.971324332"
Sep 14 10:25:27.768276 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:27.768236    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:27.768501 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:27.768433    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 10:25:27.768573 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:27.768519    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert podName:a9baf0bd-67d4-43e7-a332-f07090b1b9d6 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:35.768497488 +0000 UTC m=+58.653566592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-v6dkv" (UID: "a9baf0bd-67d4-43e7-a332-f07090b1b9d6") : secret "networking-console-plugin-cert" not found
Sep 14 10:25:27.801236 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:27.801204    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:27.869226 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:27.869175    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:27.869433 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:27.869343    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:27.869433 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:27.869365    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 10:25:27.869546 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:27.869435    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls podName:6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b nodeName:}" failed. No retries permitted until 2026-09-14 10:25:43.8694155 +0000 UTC m=+66.754484604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls") pod "dns-default-thbpk" (UID: "6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b") : secret "dns-default-metrics-tls" not found
Sep 14 10:25:27.869546 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:27.869498    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 10:25:27.869546 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:27.869512    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7677d5d4c7-f5kgt: secret "image-registry-tls" not found
Sep 14 10:25:27.869701 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:27.869561    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls podName:3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:43.869546254 +0000 UTC m=+66.754615354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls") pod "image-registry-7677d5d4c7-f5kgt" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922") : secret "image-registry-tls" not found
Sep 14 10:25:27.932161 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:27.932108    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:28.116591 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:28.116500    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:28.215753 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:28.215715    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:28.316373 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:28.316329    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:28.488933 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:28.488894    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:29.078719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.078680    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:29.078920 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:29.078838    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:29.078967 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:29.078929    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls podName:1df802cf-5d9c-48a8-bf65-3f527b45d319 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:45.0789066 +0000 UTC m=+67.963975686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2dbtk" (UID: "1df802cf-5d9c-48a8-bf65-3f527b45d319") : secret "cluster-monitoring-operator-tls" not found
Sep 14 10:25:29.179480 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.179439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:29.179957 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.179491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:29.179957 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:29.179612    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:45.179595353 +0000 UTC m=+68.064664439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : configmap references non-existent config key: service-ca.crt
Sep 14 10:25:29.179957 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:29.179654    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 10:25:29.179957 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:29.179713    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs podName:b3188e21-0cb0-486e-9746-30bdf61825ac nodeName:}" failed. No retries permitted until 2026-09-14 10:25:45.17970068 +0000 UTC m=+68.064769770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs") pod "router-default-6bbc499686-jdqd8" (UID: "b3188e21-0cb0-486e-9746-30bdf61825ac") : secret "router-metrics-certs-default" not found
Sep 14 10:25:29.281170 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.281126    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:29.283858 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.283824    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8439ebe5-6434-4287-b93a-f622111ce8b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-vnvn9\" (UID: \"8439ebe5-6434-4287-b93a-f622111ce8b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:29.296712 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.296681    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:29.383062 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.382967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:29.565388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.565347    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"
Sep 14 10:25:29.849050 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.849010    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9"]
Sep 14 10:25:29.884251 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:29.884216    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:30.072645 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:30.072606    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9" event={"ID":"8439ebe5-6434-4287-b93a-f622111ce8b3","Type":"ContainerStarted","Data":"308f1c3ea2e596b9f1a87191c6a47b72fec5f3d1978d6f38fbc91d8ad430a7cc"}
Sep 14 10:25:30.073998 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:30.073966    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:30.282744 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:30.282702    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:30.290009 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:30.289984    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:30.290143 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:30.290039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:30.290143 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:30.290117    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 10:25:30.290221 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:30.290189    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:38.290169819 +0000 UTC m=+61.175238912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : configmap "kube-rbac-proxy" not found
Sep 14 10:25:30.290221 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:30.290209    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:30.290303 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:25:30.290258    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls podName:f9fda6cb-d549-4076-bc65-4638d564bbc9 nodeName:}" failed. No retries permitted until 2026-09-14 10:25:38.290242485 +0000 UTC m=+61.175311584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5j2fs" (UID: "f9fda6cb-d549-4076-bc65-4638d564bbc9") : secret "insights-runtime-extractor-tls" not found
Sep 14 10:25:30.486511 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:30.486461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:31.319088 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:31.319033    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:31.501650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:31.501534    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:31.639500 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:31.639472    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:31.745246 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:31.745206    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:31.898285 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:31.898256    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:32.014573 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:32.014531    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:32.082459 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:32.082425    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9" event={"ID":"8439ebe5-6434-4287-b93a-f622111ce8b3","Type":"ContainerStarted","Data":"992cacb1ab261d9a5289e0fdd33e0a00dd229b31b86e87833295a3575d1e498f"}
Sep 14 10:25:32.082617 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:32.082481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9" event={"ID":"8439ebe5-6434-4287-b93a-f622111ce8b3","Type":"ContainerStarted","Data":"6e545295e5d81b4d904fe929dcff71b0b860f8f8c33f5850d4d298b4a3879908"}
Sep 14 10:25:32.292718 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:32.292615    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:32.374704 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:32.374668    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:32.689391 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:32.689358    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:33.088023 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:33.087934    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:33.685506 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:33.685464    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log" limit=1024
Sep 14 10:25:35.840377 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:35.840339    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:35.842919 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:35.842888    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9baf0bd-67d4-43e7-a332-f07090b1b9d6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-v6dkv\" (UID: \"a9baf0bd-67d4-43e7-a332-f07090b1b9d6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:36.120689 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:36.120605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"
Sep 14 10:25:36.447370 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:36.447305    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-vnvn9" podStartSLOduration=21.80027209 podStartE2EDuration="23.447282018s" totalImagesPullingTime="1.647009928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:32.107991172 +0000 UTC m=+54.993060284" watchObservedRunningTime="2026-09-14 10:25:36.447282018 +0000 UTC m=+59.332351127"
Sep 14 10:25:36.448098 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:36.448078    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv"]
Sep 14 10:25:36.451345 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:36.451311    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9baf0bd_67d4_43e7_a332_f07090b1b9d6.slice/crio-68e5bfac76717ae4870c14c4e2429b52107e8f698751e6e3894f2653ba68a51e WatchSource:0}: Error finding container 68e5bfac76717ae4870c14c4e2429b52107e8f698751e6e3894f2653ba68a51e: Status 404 returned error can't find the container with id 68e5bfac76717ae4870c14c4e2429b52107e8f698751e6e3894f2653ba68a51e
Sep 14 10:25:36.602819 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:36.602792    2574 scope.go:117] "RemoveContainer" containerID="53fa43730b61747b88ad9044b0b4a890636812a869787c15eb4ca510db43534b"
Sep 14 10:25:37.101565 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:37.101535    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:25:37.102088 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:37.101649    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9gmht" event={"ID":"7545b769-2bd9-4233-8670-d659be985d44","Type":"ContainerStarted","Data":"b6ced1531379144f3063423c674caf2aa9ece78005ee3aac9cd2fe4b7c668481"}
Sep 14 10:25:37.102191 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:37.102155    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:37.103452 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:37.103429    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv" event={"ID":"a9baf0bd-67d4-43e7-a332-f07090b1b9d6","Type":"ContainerStarted","Data":"68e5bfac76717ae4870c14c4e2429b52107e8f698751e6e3894f2653ba68a51e"}
Sep 14 10:25:37.125081 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:37.125035    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-9gmht" podStartSLOduration=16.743352003 podStartE2EDuration="24.125012064s" totalImagesPullingTime="7.381660061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:37.123051806 +0000 UTC m=+60.008120915" watchObservedRunningTime="2026-09-14 10:25:37.125012064 +0000 UTC m=+60.010081201"
Sep 14 10:25:37.297559 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:37.297498    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-9gmht"
Sep 14 10:25:37.939917 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:37.939859    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qfb4q"
Sep 14 10:25:38.107942 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:38.107900    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv" event={"ID":"a9baf0bd-67d4-43e7-a332-f07090b1b9d6","Type":"ContainerStarted","Data":"56815ff18ea9220e75c51f09799d44b99af170e8527983fd61e6e6a9918d8383"}
Sep 14 10:25:38.129732 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:38.129683    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-v6dkv" podStartSLOduration=18.028832213 podStartE2EDuration="19.129664684s" totalImagesPullingTime="1.100832471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:38.129240456 +0000 UTC m=+61.014309561" watchObservedRunningTime="2026-09-14 10:25:38.129664684 +0000 UTC m=+61.014733774"
Sep 14 10:25:38.365626 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:38.365517    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:38.365626 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:38.365589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:38.366094 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:38.366073    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9fda6cb-d549-4076-bc65-4638d564bbc9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:38.368060 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:38.368041    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9fda6cb-d549-4076-bc65-4638d564bbc9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5j2fs\" (UID: \"f9fda6cb-d549-4076-bc65-4638d564bbc9\") " pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:38.444428 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:38.444394    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-msf85\""
Sep 14 10:25:38.451808 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:38.451786    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5j2fs"
Sep 14 10:25:38.732796 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:38.732761    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5j2fs"]
Sep 14 10:25:38.736448 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:38.736422    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fda6cb_d549_4076_bc65_4638d564bbc9.slice/crio-cdf8e19fa1801ee7f5c85d3f45fb49be795abf4f48b9b06a069d2b98da8c8e33 WatchSource:0}: Error finding container cdf8e19fa1801ee7f5c85d3f45fb49be795abf4f48b9b06a069d2b98da8c8e33: Status 404 returned error can't find the container with id cdf8e19fa1801ee7f5c85d3f45fb49be795abf4f48b9b06a069d2b98da8c8e33
Sep 14 10:25:39.112971 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:39.112879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5j2fs" event={"ID":"f9fda6cb-d549-4076-bc65-4638d564bbc9","Type":"ContainerStarted","Data":"a26d9ed81090a6afe79bb1d8844562f7ab01219e23a10df73082318cf216733b"}
Sep 14 10:25:39.112971 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:39.112940    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5j2fs" event={"ID":"f9fda6cb-d549-4076-bc65-4638d564bbc9","Type":"ContainerStarted","Data":"cdf8e19fa1801ee7f5c85d3f45fb49be795abf4f48b9b06a069d2b98da8c8e33"}
Sep 14 10:25:40.119997 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:40.119958    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5j2fs" event={"ID":"f9fda6cb-d549-4076-bc65-4638d564bbc9","Type":"ContainerStarted","Data":"dfbeddc3732b2fc497364a7a54d3d3816e8e95ac9543d1c3aff7ff20a2527f23"}
Sep 14 10:25:41.129511 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:41.129408    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5j2fs" event={"ID":"f9fda6cb-d549-4076-bc65-4638d564bbc9","Type":"ContainerStarted","Data":"b0e15e433c89cd9f80ea5499b7851b015c041c23e8c6af3b91816617e3475760"}
Sep 14 10:25:41.154513 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:41.154460    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5j2fs" podStartSLOduration=17.211916815 podStartE2EDuration="19.154443261s" totalImagesPullingTime="1.942526446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:25:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:41.154247218 +0000 UTC m=+64.039316325" watchObservedRunningTime="2026-09-14 10:25:41.154443261 +0000 UTC m=+64.039512395"
Sep 14 10:25:42.400672 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.400632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:42.401260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.400755    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:42.403705 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.403682    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 10:25:42.403841 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.403682    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 10:25:42.413376 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.413349    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edaf9e65-4df9-4d03-8371-8349eb66dfbd-original-pull-secret\") pod \"global-pull-secret-syncer-kfv78\" (UID: \"edaf9e65-4df9-4d03-8371-8349eb66dfbd\") " pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:42.413376 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.413377    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72f769c8-aaf4-4b60-9a6a-afbe278338bc-metrics-certs\") pod \"network-metrics-daemon-g8jfb\" (UID: \"72f769c8-aaf4-4b60-9a6a-afbe278338bc\") " pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:42.425123 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.425101    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rjh76\""
Sep 14 10:25:42.432561 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.432545    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jfb"
Sep 14 10:25:42.501807 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.501772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:42.504643 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.504610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmnxr\" (UniqueName: \"kubernetes.io/projected/3d686589-36c1-4553-a44f-c6d817392c26-kube-api-access-xmnxr\") pod \"network-check-target-tdj5q\" (UID: \"3d686589-36c1-4553-a44f-c6d817392c26\") " pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:42.612590 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.612555    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfv78"
Sep 14 10:25:42.720244 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.720218    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsz5x\""
Sep 14 10:25:42.727607 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.727586    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:42.733341 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.733324    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8jfb"]
Sep 14 10:25:42.735702 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:42.735680    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f769c8_aaf4_4b60_9a6a_afbe278338bc.slice/crio-a762f9bb4ef9855178944503468e99a92b00a06b29d7a164718f8cffcd02c6ba WatchSource:0}: Error finding container a762f9bb4ef9855178944503468e99a92b00a06b29d7a164718f8cffcd02c6ba: Status 404 returned error can't find the container with id a762f9bb4ef9855178944503468e99a92b00a06b29d7a164718f8cffcd02c6ba
Sep 14 10:25:42.915266 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:42.915191    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kfv78"]
Sep 14 10:25:42.918049 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:42.918020    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedaf9e65_4df9_4d03_8371_8349eb66dfbd.slice/crio-e2556d76d6fcf0c2b36b78f51d63d9a28c3621364051d7b758b363f4630f7994 WatchSource:0}: Error finding container e2556d76d6fcf0c2b36b78f51d63d9a28c3621364051d7b758b363f4630f7994: Status 404 returned error can't find the container with id e2556d76d6fcf0c2b36b78f51d63d9a28c3621364051d7b758b363f4630f7994
Sep 14 10:25:43.030719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:43.030691    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tdj5q"]
Sep 14 10:25:43.033942 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:43.033911    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d686589_36c1_4553_a44f_c6d817392c26.slice/crio-1fa968812ca8343be28db48c9b9254ebb7a4a1e069dbbb252be816faf4cc38f8 WatchSource:0}: Error finding container 1fa968812ca8343be28db48c9b9254ebb7a4a1e069dbbb252be816faf4cc38f8: Status 404 returned error can't find the container with id 1fa968812ca8343be28db48c9b9254ebb7a4a1e069dbbb252be816faf4cc38f8
Sep 14 10:25:43.138570 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:43.138507    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tdj5q" event={"ID":"3d686589-36c1-4553-a44f-c6d817392c26","Type":"ContainerStarted","Data":"1fa968812ca8343be28db48c9b9254ebb7a4a1e069dbbb252be816faf4cc38f8"}
Sep 14 10:25:43.139836 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:43.139811    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kfv78" event={"ID":"edaf9e65-4df9-4d03-8371-8349eb66dfbd","Type":"ContainerStarted","Data":"e2556d76d6fcf0c2b36b78f51d63d9a28c3621364051d7b758b363f4630f7994"}
Sep 14 10:25:43.141085 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:43.141061    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8jfb" event={"ID":"72f769c8-aaf4-4b60-9a6a-afbe278338bc","Type":"ContainerStarted","Data":"a762f9bb4ef9855178944503468e99a92b00a06b29d7a164718f8cffcd02c6ba"}
Sep 14 10:25:43.916588 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:43.916107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:43.916588 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:43.916210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:43.919624 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:43.919570    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b-metrics-tls\") pod \"dns-default-thbpk\" (UID: \"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b\") " pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:43.920051 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:43.920025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"image-registry-7677d5d4c7-f5kgt\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") " pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:44.063272 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.063239    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp2lw\""
Sep 14 10:25:44.070999 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.070935    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:44.077712 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.076374    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dh7mm\""
Sep 14 10:25:44.083653 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.083535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:44.152233 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.151335    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8jfb" event={"ID":"72f769c8-aaf4-4b60-9a6a-afbe278338bc","Type":"ContainerStarted","Data":"2a4ee5d21fafc0a8dd8c294d878a0839793e8977711e9177d9d8c9044b084765"}
Sep 14 10:25:44.152233 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.151412    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8jfb" event={"ID":"72f769c8-aaf4-4b60-9a6a-afbe278338bc","Type":"ContainerStarted","Data":"f28b6ecf82def98ba7c70a78e1fe81e0f5f8fcd9939a18a780c065fb28258a68"}
Sep 14 10:25:44.155305 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.154991    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tdj5q" event={"ID":"3d686589-36c1-4553-a44f-c6d817392c26","Type":"ContainerStarted","Data":"b02f2d153bd2ec5614da199279346f20ae13350769043ba92d7dc88068094c1b"}
Sep 14 10:25:44.156222 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.155515    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:25:44.172474 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.172354    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g8jfb" podStartSLOduration=65.008415015 podStartE2EDuration="1m6.172333852s" totalImagesPullingTime="1.163918837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:44.170747058 +0000 UTC m=+67.055816169" watchObservedRunningTime="2026-09-14 10:25:44.172333852 +0000 UTC m=+67.057402959"
Sep 14 10:25:44.191260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.191216    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tdj5q" podStartSLOduration=66.191200415 podStartE2EDuration="1m6.191200415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:44.190615971 +0000 UTC m=+67.075685079" watchObservedRunningTime="2026-09-14 10:25:44.191200415 +0000 UTC m=+67.076269525"
Sep 14 10:25:44.358912 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.358832    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7677d5d4c7-f5kgt"]
Sep 14 10:25:44.361902 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:44.361851    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f39e9d2_5f0c_4cd4_b2d2_19ac5c175922.slice/crio-42dbc0b8a353a282adbcc797c483c76356c319d5fefad37a03a4507202275498 WatchSource:0}: Error finding container 42dbc0b8a353a282adbcc797c483c76356c319d5fefad37a03a4507202275498: Status 404 returned error can't find the container with id 42dbc0b8a353a282adbcc797c483c76356c319d5fefad37a03a4507202275498
Sep 14 10:25:44.382997 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:44.382973    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-thbpk"]
Sep 14 10:25:44.385420 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:44.385394    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9f4ee8_3c9e_4178_bd69_8b89d2dcd66b.slice/crio-5c05084db89deca8721aa5212f8fbe8f049f48ac8e43b742a198cada3d4780b2 WatchSource:0}: Error finding container 5c05084db89deca8721aa5212f8fbe8f049f48ac8e43b742a198cada3d4780b2: Status 404 returned error can't find the container with id 5c05084db89deca8721aa5212f8fbe8f049f48ac8e43b742a198cada3d4780b2
Sep 14 10:25:45.129128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.129071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:45.132614 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.132575    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1df802cf-5d9c-48a8-bf65-3f527b45d319-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2dbtk\" (UID: \"1df802cf-5d9c-48a8-bf65-3f527b45d319\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:45.160723 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.160683    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-thbpk" event={"ID":"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b","Type":"ContainerStarted","Data":"5c05084db89deca8721aa5212f8fbe8f049f48ac8e43b742a198cada3d4780b2"}
Sep 14 10:25:45.162982 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.162947    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt" event={"ID":"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922","Type":"ContainerStarted","Data":"036bd295a3e98204f9c0d30f64afef7fe95151d0d35c951c67e0174679e6630e"}
Sep 14 10:25:45.163140 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.163025    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt" event={"ID":"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922","Type":"ContainerStarted","Data":"42dbc0b8a353a282adbcc797c483c76356c319d5fefad37a03a4507202275498"}
Sep 14 10:25:45.163255 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.163235    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:25:45.193184 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.192422    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt" podStartSLOduration=67.192398637 podStartE2EDuration="1m7.192398637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:45.192046868 +0000 UTC m=+68.077115969" watchObservedRunningTime="2026-09-14 10:25:45.192398637 +0000 UTC m=+68.077467746"
Sep 14 10:25:45.229736 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.229690    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:45.229962 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.229747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:45.230849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.230816    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3188e21-0cb0-486e-9746-30bdf61825ac-service-ca-bundle\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:45.233246 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.233198    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3188e21-0cb0-486e-9746-30bdf61825ac-metrics-certs\") pod \"router-default-6bbc499686-jdqd8\" (UID: \"b3188e21-0cb0-486e-9746-30bdf61825ac\") " pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:45.283111 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.283076    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rznpt\""
Sep 14 10:25:45.290656 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.290630    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"
Sep 14 10:25:45.437909 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.437858    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9d42q\""
Sep 14 10:25:45.445252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.445220    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:45.586475 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.586289    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk"]
Sep 14 10:25:45.592912 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:45.589354    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df802cf_5d9c_48a8_bf65_3f527b45d319.slice/crio-9f27b2948c8b8c4814fd4e071986adedc6356993fbc309e419584968750e111d WatchSource:0}: Error finding container 9f27b2948c8b8c4814fd4e071986adedc6356993fbc309e419584968750e111d: Status 404 returned error can't find the container with id 9f27b2948c8b8c4814fd4e071986adedc6356993fbc309e419584968750e111d
Sep 14 10:25:45.729231 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:45.729038    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bbc499686-jdqd8"]
Sep 14 10:25:46.169497 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:46.169460    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk" event={"ID":"1df802cf-5d9c-48a8-bf65-3f527b45d319","Type":"ContainerStarted","Data":"9f27b2948c8b8c4814fd4e071986adedc6356993fbc309e419584968750e111d"}
Sep 14 10:25:47.551608 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:47.551570    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3188e21_0cb0_486e_9746_30bdf61825ac.slice/crio-5c5253bef7bdc2381e9f2f1356bf8da124c27003755cdf4512ffc19d55bdd011 WatchSource:0}: Error finding container 5c5253bef7bdc2381e9f2f1356bf8da124c27003755cdf4512ffc19d55bdd011: Status 404 returned error can't find the container with id 5c5253bef7bdc2381e9f2f1356bf8da124c27003755cdf4512ffc19d55bdd011
Sep 14 10:25:47.963916 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.962087    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"]
Sep 14 10:25:47.966193 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.964971    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"]
Sep 14 10:25:47.966193 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.965124    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:47.967550 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.967527    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:47.968361 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.968183    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 14 10:25:47.969206 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.969184    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 14 10:25:47.969692 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.969672    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 14 10:25:47.970026 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.970008    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 14 10:25:47.971114 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.971076    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 14 10:25:47.971827 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.971800    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"]
Sep 14 10:25:47.973177 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.973154    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 14 10:25:47.973421 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.973405    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 14 10:25:47.973655 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.973626    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 14 10:25:47.974365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.974348    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"
Sep 14 10:25:47.979238 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.979214    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2qlht\""
Sep 14 10:25:47.979357 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.979306    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 14 10:25:47.980253 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.980228    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"]
Sep 14 10:25:47.985174 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.985153    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"]
Sep 14 10:25:47.990131 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:47.990098    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"]
Sep 14 10:25:48.052840 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.052802    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-hub\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.053058 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.052863    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.053058 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.052919    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tslhs\" (UniqueName: \"kubernetes.io/projected/c04d887f-4bfa-466f-826e-fce829cd10df-kube-api-access-tslhs\") pod \"managed-serviceaccount-addon-agent-67696fccc8-xqsfh\" (UID: \"c04d887f-4bfa-466f-826e-fce829cd10df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"
Sep 14 10:25:48.053058 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.052970    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0848277d-498f-4da3-9782-1e6ffbed2be3-tmp\") pod \"klusterlet-addon-workmgr-8599bfb8f9-68jkz\" (UID: \"0848277d-498f-4da3-9782-1e6ffbed2be3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.053058 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.052998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0848277d-498f-4da3-9782-1e6ffbed2be3-klusterlet-config\") pod \"klusterlet-addon-workmgr-8599bfb8f9-68jkz\" (UID: \"0848277d-498f-4da3-9782-1e6ffbed2be3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.053058 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.053054    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkjj2\" (UniqueName: \"kubernetes.io/projected/0848277d-498f-4da3-9782-1e6ffbed2be3-kube-api-access-kkjj2\") pod \"klusterlet-addon-workmgr-8599bfb8f9-68jkz\" (UID: \"0848277d-498f-4da3-9782-1e6ffbed2be3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.053276 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.053079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.053276 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.053103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qngcb\" (UniqueName: \"kubernetes.io/projected/377666a5-d3b5-4d81-9240-1347793fe426-kube-api-access-qngcb\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.053276 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.053134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-ca\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.053276 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.053160    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/377666a5-d3b5-4d81-9240-1347793fe426-additional-service-ca\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.053276 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.053188    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c04d887f-4bfa-466f-826e-fce829cd10df-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67696fccc8-xqsfh\" (UID: \"c04d887f-4bfa-466f-826e-fce829cd10df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"
Sep 14 10:25:48.134512 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.134421    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-6v8gb"]
Sep 14 10:25:48.138020 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.137991    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-6v8gb"
Sep 14 10:25:48.141494 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.141467    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 14 10:25:48.141858 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.141839    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fnz7r\""
Sep 14 10:25:48.141988 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.141958    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 14 10:25:48.154374 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkjj2\" (UniqueName: \"kubernetes.io/projected/0848277d-498f-4da3-9782-1e6ffbed2be3-kube-api-access-kkjj2\") pod \"klusterlet-addon-workmgr-8599bfb8f9-68jkz\" (UID: \"0848277d-498f-4da3-9782-1e6ffbed2be3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.154535 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154385    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.154535 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qngcb\" (UniqueName: \"kubernetes.io/projected/377666a5-d3b5-4d81-9240-1347793fe426-kube-api-access-qngcb\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.154623 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154535    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-ca\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.154623 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/377666a5-d3b5-4d81-9240-1347793fe426-additional-service-ca\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.154623 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c04d887f-4bfa-466f-826e-fce829cd10df-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67696fccc8-xqsfh\" (UID: \"c04d887f-4bfa-466f-826e-fce829cd10df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"
Sep 14 10:25:48.154742 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-hub\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.154742 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.154841 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154752    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tslhs\" (UniqueName: \"kubernetes.io/projected/c04d887f-4bfa-466f-826e-fce829cd10df-kube-api-access-tslhs\") pod \"managed-serviceaccount-addon-agent-67696fccc8-xqsfh\" (UID: \"c04d887f-4bfa-466f-826e-fce829cd10df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"
Sep 14 10:25:48.154841 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0848277d-498f-4da3-9782-1e6ffbed2be3-tmp\") pod \"klusterlet-addon-workmgr-8599bfb8f9-68jkz\" (UID: \"0848277d-498f-4da3-9782-1e6ffbed2be3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.154841 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.154807    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0848277d-498f-4da3-9782-1e6ffbed2be3-klusterlet-config\") pod \"klusterlet-addon-workmgr-8599bfb8f9-68jkz\" (UID: \"0848277d-498f-4da3-9782-1e6ffbed2be3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.155485 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.155397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0848277d-498f-4da3-9782-1e6ffbed2be3-tmp\") pod \"klusterlet-addon-workmgr-8599bfb8f9-68jkz\" (UID: \"0848277d-498f-4da3-9782-1e6ffbed2be3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.155587 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.155488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/377666a5-d3b5-4d81-9240-1347793fe426-additional-service-ca\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.158711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.158657    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-hub\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.160974 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.158794    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.160974 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.159647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c04d887f-4bfa-466f-826e-fce829cd10df-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67696fccc8-xqsfh\" (UID: \"c04d887f-4bfa-466f-826e-fce829cd10df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"
Sep 14 10:25:48.160974 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.159653    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-ca\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.160974 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.159751    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0848277d-498f-4da3-9782-1e6ffbed2be3-klusterlet-config\") pod \"klusterlet-addon-workmgr-8599bfb8f9-68jkz\" (UID: \"0848277d-498f-4da3-9782-1e6ffbed2be3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.161296 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.161275    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/377666a5-d3b5-4d81-9240-1347793fe426-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.162504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.162484    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-6v8gb"]
Sep 14 10:25:48.167935 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.167863    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tslhs\" (UniqueName: \"kubernetes.io/projected/c04d887f-4bfa-466f-826e-fce829cd10df-kube-api-access-tslhs\") pod \"managed-serviceaccount-addon-agent-67696fccc8-xqsfh\" (UID: \"c04d887f-4bfa-466f-826e-fce829cd10df\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"
Sep 14 10:25:48.168075 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.168039    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qngcb\" (UniqueName: \"kubernetes.io/projected/377666a5-d3b5-4d81-9240-1347793fe426-kube-api-access-qngcb\") pod \"cluster-proxy-proxy-agent-86f5968b4f-k99kf\" (UID: \"377666a5-d3b5-4d81-9240-1347793fe426\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.168339 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.168317    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkjj2\" (UniqueName: \"kubernetes.io/projected/0848277d-498f-4da3-9782-1e6ffbed2be3-kube-api-access-kkjj2\") pod \"klusterlet-addon-workmgr-8599bfb8f9-68jkz\" (UID: \"0848277d-498f-4da3-9782-1e6ffbed2be3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.181841 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.181796    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bbc499686-jdqd8" event={"ID":"b3188e21-0cb0-486e-9746-30bdf61825ac","Type":"ContainerStarted","Data":"0950de909918a7c7ebf5ddf49af6a3ca6a11f71dbca3195f2b69d8a7844b6e9a"}
Sep 14 10:25:48.182056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.181859    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bbc499686-jdqd8" event={"ID":"b3188e21-0cb0-486e-9746-30bdf61825ac","Type":"ContainerStarted","Data":"5c5253bef7bdc2381e9f2f1356bf8da124c27003755cdf4512ffc19d55bdd011"}
Sep 14 10:25:48.183817 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.183749    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kfv78" event={"ID":"edaf9e65-4df9-4d03-8371-8349eb66dfbd","Type":"ContainerStarted","Data":"757e3363367003ee260d3d35d9a34f47ae0809226387bbb040bd215d219da341"}
Sep 14 10:25:48.187713 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.187676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-thbpk" event={"ID":"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b","Type":"ContainerStarted","Data":"fe4e1fd8046fa35820fdbd4cd0425c061f64beb08517191c1e0da9f4ad8e0438"}
Sep 14 10:25:48.187827 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.187728    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-thbpk" event={"ID":"6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b","Type":"ContainerStarted","Data":"af55b6b374b0714cfceef09890a4eef7cf98fecd4540e3ecfcd908f84f79c28c"}
Sep 14 10:25:48.188072 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.188026    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:48.217828 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.217770    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bbc499686-jdqd8" podStartSLOduration=35.217750878 podStartE2EDuration="35.217750878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:48.216395145 +0000 UTC m=+71.101464247" watchObservedRunningTime="2026-09-14 10:25:48.217750878 +0000 UTC m=+71.102819985"
Sep 14 10:25:48.242371 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.242316    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-thbpk" podStartSLOduration=34.040698914 podStartE2EDuration="37.242296298s" totalImagesPullingTime="3.201597384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:48.238664203 +0000 UTC m=+71.123733325" watchObservedRunningTime="2026-09-14 10:25:48.242296298 +0000 UTC m=+71.127365407"
Sep 14 10:25:48.256143 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.256092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqd29\" (UniqueName: \"kubernetes.io/projected/ecd49ef6-e67d-4019-834b-f62abf796b3c-kube-api-access-gqd29\") pod \"downloads-76f99584f4-6v8gb\" (UID: \"ecd49ef6-e67d-4019-834b-f62abf796b3c\") " pod="openshift-console/downloads-76f99584f4-6v8gb"
Sep 14 10:25:48.267670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.267604    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kfv78" podStartSLOduration=65.591650279 podStartE2EDuration="1m10.267580819s" totalImagesPullingTime="4.67593054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:48.265587745 +0000 UTC m=+71.150656855" watchObservedRunningTime="2026-09-14 10:25:48.267580819 +0000 UTC m=+71.152649928"
Sep 14 10:25:48.280589 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.280552    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:48.297277 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.297246    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"
Sep 14 10:25:48.306014 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.305988    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"
Sep 14 10:25:48.357466 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.357421    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqd29\" (UniqueName: \"kubernetes.io/projected/ecd49ef6-e67d-4019-834b-f62abf796b3c-kube-api-access-gqd29\") pod \"downloads-76f99584f4-6v8gb\" (UID: \"ecd49ef6-e67d-4019-834b-f62abf796b3c\") " pod="openshift-console/downloads-76f99584f4-6v8gb"
Sep 14 10:25:48.367843 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.367803    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqd29\" (UniqueName: \"kubernetes.io/projected/ecd49ef6-e67d-4019-834b-f62abf796b3c-kube-api-access-gqd29\") pod \"downloads-76f99584f4-6v8gb\" (UID: \"ecd49ef6-e67d-4019-834b-f62abf796b3c\") " pod="openshift-console/downloads-76f99584f4-6v8gb"
Sep 14 10:25:48.445549 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.445509    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:48.448884 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.448835    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:48.465200 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.465155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-6v8gb"
Sep 14 10:25:48.868057 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.867961    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh"]
Sep 14 10:25:48.870435 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:48.870406    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc04d887f_4bfa_466f_826e_fce829cd10df.slice/crio-3c19c330fa1e2e2876aded229082ff478b105acd27409c7efbcc282e0c4c6615 WatchSource:0}: Error finding container 3c19c330fa1e2e2876aded229082ff478b105acd27409c7efbcc282e0c4c6615: Status 404 returned error can't find the container with id 3c19c330fa1e2e2876aded229082ff478b105acd27409c7efbcc282e0c4c6615
Sep 14 10:25:48.882258 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.882220    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-6v8gb"]
Sep 14 10:25:48.898031 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.898000    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"]
Sep 14 10:25:48.900349 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:48.900312    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0848277d_498f_4da3_9782_1e6ffbed2be3.slice/crio-a2c00c4d73964748137b38c4fb65016f3c62a646297c20792e7d50bcbb68fad8 WatchSource:0}: Error finding container a2c00c4d73964748137b38c4fb65016f3c62a646297c20792e7d50bcbb68fad8: Status 404 returned error can't find the container with id a2c00c4d73964748137b38c4fb65016f3c62a646297c20792e7d50bcbb68fad8
Sep 14 10:25:48.905943 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:48.905752    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf"]
Sep 14 10:25:48.908425 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:48.908391    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod377666a5_d3b5_4d81_9240_1347793fe426.slice/crio-0bfb94cb5025174171b7d9ea06d653f57a602c90aad630540eec879ce865f866 WatchSource:0}: Error finding container 0bfb94cb5025174171b7d9ea06d653f57a602c90aad630540eec879ce865f866: Status 404 returned error can't find the container with id 0bfb94cb5025174171b7d9ea06d653f57a602c90aad630540eec879ce865f866
Sep 14 10:25:49.165132 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.165085    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"]
Sep 14 10:25:49.198301 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.198256    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"]
Sep 14 10:25:49.198477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.198305    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz" event={"ID":"0848277d-498f-4da3-9782-1e6ffbed2be3","Type":"ContainerStarted","Data":"a2c00c4d73964748137b38c4fb65016f3c62a646297c20792e7d50bcbb68fad8"}
Sep 14 10:25:49.198477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.198336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf" event={"ID":"377666a5-d3b5-4d81-9240-1347793fe426","Type":"ContainerStarted","Data":"0bfb94cb5025174171b7d9ea06d653f57a602c90aad630540eec879ce865f866"}
Sep 14 10:25:49.198477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.198357    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh" event={"ID":"c04d887f-4bfa-466f-826e-fce829cd10df","Type":"ContainerStarted","Data":"3c19c330fa1e2e2876aded229082ff478b105acd27409c7efbcc282e0c4c6615"}
Sep 14 10:25:49.198477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.198436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"
Sep 14 10:25:49.199963 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.199922    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk" event={"ID":"1df802cf-5d9c-48a8-bf65-3f527b45d319","Type":"ContainerStarted","Data":"530c28545ede7ed0c8f0eccce614687463dc2217bcd2e18a9d610504cce28e56"}
Sep 14 10:25:49.201942 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.201919    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 14 10:25:49.202982 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.202361    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zvvfh\""
Sep 14 10:25:49.202982 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.202525    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-6v8gb" event={"ID":"ecd49ef6-e67d-4019-834b-f62abf796b3c","Type":"ContainerStarted","Data":"dc64ba045ad3f2daa3384da970efe05c1df2780440c9b10402be960805c5d0db"}
Sep 14 10:25:49.202982 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.202929    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:49.205208 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.205189    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bbc499686-jdqd8"
Sep 14 10:25:49.265292 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.265257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d6ff551-9424-4de8-873c-73cfe5302e63-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hljwn\" (UID: \"2d6ff551-9424-4de8-873c-73cfe5302e63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"
Sep 14 10:25:49.269370 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.269322    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2dbtk" podStartSLOduration=33.269275582 podStartE2EDuration="36.26930465s" totalImagesPullingTime="3.000029068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:49.267605459 +0000 UTC m=+72.152674578" watchObservedRunningTime="2026-09-14 10:25:49.26930465 +0000 UTC m=+72.154373758"
Sep 14 10:25:49.366333 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.366292    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d6ff551-9424-4de8-873c-73cfe5302e63-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hljwn\" (UID: \"2d6ff551-9424-4de8-873c-73cfe5302e63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"
Sep 14 10:25:49.369318 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.369282    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d6ff551-9424-4de8-873c-73cfe5302e63-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hljwn\" (UID: \"2d6ff551-9424-4de8-873c-73cfe5302e63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"
Sep 14 10:25:49.512895 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.512783    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"
Sep 14 10:25:49.803922 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:49.803847    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"]
Sep 14 10:25:49.810728 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:49.810697    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6ff551_9424_4de8_873c_73cfe5302e63.slice/crio-26effe0c92fd5875fa0f19e31fe33613fef68d0293c0886c500a5e2dd14c8a6c WatchSource:0}: Error finding container 26effe0c92fd5875fa0f19e31fe33613fef68d0293c0886c500a5e2dd14c8a6c: Status 404 returned error can't find the container with id 26effe0c92fd5875fa0f19e31fe33613fef68d0293c0886c500a5e2dd14c8a6c
Sep 14 10:25:50.218486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.217930    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn" event={"ID":"2d6ff551-9424-4de8-873c-73cfe5302e63","Type":"ContainerStarted","Data":"26effe0c92fd5875fa0f19e31fe33613fef68d0293c0886c500a5e2dd14c8a6c"}
Sep 14 10:25:50.830593 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.829055    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56cbb49964-pl58p"]
Sep 14 10:25:50.852001 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.850471    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cbb49964-pl58p"]
Sep 14 10:25:50.852001 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.850611    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:50.854776 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.854104    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 10:25:50.854776 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.854349    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r7wmm\""
Sep 14 10:25:50.854776 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.854610    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 10:25:50.857543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.855540    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 10:25:50.857543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.856446    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 10:25:50.857543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.857118    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 10:25:50.982053 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.982014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-service-ca\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:50.982234 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.982077    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-serving-cert\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:50.982234 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.982109    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-652fq\" (UniqueName: \"kubernetes.io/projected/5749c0e2-1ce8-4ffe-92e2-192e679731c5-kube-api-access-652fq\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:50.982234 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.982144    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-oauth-config\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:50.982234 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.982167    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-oauth-serving-cert\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:50.982450 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:50.982266    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-config\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.083900 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.083790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-serving-cert\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.083900 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.083849    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-652fq\" (UniqueName: \"kubernetes.io/projected/5749c0e2-1ce8-4ffe-92e2-192e679731c5-kube-api-access-652fq\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.083900 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.083901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-oauth-config\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.084170 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.083925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-oauth-serving-cert\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.084170 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.084017    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-config\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.084170 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.084063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-service-ca\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.085631 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.084833    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-service-ca\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.087548 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.086729    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-oauth-serving-cert\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.087548 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.087313    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-config\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.105827 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.105711    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-serving-cert\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.112381 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.112281    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-oauth-config\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.116014 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.115918    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-652fq\" (UniqueName: \"kubernetes.io/projected/5749c0e2-1ce8-4ffe-92e2-192e679731c5-kube-api-access-652fq\") pod \"console-56cbb49964-pl58p\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") " pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.168468 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.168148    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:25:51.528157 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:51.527998    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cbb49964-pl58p"]
Sep 14 10:25:54.171836 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:25:54.171793    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5749c0e2_1ce8_4ffe_92e2_192e679731c5.slice/crio-48340c563441ac20edda7d5517e20ac1a3c37c69e63e329d2652447a7988d626 WatchSource:0}: Error finding container 48340c563441ac20edda7d5517e20ac1a3c37c69e63e329d2652447a7988d626: Status 404 returned error can't find the container with id 48340c563441ac20edda7d5517e20ac1a3c37c69e63e329d2652447a7988d626
Sep 14 10:25:54.254152 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:54.254109    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cbb49964-pl58p" event={"ID":"5749c0e2-1ce8-4ffe-92e2-192e679731c5","Type":"ContainerStarted","Data":"48340c563441ac20edda7d5517e20ac1a3c37c69e63e329d2652447a7988d626"}
Sep 14 10:25:58.205396 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.205352    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-thbpk"
Sep 14 10:25:58.282211 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.282165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf" event={"ID":"377666a5-d3b5-4d81-9240-1347793fe426","Type":"ContainerStarted","Data":"977dd3efaeae79a83bafdf9678e3d751971ecaa3e4d3e4e3410cf5714a409df2"}
Sep 14 10:25:58.282368 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.282225    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf" event={"ID":"377666a5-d3b5-4d81-9240-1347793fe426","Type":"ContainerStarted","Data":"b8f22dd41666ee19efc4d0ae572454107387f93999f383d0e002cb4cb2fc1e14"}
Sep 14 10:25:58.282368 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.282244    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf" event={"ID":"377666a5-d3b5-4d81-9240-1347793fe426","Type":"ContainerStarted","Data":"a748b8dfca16f9c22f7c7ff2f5dba9a7e1b71d6da4a77d3ddc1f4998e36cb216"}
Sep 14 10:25:58.285346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.284904    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn" event={"ID":"2d6ff551-9424-4de8-873c-73cfe5302e63","Type":"ContainerStarted","Data":"4cfad92b41966bb8162e3f4a9ecc8faed335da45b730b6fd189aeef06b8adfce"}
Sep 14 10:25:58.285346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.285114    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"
Sep 14 10:25:58.288112 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.288077    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh" event={"ID":"c04d887f-4bfa-466f-826e-fce829cd10df","Type":"ContainerStarted","Data":"4b3c10287afbd90912bf116d8440252b58a30271530b8a69ef897c2455a3350e"}
Sep 14 10:25:58.290177 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.290138    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz" event={"ID":"0848277d-498f-4da3-9782-1e6ffbed2be3","Type":"ContainerStarted","Data":"b6f1ee5407ca6aed247125b4f0b31abd83090bea62c672af0a061e71f55dee2b"}
Sep 14 10:25:58.290771 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.290748    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:58.294921 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.291925    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn"
Sep 14 10:25:58.294921 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.292519    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz"
Sep 14 10:25:58.304529 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.304477    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86f5968b4f-k99kf" podStartSLOduration=2.591939852 podStartE2EDuration="11.304455379s" totalImagesPullingTime="8.712515527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:58.30335583 +0000 UTC m=+81.188424938" watchObservedRunningTime="2026-09-14 10:25:58.304455379 +0000 UTC m=+81.189524489"
Sep 14 10:25:58.321454 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.321388    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67696fccc8-xqsfh" podStartSLOduration=2.594737614 podStartE2EDuration="11.321364428s" totalImagesPullingTime="8.726626814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:58.319498029 +0000 UTC m=+81.204567143" watchObservedRunningTime="2026-09-14 10:25:58.321364428 +0000 UTC m=+81.206433544"
Sep 14 10:25:58.337698 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.337634    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hljwn" podStartSLOduration=1.550976278 podStartE2EDuration="9.337609783s" totalImagesPullingTime="7.786633505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:58.335780164 +0000 UTC m=+81.220849273" watchObservedRunningTime="2026-09-14 10:25:58.337609783 +0000 UTC m=+81.222678892"
Sep 14 10:25:58.358718 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:25:58.358384    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8599bfb8f9-68jkz" podStartSLOduration=2.6376379500000002 podStartE2EDuration="11.35835719s" totalImagesPullingTime="8.72071924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:25:58.357923791 +0000 UTC m=+81.242992895" watchObservedRunningTime="2026-09-14 10:25:58.35835719 +0000 UTC m=+81.243426299"
Sep 14 10:26:03.685222 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.685188    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fwh5m"]
Sep 14 10:26:03.697178 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.697148    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.700977 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.700950    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 14 10:26:03.701133 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.700987    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 14 10:26:03.701133 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.701060    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 14 10:26:03.705909 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.702192    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c4k9f\""
Sep 14 10:26:03.705909 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.702578    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 14 10:26:03.710093 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.710060    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.710245 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.710107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-root\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.710245 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.710140    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.710245 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.710236    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-sys\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.710477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.710275    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-metrics-client-ca\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.710477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.710308    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-tls\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.710477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.710350    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc5t5\" (UniqueName: \"kubernetes.io/projected/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-kube-api-access-cc5t5\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.710477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.710377    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-textfile\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.710477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.710401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-wtmp\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.811906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.810908    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-textfile\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.811906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.810956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-wtmp\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.811906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.811007    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.811906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.811037    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-root\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.811906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.811067    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.811906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.811087    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-sys\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.811906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.811112    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-metrics-client-ca\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.811906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.811148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-tls\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.811906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.811172    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc5t5\" (UniqueName: \"kubernetes.io/projected/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-kube-api-access-cc5t5\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.813518 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:26:03.812931    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 14 10:26:03.813518 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.813015    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-textfile\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.813518 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:26:03.813025    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-tls podName:9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4 nodeName:}" failed. No retries permitted until 2026-09-14 10:26:04.313004279 +0000 UTC m=+87.198073389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-tls") pod "node-exporter-fwh5m" (UID: "9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4") : secret "node-exporter-tls" not found
Sep 14 10:26:03.813518 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.813180    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-metrics-client-ca\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.813518 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.813267    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-sys\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.813518 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.813322    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-root\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.813518 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.813365    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-wtmp\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.813518 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.813449    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.817589 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.817557    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:03.826592 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:03.826560    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc5t5\" (UniqueName: \"kubernetes.io/projected/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-kube-api-access-cc5t5\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:04.077366 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:04.077284    2574 patch_prober.go:28] interesting pod/image-registry-7677d5d4c7-f5kgt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 14 10:26:04.077366 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:04.077348    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt" podUID="3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:26:04.316606 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:04.316552    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-tls\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:04.319414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:04.319353    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4-node-exporter-tls\") pod \"node-exporter-fwh5m\" (UID: \"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4\") " pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:04.616945 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:04.616909    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fwh5m"
Sep 14 10:26:06.174656 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:06.174626    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:26:07.937915 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:26:07.937863    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7cef41_9bab_4ae8_b2fe_34f5ccb0bdf4.slice/crio-60056af9db6c7f10b46bcd68a6a12d38799b6c8e4b55a9da66420f5cdef51a30 WatchSource:0}: Error finding container 60056af9db6c7f10b46bcd68a6a12d38799b6c8e4b55a9da66420f5cdef51a30: Status 404 returned error can't find the container with id 60056af9db6c7f10b46bcd68a6a12d38799b6c8e4b55a9da66420f5cdef51a30
Sep 14 10:26:08.352114 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:08.352066    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwh5m" event={"ID":"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4","Type":"ContainerStarted","Data":"60056af9db6c7f10b46bcd68a6a12d38799b6c8e4b55a9da66420f5cdef51a30"}
Sep 14 10:26:08.354105 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:08.354077    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cbb49964-pl58p" event={"ID":"5749c0e2-1ce8-4ffe-92e2-192e679731c5","Type":"ContainerStarted","Data":"12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900"}
Sep 14 10:26:08.383843 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:08.383789    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56cbb49964-pl58p" podStartSLOduration=12.059110535 podStartE2EDuration="18.383772854s" totalImagesPullingTime="6.324662319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:08.382752011 +0000 UTC m=+91.267821119" watchObservedRunningTime="2026-09-14 10:26:08.383772854 +0000 UTC m=+91.268841959"
Sep 14 10:26:08.837883 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:08.837818    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56cbb49964-pl58p"]
Sep 14 10:26:09.361305 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:09.361259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-6v8gb" event={"ID":"ecd49ef6-e67d-4019-834b-f62abf796b3c","Type":"ContainerStarted","Data":"a3e2d41a8b0c7a3942c891a5d6a42c1303d68682f7d0213fee2fd6720549cc47"}
Sep 14 10:26:09.361818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:09.361761    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-6v8gb"
Sep 14 10:26:09.380038 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:09.380003    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-6v8gb"
Sep 14 10:26:09.385495 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:09.385439    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-6v8gb" podStartSLOduration=1.977316163 podStartE2EDuration="21.385417785s" totalImagesPullingTime="19.408101622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:09.382493765 +0000 UTC m=+92.267562873" watchObservedRunningTime="2026-09-14 10:26:09.385417785 +0000 UTC m=+92.270486976"
Sep 14 10:26:10.368894 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:10.368837    2574 generic.go:356] "Generic (PLEG): container finished" podID="9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4" containerID="7887dec5111b0f1a71366210d8feaead5c838d9351663c37feb18b064797d43b" exitCode=0
Sep 14 10:26:10.369380 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:10.368930    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwh5m" event={"ID":"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4","Type":"ContainerDied","Data":"7887dec5111b0f1a71366210d8feaead5c838d9351663c37feb18b064797d43b"}
Sep 14 10:26:11.168697 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:11.168657    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:26:11.377677 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:11.377635    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwh5m" event={"ID":"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4","Type":"ContainerStarted","Data":"5bed53f69f5bf6b6a58e05aedbaed5305095e02f1751f44ccb1220da6795613a"}
Sep 14 10:26:11.378169 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:11.377702    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwh5m" event={"ID":"9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4","Type":"ContainerStarted","Data":"48d821157adff31cfdeb8faaa87334b464c24f7953b48aea264e10555193c2a0"}
Sep 14 10:26:11.402336 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:11.402279    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fwh5m" podStartSLOduration=6.729184031 podStartE2EDuration="8.402259426s" totalImagesPullingTime="1.568660946s" totalInitContainerRuntime="104.414449ms" isStatefulPod=true podCreationTimestamp="2026-09-14 10:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:11.399403766 +0000 UTC m=+94.284472877" watchObservedRunningTime="2026-09-14 10:26:11.402259426 +0000 UTC m=+94.287328534"
Sep 14 10:26:12.502626 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.502582    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bf778cf9c-v6k5h"]
Sep 14 10:26:12.526403 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.526365    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf778cf9c-v6k5h"]
Sep 14 10:26:12.526656 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.526586    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.538718 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.538626    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 10:26:12.596594 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.596549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-oauth-serving-cert\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.596800 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.596611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-config\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.596800 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.596695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-serving-cert\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.596800 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.596737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-trusted-ca-bundle\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.596800 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.596761    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-oauth-config\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.597037 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.596846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-service-ca\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.597037 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.596888    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cpmt\" (UniqueName: \"kubernetes.io/projected/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-kube-api-access-4cpmt\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.698035 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.697987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-trusted-ca-bundle\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.698035 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.698042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-oauth-config\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.698300 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.698094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-service-ca\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.698300 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.698111    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cpmt\" (UniqueName: \"kubernetes.io/projected/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-kube-api-access-4cpmt\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.698300 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.698204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-oauth-serving-cert\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.698300 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.698256    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-config\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.698518 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.698305    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-serving-cert\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.699016 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.698987    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-service-ca\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.699640 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.699612    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-oauth-serving-cert\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.699762 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.699674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-config\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.699762 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.699696    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-trusted-ca-bundle\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.702431 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.702403    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-oauth-config\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.702591 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.702569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-serving-cert\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.708500 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.708472    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cpmt\" (UniqueName: \"kubernetes.io/projected/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-kube-api-access-4cpmt\") pod \"console-6bf778cf9c-v6k5h\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") " pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:12.841332 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:12.841254    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:13.170440 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:13.170406    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf778cf9c-v6k5h"]
Sep 14 10:26:13.175947 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:26:13.175909    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b2d35e_bfd4_4933_a22a_a30780cd5d0e.slice/crio-41c706427a58d511a1879bdff0d9af895f6f7ddcc0bb9136887f18025d37a58c WatchSource:0}: Error finding container 41c706427a58d511a1879bdff0d9af895f6f7ddcc0bb9136887f18025d37a58c: Status 404 returned error can't find the container with id 41c706427a58d511a1879bdff0d9af895f6f7ddcc0bb9136887f18025d37a58c
Sep 14 10:26:13.392589 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:13.392542    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf778cf9c-v6k5h" event={"ID":"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e","Type":"ContainerStarted","Data":"c5ff89f614d4aa6589bc45bb192716f825bffaedd43c0681051ed2c0d3c60b58"}
Sep 14 10:26:13.392769 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:13.392611    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf778cf9c-v6k5h" event={"ID":"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e","Type":"ContainerStarted","Data":"41c706427a58d511a1879bdff0d9af895f6f7ddcc0bb9136887f18025d37a58c"}
Sep 14 10:26:15.166481 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:15.166444    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tdj5q"
Sep 14 10:26:15.188021 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:15.187945    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bf778cf9c-v6k5h" podStartSLOduration=3.187924236 podStartE2EDuration="3.187924236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:26:13.420051804 +0000 UTC m=+96.305120913" watchObservedRunningTime="2026-09-14 10:26:15.187924236 +0000 UTC m=+98.072993343"
Sep 14 10:26:15.289143 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:15.289097    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7677d5d4c7-f5kgt"]
Sep 14 10:26:22.842644 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:22.842604    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:22.843237 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:22.842664    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:22.847599 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:22.847574    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:23.446517 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:23.446484    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:26:32.481418 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:32.481380    2574 generic.go:356] "Generic (PLEG): container finished" podID="866357bc-923e-4c1b-aa65-3e34fafdbb6a" containerID="1d389f9297bb951ecc5927b8b52bd7024d626b7d62523c4f2ed15b75d5adaa60" exitCode=0
Sep 14 10:26:32.481937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:32.481458    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4" event={"ID":"866357bc-923e-4c1b-aa65-3e34fafdbb6a","Type":"ContainerDied","Data":"1d389f9297bb951ecc5927b8b52bd7024d626b7d62523c4f2ed15b75d5adaa60"}
Sep 14 10:26:32.481937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:32.481755    2574 scope.go:117] "RemoveContainer" containerID="1d389f9297bb951ecc5927b8b52bd7024d626b7d62523c4f2ed15b75d5adaa60"
Sep 14 10:26:33.488435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:33.488389    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jcvw4" event={"ID":"866357bc-923e-4c1b-aa65-3e34fafdbb6a","Type":"ContainerStarted","Data":"f087fbf0aec344e6cef42b799bf044a0f38fb1434b5011d823709aee149878e2"}
Sep 14 10:26:35.393618 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.393558    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56cbb49964-pl58p" podUID="5749c0e2-1ce8-4ffe-92e2-192e679731c5" containerName="console" containerID="cri-o://12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900" gracePeriod=15
Sep 14 10:26:35.689735 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.689703    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:26:35.822520 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.822485    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-serving-cert\") pod \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") "
Sep 14 10:26:35.822692 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.822531    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-652fq\" (UniqueName: \"kubernetes.io/projected/5749c0e2-1ce8-4ffe-92e2-192e679731c5-kube-api-access-652fq\") pod \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") "
Sep 14 10:26:35.822692 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.822567    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-config\") pod \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") "
Sep 14 10:26:35.822692 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.822597    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-service-ca\") pod \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") "
Sep 14 10:26:35.822692 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.822654    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-oauth-config\") pod \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") "
Sep 14 10:26:35.822854 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.822697    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-oauth-serving-cert\") pod \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\" (UID: \"5749c0e2-1ce8-4ffe-92e2-192e679731c5\") "
Sep 14 10:26:35.823089 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.823061    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-config" (OuterVolumeSpecName: "console-config") pod "5749c0e2-1ce8-4ffe-92e2-192e679731c5" (UID: "5749c0e2-1ce8-4ffe-92e2-192e679731c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:26:35.823198 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.823092    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5749c0e2-1ce8-4ffe-92e2-192e679731c5" (UID: "5749c0e2-1ce8-4ffe-92e2-192e679731c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:26:35.823239 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.823204    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5749c0e2-1ce8-4ffe-92e2-192e679731c5" (UID: "5749c0e2-1ce8-4ffe-92e2-192e679731c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:26:35.825209 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.825175    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5749c0e2-1ce8-4ffe-92e2-192e679731c5-kube-api-access-652fq" (OuterVolumeSpecName: "kube-api-access-652fq") pod "5749c0e2-1ce8-4ffe-92e2-192e679731c5" (UID: "5749c0e2-1ce8-4ffe-92e2-192e679731c5"). InnerVolumeSpecName "kube-api-access-652fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:26:35.825308 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.825213    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5749c0e2-1ce8-4ffe-92e2-192e679731c5" (UID: "5749c0e2-1ce8-4ffe-92e2-192e679731c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:26:35.825308 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.825233    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5749c0e2-1ce8-4ffe-92e2-192e679731c5" (UID: "5749c0e2-1ce8-4ffe-92e2-192e679731c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:26:35.924243 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.924211    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-652fq\" (UniqueName: \"kubernetes.io/projected/5749c0e2-1ce8-4ffe-92e2-192e679731c5-kube-api-access-652fq\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:35.924243 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.924239    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-config\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:35.924243 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.924248    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:35.924535 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.924256    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-oauth-config\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:35.924535 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.924267    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5749c0e2-1ce8-4ffe-92e2-192e679731c5-oauth-serving-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:35.924535 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:35.924279    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5749c0e2-1ce8-4ffe-92e2-192e679731c5-console-serving-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:36.504155 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:36.504118    2574 generic.go:356] "Generic (PLEG): container finished" podID="5749c0e2-1ce8-4ffe-92e2-192e679731c5" containerID="12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900" exitCode=0
Sep 14 10:26:36.504558 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:36.504169    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cbb49964-pl58p"
Sep 14 10:26:36.504558 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:36.504209    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cbb49964-pl58p" event={"ID":"5749c0e2-1ce8-4ffe-92e2-192e679731c5","Type":"ContainerDied","Data":"12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900"}
Sep 14 10:26:36.504558 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:36.504259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cbb49964-pl58p" event={"ID":"5749c0e2-1ce8-4ffe-92e2-192e679731c5","Type":"ContainerDied","Data":"48340c563441ac20edda7d5517e20ac1a3c37c69e63e329d2652447a7988d626"}
Sep 14 10:26:36.504558 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:36.504279    2574 scope.go:117] "RemoveContainer" containerID="12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900"
Sep 14 10:26:36.520701 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:36.520682    2574 scope.go:117] "RemoveContainer" containerID="12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900"
Sep 14 10:26:36.521108 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:26:36.521087    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900\": container with ID starting with 12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900 not found: ID does not exist" containerID="12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900"
Sep 14 10:26:36.521190 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:36.521123    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900"} err="failed to get container status \"12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900\": rpc error: code = NotFound desc = could not find container \"12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900\": container with ID starting with 12e29b704275d604d9394a6692b42e203ef2cd34929e0bdb5167acf0532e5900 not found: ID does not exist"
Sep 14 10:26:36.530254 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:36.530229    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56cbb49964-pl58p"]
Sep 14 10:26:36.536465 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:36.536440    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56cbb49964-pl58p"]
Sep 14 10:26:37.510830 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:37.510797    2574 generic.go:356] "Generic (PLEG): container finished" podID="38918036-e719-4ab8-b090-4f3b82832bd5" containerID="d25cb00a04bb1a072e547813e9a385328f1ad8aa75346e0f815e351f99e8d80f" exitCode=0
Sep 14 10:26:37.511334 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:37.510897    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm" event={"ID":"38918036-e719-4ab8-b090-4f3b82832bd5","Type":"ContainerDied","Data":"d25cb00a04bb1a072e547813e9a385328f1ad8aa75346e0f815e351f99e8d80f"}
Sep 14 10:26:37.511334 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:37.511322    2574 scope.go:117] "RemoveContainer" containerID="d25cb00a04bb1a072e547813e9a385328f1ad8aa75346e0f815e351f99e8d80f"
Sep 14 10:26:37.607957 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:37.607929    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5749c0e2-1ce8-4ffe-92e2-192e679731c5" path="/var/lib/kubelet/pods/5749c0e2-1ce8-4ffe-92e2-192e679731c5/volumes"
Sep 14 10:26:38.517426 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:38.517392    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-frxdm" event={"ID":"38918036-e719-4ab8-b090-4f3b82832bd5","Type":"ContainerStarted","Data":"2d9c5f7bd6928e45aa4a6a13821793e571e708ac83968af8610ca9cb19069cf9"}
Sep 14 10:26:40.314625 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.314581    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt" podUID="3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" containerName="registry" containerID="cri-o://036bd295a3e98204f9c0d30f64afef7fe95151d0d35c951c67e0174679e6630e" gracePeriod=30
Sep 14 10:26:40.529404 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.529358    2574 generic.go:356] "Generic (PLEG): container finished" podID="3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" containerID="036bd295a3e98204f9c0d30f64afef7fe95151d0d35c951c67e0174679e6630e" exitCode=0
Sep 14 10:26:40.529606 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.529425    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt" event={"ID":"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922","Type":"ContainerDied","Data":"036bd295a3e98204f9c0d30f64afef7fe95151d0d35c951c67e0174679e6630e"}
Sep 14 10:26:40.596316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.596228    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:26:40.767456 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.767421    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-ca-trust-extracted\") pod \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") "
Sep 14 10:26:40.767660 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.767495    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h526g\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-kube-api-access-h526g\") pod \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") "
Sep 14 10:26:40.767660 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.767512    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-trusted-ca\") pod \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") "
Sep 14 10:26:40.767660 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.767532    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-image-registry-private-configuration\") pod \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") "
Sep 14 10:26:40.767660 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.767573    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") pod \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") "
Sep 14 10:26:40.767660 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.767631    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-installation-pull-secrets\") pod \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") "
Sep 14 10:26:40.767961 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.767759    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-certificates\") pod \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") "
Sep 14 10:26:40.767961 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.767812    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-bound-sa-token\") pod \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\" (UID: \"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922\") "
Sep 14 10:26:40.768235 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.768209    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:26:40.768834 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.768766    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:26:40.770427 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.770399    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-kube-api-access-h526g" (OuterVolumeSpecName: "kube-api-access-h526g") pod "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922"). InnerVolumeSpecName "kube-api-access-h526g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:26:40.770782 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.770761    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:26:40.770889 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.770795    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:26:40.770996 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.770975    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:26:40.771042 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.771013    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:26:40.776535 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.776507    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" (UID: "3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:26:40.868793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.868695    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-certificates\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:40.868793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.868730    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-bound-sa-token\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:40.868793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.868745    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-ca-trust-extracted\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:40.868793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.868756    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h526g\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-kube-api-access-h526g\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:40.868793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.868767    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-trusted-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:40.868793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.868781    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-image-registry-private-configuration\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:40.868793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.868793    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-registry-tls\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:40.869185 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:40.868804    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922-installation-pull-secrets\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:26:41.534924 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:41.534861    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt"
Sep 14 10:26:41.535346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:41.534914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7677d5d4c7-f5kgt" event={"ID":"3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922","Type":"ContainerDied","Data":"42dbc0b8a353a282adbcc797c483c76356c319d5fefad37a03a4507202275498"}
Sep 14 10:26:41.535346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:41.534991    2574 scope.go:117] "RemoveContainer" containerID="036bd295a3e98204f9c0d30f64afef7fe95151d0d35c951c67e0174679e6630e"
Sep 14 10:26:41.560391 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:41.560360    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7677d5d4c7-f5kgt"]
Sep 14 10:26:41.568885 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:41.568845    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7677d5d4c7-f5kgt"]
Sep 14 10:26:41.611978 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:41.611941    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" path="/var/lib/kubelet/pods/3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922/volumes"
Sep 14 10:26:42.541902 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:42.541849    2574 generic.go:356] "Generic (PLEG): container finished" podID="7224b4b8-bcb6-40e7-bade-a29550063f2f" containerID="7660946ce45c86e7e5e057b37eeacccdb396541e559465af3785a55a55eb0d35" exitCode=0
Sep 14 10:26:42.542400 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:42.541912    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-xwpfk" event={"ID":"7224b4b8-bcb6-40e7-bade-a29550063f2f","Type":"ContainerDied","Data":"7660946ce45c86e7e5e057b37eeacccdb396541e559465af3785a55a55eb0d35"}
Sep 14 10:26:42.542400 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:42.542323    2574 scope.go:117] "RemoveContainer" containerID="7660946ce45c86e7e5e057b37eeacccdb396541e559465af3785a55a55eb0d35"
Sep 14 10:26:43.550218 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:26:43.550183    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-xwpfk" event={"ID":"7224b4b8-bcb6-40e7-bade-a29550063f2f","Type":"ContainerStarted","Data":"f96b8649d03c0a90bca21535b665b1970280eae1444596191522fe8214baac95"}
Sep 14 10:27:01.592861 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:01.592815    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bf778cf9c-v6k5h"]
Sep 14 10:27:26.614228 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.614183    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bf778cf9c-v6k5h" podUID="f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" containerName="console" containerID="cri-o://c5ff89f614d4aa6589bc45bb192716f825bffaedd43c0681051ed2c0d3c60b58" gracePeriod=15
Sep 14 10:27:26.746056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.746022    2574 generic.go:356] "Generic (PLEG): container finished" podID="f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" containerID="c5ff89f614d4aa6589bc45bb192716f825bffaedd43c0681051ed2c0d3c60b58" exitCode=0
Sep 14 10:27:26.746213 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.746099    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf778cf9c-v6k5h" event={"ID":"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e","Type":"ContainerDied","Data":"c5ff89f614d4aa6589bc45bb192716f825bffaedd43c0681051ed2c0d3c60b58"}
Sep 14 10:27:26.869707 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.869643    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:27:26.961152 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961112    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cpmt\" (UniqueName: \"kubernetes.io/projected/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-kube-api-access-4cpmt\") pod \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") "
Sep 14 10:27:26.961152 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961153    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-config\") pod \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") "
Sep 14 10:27:26.961390 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961177    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-service-ca\") pod \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") "
Sep 14 10:27:26.961390 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961210    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-trusted-ca-bundle\") pod \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") "
Sep 14 10:27:26.961390 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961240    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-oauth-config\") pod \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") "
Sep 14 10:27:26.961390 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961270    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-oauth-serving-cert\") pod \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") "
Sep 14 10:27:26.961390 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961293    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-serving-cert\") pod \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\" (UID: \"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e\") "
Sep 14 10:27:26.961658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961624    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-config" (OuterVolumeSpecName: "console-config") pod "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" (UID: "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:27:26.961795 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961660    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" (UID: "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:27:26.961891 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961825    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" (UID: "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:27:26.961891 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.961843    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-service-ca" (OuterVolumeSpecName: "service-ca") pod "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" (UID: "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:27:26.963617 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.963590    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-kube-api-access-4cpmt" (OuterVolumeSpecName: "kube-api-access-4cpmt") pod "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" (UID: "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e"). InnerVolumeSpecName "kube-api-access-4cpmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:27:26.963723 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.963671    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" (UID: "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:27:26.963723 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:26.963704    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" (UID: "f8b2d35e-bfd4-4933-a22a-a30780cd5d0e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:27:27.062074 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.062039    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-trusted-ca-bundle\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:27:27.062074 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.062065    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-oauth-config\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:27:27.062074 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.062075    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-oauth-serving-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:27:27.062074 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.062083    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-serving-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:27:27.062329 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.062091    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cpmt\" (UniqueName: \"kubernetes.io/projected/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-kube-api-access-4cpmt\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:27:27.062329 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.062102    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-console-config\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:27:27.062329 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.062110    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:27:27.752219 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.752191    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf778cf9c-v6k5h"
Sep 14 10:27:27.752765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.752225    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf778cf9c-v6k5h" event={"ID":"f8b2d35e-bfd4-4933-a22a-a30780cd5d0e","Type":"ContainerDied","Data":"41c706427a58d511a1879bdff0d9af895f6f7ddcc0bb9136887f18025d37a58c"}
Sep 14 10:27:27.752765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.752296    2574 scope.go:117] "RemoveContainer" containerID="c5ff89f614d4aa6589bc45bb192716f825bffaedd43c0681051ed2c0d3c60b58"
Sep 14 10:27:27.778415 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.778372    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bf778cf9c-v6k5h"]
Sep 14 10:27:27.789165 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:27.789134    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bf778cf9c-v6k5h"]
Sep 14 10:27:29.607927 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:27:29.607840    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" path="/var/lib/kubelet/pods/f8b2d35e-bfd4-4933-a22a-a30780cd5d0e/volumes"
Sep 14 10:28:51.374237 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374205    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"]
Sep 14 10:28:51.374711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374497    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" containerName="registry"
Sep 14 10:28:51.374711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374507    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" containerName="registry"
Sep 14 10:28:51.374711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374526    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5749c0e2-1ce8-4ffe-92e2-192e679731c5" containerName="console"
Sep 14 10:28:51.374711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374532    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5749c0e2-1ce8-4ffe-92e2-192e679731c5" containerName="console"
Sep 14 10:28:51.374711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374538    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" containerName="console"
Sep 14 10:28:51.374711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374544    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" containerName="console"
Sep 14 10:28:51.374711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374594    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f39e9d2-5f0c-4cd4-b2d2-19ac5c175922" containerName="registry"
Sep 14 10:28:51.374711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374601    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5749c0e2-1ce8-4ffe-92e2-192e679731c5" containerName="console"
Sep 14 10:28:51.374711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.374608    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8b2d35e-bfd4-4933-a22a-a30780cd5d0e" containerName="console"
Sep 14 10:28:51.376632 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.376616    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.382368 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.382345    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 14 10:28:51.382861 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.382624    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 14 10:28:51.383177 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.383163    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 14 10:28:51.383812 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.383793    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sfzpx\""
Sep 14 10:28:51.384172 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.384159    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 14 10:28:51.402408 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.402369    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"]
Sep 14 10:28:51.464356 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.464320    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c283c7f-0962-4570-b434-3338bafca2bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.464356 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.464356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c283c7f-0962-4570-b434-3338bafca2bb-tmp\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.464547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.464377    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c283c7f-0962-4570-b434-3338bafca2bb-manifests\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.464547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.464449    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c283c7f-0962-4570-b434-3338bafca2bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.464547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.464496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtjmd\" (UniqueName: \"kubernetes.io/projected/7c283c7f-0962-4570-b434-3338bafca2bb-kube-api-access-mtjmd\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.564904 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.564834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c283c7f-0962-4570-b434-3338bafca2bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.564904 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.564911    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c283c7f-0962-4570-b434-3338bafca2bb-tmp\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.565128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.564935    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c283c7f-0962-4570-b434-3338bafca2bb-manifests\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.565128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.564958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c283c7f-0962-4570-b434-3338bafca2bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.565128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.564996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtjmd\" (UniqueName: \"kubernetes.io/projected/7c283c7f-0962-4570-b434-3338bafca2bb-kube-api-access-mtjmd\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.565434 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.565409    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c283c7f-0962-4570-b434-3338bafca2bb-manifests\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.567334 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.567307    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c283c7f-0962-4570-b434-3338bafca2bb-tmp\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.567530 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.567514    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c283c7f-0962-4570-b434-3338bafca2bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.567571 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.567544    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c283c7f-0962-4570-b434-3338bafca2bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.584070 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.584046    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtjmd\" (UniqueName: \"kubernetes.io/projected/7c283c7f-0962-4570-b434-3338bafca2bb-kube-api-access-mtjmd\") pod \"opendatahub-operator-controller-manager-757dcccd8b-fmqc7\" (UID: \"7c283c7f-0962-4570-b434-3338bafca2bb\") " pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.687026 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.686989    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:51.986777 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:51.986755    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"]
Sep 14 10:28:51.988795 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:28:51.988766    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c283c7f_0962_4570_b434_3338bafca2bb.slice/crio-90d757f6264c6df8ab3da5993bf3a0d4a17fb673a5506bf2d8753bf14b6c77be WatchSource:0}: Error finding container 90d757f6264c6df8ab3da5993bf3a0d4a17fb673a5506bf2d8753bf14b6c77be: Status 404 returned error can't find the container with id 90d757f6264c6df8ab3da5993bf3a0d4a17fb673a5506bf2d8753bf14b6c77be
Sep 14 10:28:52.107321 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:52.107275    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7" event={"ID":"7c283c7f-0962-4570-b434-3338bafca2bb","Type":"ContainerStarted","Data":"90d757f6264c6df8ab3da5993bf3a0d4a17fb673a5506bf2d8753bf14b6c77be"}
Sep 14 10:28:55.123625 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:55.123553    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7" event={"ID":"7c283c7f-0962-4570-b434-3338bafca2bb","Type":"ContainerStarted","Data":"f94a3abb985767bd51d69018c4697bb182e72349a343d02f46e38293af16a4b3"}
Sep 14 10:28:56.130438 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:56.130401    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c283c7f-0962-4570-b434-3338bafca2bb" containerID="f94a3abb985767bd51d69018c4697bb182e72349a343d02f46e38293af16a4b3" exitCode=0
Sep 14 10:28:56.130802 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:56.130483    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7" event={"ID":"7c283c7f-0962-4570-b434-3338bafca2bb","Type":"ContainerDied","Data":"f94a3abb985767bd51d69018c4697bb182e72349a343d02f46e38293af16a4b3"}
Sep 14 10:28:57.142244 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:57.142204    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7" event={"ID":"7c283c7f-0962-4570-b434-3338bafca2bb","Type":"ContainerStarted","Data":"14447af94b2d58ee82805439d05e54490dcbac487d7a44723f47271b72be0d70"}
Sep 14 10:28:57.142629 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:57.142342    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:28:57.167790 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:28:57.167739    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7" podStartSLOduration=1.998897462 podStartE2EDuration="6.167723753s" totalImagesPullingTime="3.091828249s" totalInitContainerRuntime="1.076998042s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:28:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:28:57.165628755 +0000 UTC m=+260.050697888" watchObservedRunningTime="2026-09-14 10:28:57.167723753 +0000 UTC m=+260.052792884"
Sep 14 10:29:08.149128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:08.149051    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-757dcccd8b-fmqc7"
Sep 14 10:29:22.209698 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.209665    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"]
Sep 14 10:29:22.218981 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.218959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.224435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.224410    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 14 10:29:22.224572 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.224415    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 14 10:29:22.229100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.229082    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-snh5n\""
Sep 14 10:29:22.235988 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.235966    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"]
Sep 14 10:29:22.319630 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.319554    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc1babb-61ee-4958-8c40-f2d16691eea6-tls-certs\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.319790 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.319645    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqsh\" (UniqueName: \"kubernetes.io/projected/abc1babb-61ee-4958-8c40-f2d16691eea6-kube-api-access-7qqsh\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.319790 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.319678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abc1babb-61ee-4958-8c40-f2d16691eea6-tmp\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.347354 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.347314    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m92ch"]
Sep 14 10:29:22.349745 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.349729    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:22.352975 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.352951    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 14 10:29:22.353303 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.353286    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7khpm\""
Sep 14 10:29:22.381028 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.380988    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m92ch"]
Sep 14 10:29:22.421097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.421067    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abc1babb-61ee-4958-8c40-f2d16691eea6-tmp\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.421349 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.421163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc1babb-61ee-4958-8c40-f2d16691eea6-tls-certs\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.421349 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.421194    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kccds\" (UniqueName: \"kubernetes.io/projected/909acd21-f705-4f36-8176-1d5beb702510-kube-api-access-kccds\") pod \"odh-model-controller-7998c67dc4-m92ch\" (UID: \"909acd21-f705-4f36-8176-1d5beb702510\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:22.421349 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.421230    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqsh\" (UniqueName: \"kubernetes.io/projected/abc1babb-61ee-4958-8c40-f2d16691eea6-kube-api-access-7qqsh\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.421349 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.421256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/909acd21-f705-4f36-8176-1d5beb702510-cert\") pod \"odh-model-controller-7998c67dc4-m92ch\" (UID: \"909acd21-f705-4f36-8176-1d5beb702510\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:22.421349 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:29:22.421307    2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 14 10:29:22.421578 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:29:22.421404    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc1babb-61ee-4958-8c40-f2d16691eea6-tls-certs podName:abc1babb-61ee-4958-8c40-f2d16691eea6 nodeName:}" failed. No retries permitted until 2026-09-14 10:29:22.921381499 +0000 UTC m=+285.806450602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/abc1babb-61ee-4958-8c40-f2d16691eea6-tls-certs") pod "kube-auth-proxy-cb779b95-vtsgd" (UID: "abc1babb-61ee-4958-8c40-f2d16691eea6") : secret "kube-auth-proxy-tls" not found
Sep 14 10:29:22.423579 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.423560    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abc1babb-61ee-4958-8c40-f2d16691eea6-tmp\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.436750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.436723    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqsh\" (UniqueName: \"kubernetes.io/projected/abc1babb-61ee-4958-8c40-f2d16691eea6-kube-api-access-7qqsh\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.522020 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.521931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kccds\" (UniqueName: \"kubernetes.io/projected/909acd21-f705-4f36-8176-1d5beb702510-kube-api-access-kccds\") pod \"odh-model-controller-7998c67dc4-m92ch\" (UID: \"909acd21-f705-4f36-8176-1d5beb702510\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:22.522020 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.521980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/909acd21-f705-4f36-8176-1d5beb702510-cert\") pod \"odh-model-controller-7998c67dc4-m92ch\" (UID: \"909acd21-f705-4f36-8176-1d5beb702510\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:22.522269 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:29:22.522109    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 14 10:29:22.522269 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:29:22.522178    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909acd21-f705-4f36-8176-1d5beb702510-cert podName:909acd21-f705-4f36-8176-1d5beb702510 nodeName:}" failed. No retries permitted until 2026-09-14 10:29:23.022157799 +0000 UTC m=+285.907226899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/909acd21-f705-4f36-8176-1d5beb702510-cert") pod "odh-model-controller-7998c67dc4-m92ch" (UID: "909acd21-f705-4f36-8176-1d5beb702510") : secret "odh-model-controller-webhook-cert" not found
Sep 14 10:29:22.534943 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.534913    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kccds\" (UniqueName: \"kubernetes.io/projected/909acd21-f705-4f36-8176-1d5beb702510-kube-api-access-kccds\") pod \"odh-model-controller-7998c67dc4-m92ch\" (UID: \"909acd21-f705-4f36-8176-1d5beb702510\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:22.925464 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.925416    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc1babb-61ee-4958-8c40-f2d16691eea6-tls-certs\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:22.928085 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:22.928059    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc1babb-61ee-4958-8c40-f2d16691eea6-tls-certs\") pod \"kube-auth-proxy-cb779b95-vtsgd\" (UID: \"abc1babb-61ee-4958-8c40-f2d16691eea6\") " pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:23.026626 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.026588    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/909acd21-f705-4f36-8176-1d5beb702510-cert\") pod \"odh-model-controller-7998c67dc4-m92ch\" (UID: \"909acd21-f705-4f36-8176-1d5beb702510\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:23.029780 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.029751    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/909acd21-f705-4f36-8176-1d5beb702510-cert\") pod \"odh-model-controller-7998c67dc4-m92ch\" (UID: \"909acd21-f705-4f36-8176-1d5beb702510\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:23.071172 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.071140    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zmqzh"]
Sep 14 10:29:23.074954 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.074931    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:23.078637 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.078608    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 14 10:29:23.089217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.089191    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zmqzh"]
Sep 14 10:29:23.127527 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.127494    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adaf889b-7dad-4d9d-886d-6721a089fc7c-tls-certs\") pod \"model-serving-api-54d89bd5fc-zmqzh\" (UID: \"adaf889b-7dad-4d9d-886d-6721a089fc7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:23.127527 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.127531    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqdkg\" (UniqueName: \"kubernetes.io/projected/adaf889b-7dad-4d9d-886d-6721a089fc7c-kube-api-access-nqdkg\") pod \"model-serving-api-54d89bd5fc-zmqzh\" (UID: \"adaf889b-7dad-4d9d-886d-6721a089fc7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:23.128309 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.128295    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"
Sep 14 10:29:23.228672 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.228634    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adaf889b-7dad-4d9d-886d-6721a089fc7c-tls-certs\") pod \"model-serving-api-54d89bd5fc-zmqzh\" (UID: \"adaf889b-7dad-4d9d-886d-6721a089fc7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:23.228672 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.228675    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqdkg\" (UniqueName: \"kubernetes.io/projected/adaf889b-7dad-4d9d-886d-6721a089fc7c-kube-api-access-nqdkg\") pod \"model-serving-api-54d89bd5fc-zmqzh\" (UID: \"adaf889b-7dad-4d9d-886d-6721a089fc7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:23.229219 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:29:23.228804    2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 14 10:29:23.229219 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:29:23.228905    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adaf889b-7dad-4d9d-886d-6721a089fc7c-tls-certs podName:adaf889b-7dad-4d9d-886d-6721a089fc7c nodeName:}" failed. No retries permitted until 2026-09-14 10:29:23.728881964 +0000 UTC m=+286.613951064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/adaf889b-7dad-4d9d-886d-6721a089fc7c-tls-certs") pod "model-serving-api-54d89bd5fc-zmqzh" (UID: "adaf889b-7dad-4d9d-886d-6721a089fc7c") : secret "model-serving-api-tls" not found
Sep 14 10:29:23.246975 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.246941    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqdkg\" (UniqueName: \"kubernetes.io/projected/adaf889b-7dad-4d9d-886d-6721a089fc7c-kube-api-access-nqdkg\") pod \"model-serving-api-54d89bd5fc-zmqzh\" (UID: \"adaf889b-7dad-4d9d-886d-6721a089fc7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:23.259072 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.259052    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:23.410681 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.410647    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cb779b95-vtsgd"]
Sep 14 10:29:23.414810 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:29:23.414773    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc1babb_61ee_4958_8c40_f2d16691eea6.slice/crio-4b2d768df8dd55b48020272dde2430ebabd2aefda5f70062b728ac54bda3d630 WatchSource:0}: Error finding container 4b2d768df8dd55b48020272dde2430ebabd2aefda5f70062b728ac54bda3d630: Status 404 returned error can't find the container with id 4b2d768df8dd55b48020272dde2430ebabd2aefda5f70062b728ac54bda3d630
Sep 14 10:29:23.557262 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.557238    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m92ch"]
Sep 14 10:29:23.559912 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:29:23.559854    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909acd21_f705_4f36_8176_1d5beb702510.slice/crio-16ab13b5d032498e222c36e9d1d9c997409e5dd2ef47d97eef7ad8124bbeff9b WatchSource:0}: Error finding container 16ab13b5d032498e222c36e9d1d9c997409e5dd2ef47d97eef7ad8124bbeff9b: Status 404 returned error can't find the container with id 16ab13b5d032498e222c36e9d1d9c997409e5dd2ef47d97eef7ad8124bbeff9b
Sep 14 10:29:23.733700 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.733652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adaf889b-7dad-4d9d-886d-6721a089fc7c-tls-certs\") pod \"model-serving-api-54d89bd5fc-zmqzh\" (UID: \"adaf889b-7dad-4d9d-886d-6721a089fc7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:23.736266 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.736246    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adaf889b-7dad-4d9d-886d-6721a089fc7c-tls-certs\") pod \"model-serving-api-54d89bd5fc-zmqzh\" (UID: \"adaf889b-7dad-4d9d-886d-6721a089fc7c\") " pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:23.984785 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:23.984746    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:24.040685 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.040650    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"]
Sep 14 10:29:24.048242 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.046627    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.051059 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.050849    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 14 10:29:24.052066 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.051839    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 14 10:29:24.053960 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.053664    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dgskx\""
Sep 14 10:29:24.053960 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.053893    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 14 10:29:24.054135 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.054100    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 14 10:29:24.084451 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.084412    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"]
Sep 14 10:29:24.138012 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.137957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrchj\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-kube-api-access-mrchj\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.138184 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.138045    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.138184 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.138072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.138184 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.138117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.138437 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.138200    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.138437 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.138223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.138437 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.138252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.239225 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.239133    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.239225 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.239180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.239754 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.239227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.239754 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.239319    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.239754 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.239346    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.239754 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.239375    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.239754 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.239413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrchj\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-kube-api-access-mrchj\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.240826 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.240777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.243784 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.243732    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.243947 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.243790    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.244358 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.244317    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.246377 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.246353    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.253593 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.253547    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrchj\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-kube-api-access-mrchj\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.255427 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.255386    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-b2j7q\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.273090 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.273018    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m92ch" event={"ID":"909acd21-f705-4f36-8176-1d5beb702510","Type":"ContainerStarted","Data":"16ab13b5d032498e222c36e9d1d9c997409e5dd2ef47d97eef7ad8124bbeff9b"}
Sep 14 10:29:24.275157 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.275124    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd" event={"ID":"abc1babb-61ee-4958-8c40-f2d16691eea6","Type":"ContainerStarted","Data":"4b2d768df8dd55b48020272dde2430ebabd2aefda5f70062b728ac54bda3d630"}
Sep 14 10:29:24.293769 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.293618    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zmqzh"]
Sep 14 10:29:24.299015 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:29:24.298981    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadaf889b_7dad_4d9d_886d_6721a089fc7c.slice/crio-120cae210689892cdf37e6b47efbc3629dd40bff045f11a31db063ded6a09eea WatchSource:0}: Error finding container 120cae210689892cdf37e6b47efbc3629dd40bff045f11a31db063ded6a09eea: Status 404 returned error can't find the container with id 120cae210689892cdf37e6b47efbc3629dd40bff045f11a31db063ded6a09eea
Sep 14 10:29:24.363573 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.363538    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:24.677720 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:24.677685    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"]
Sep 14 10:29:24.679391 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:29:24.679361    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6069bd39_ca80_4cfb_9c9b_c8e3184aac46.slice/crio-0d5a66eaee33e28c00b70e3f2543aaaf2f54afed3a19d66c1f1e1535dac32bb8 WatchSource:0}: Error finding container 0d5a66eaee33e28c00b70e3f2543aaaf2f54afed3a19d66c1f1e1535dac32bb8: Status 404 returned error can't find the container with id 0d5a66eaee33e28c00b70e3f2543aaaf2f54afed3a19d66c1f1e1535dac32bb8
Sep 14 10:29:25.293776 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:25.293691    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q" event={"ID":"6069bd39-ca80-4cfb-9c9b-c8e3184aac46","Type":"ContainerStarted","Data":"0d5a66eaee33e28c00b70e3f2543aaaf2f54afed3a19d66c1f1e1535dac32bb8"}
Sep 14 10:29:25.295858 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:25.295780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh" event={"ID":"adaf889b-7dad-4d9d-886d-6721a089fc7c","Type":"ContainerStarted","Data":"120cae210689892cdf37e6b47efbc3629dd40bff045f11a31db063ded6a09eea"}
Sep 14 10:29:29.547949 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:29.547860    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:29:29.548239 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:29.547990    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:29:30.326908 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.326842    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh" event={"ID":"adaf889b-7dad-4d9d-886d-6721a089fc7c","Type":"ContainerStarted","Data":"fe5658606bccdea7170b45814b951a1853cb0b7522732eeb12bd65304033a58a"}
Sep 14 10:29:30.327133 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.326974    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:29:30.329672 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.329641    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m92ch" event={"ID":"909acd21-f705-4f36-8176-1d5beb702510","Type":"ContainerStarted","Data":"6e79e0810b8c93ee196426d09fd78fca99cae68c274a7cf6270f11d875a6f354"}
Sep 14 10:29:30.330078 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.330043    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:30.331787 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.331761    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd" event={"ID":"abc1babb-61ee-4958-8c40-f2d16691eea6","Type":"ContainerStarted","Data":"8f80d5e004dfb37cd43b02a2801d04be0f601ae8922e89b8c1328c655a12e27f"}
Sep 14 10:29:30.334043 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.334015    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q" event={"ID":"6069bd39-ca80-4cfb-9c9b-c8e3184aac46","Type":"ContainerStarted","Data":"24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7"}
Sep 14 10:29:30.334282 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.334255    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:30.335942 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.335905    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-b2j7q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:29:30.336049 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.335953    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q" podUID="6069bd39-ca80-4cfb-9c9b-c8e3184aac46" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:29:30.364256 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.364198    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh" podStartSLOduration=2.195762106 podStartE2EDuration="7.364181138s" totalImagesPullingTime="5.168419032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:29:30.362024137 +0000 UTC m=+293.247093273" watchObservedRunningTime="2026-09-14 10:29:30.364181138 +0000 UTC m=+293.249250246"
Sep 14 10:29:30.415651 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.415587    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cb779b95-vtsgd" podStartSLOduration=2.3578251740000002 podStartE2EDuration="8.415569221s" totalImagesPullingTime="6.057744047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:29:30.414183014 +0000 UTC m=+293.299252132" watchObservedRunningTime="2026-09-14 10:29:30.415569221 +0000 UTC m=+293.300638328"
Sep 14 10:29:30.501128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.501063    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q" podStartSLOduration=2.6352176959999998 podStartE2EDuration="7.501046238s" totalImagesPullingTime="4.865828542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:29:30.499209895 +0000 UTC m=+293.384279003" watchObservedRunningTime="2026-09-14 10:29:30.501046238 +0000 UTC m=+293.386115346"
Sep 14 10:29:30.531739 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:30.531683    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-m92ch" podStartSLOduration=2.617730452 podStartE2EDuration="8.53166695s" totalImagesPullingTime="5.913936498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:29:30.529561209 +0000 UTC m=+293.414630330" watchObservedRunningTime="2026-09-14 10:29:30.53166695 +0000 UTC m=+293.416736058"
Sep 14 10:29:31.339578 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:31.339543    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-b2j7q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:29:31.339988 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:31.339607    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q" podUID="6069bd39-ca80-4cfb-9c9b-c8e3184aac46" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:29:32.560792 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.560752    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"]
Sep 14 10:29:32.564187 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.564170    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.567117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.567094    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n2mrm\""
Sep 14 10:29:32.598441 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.598403    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"]
Sep 14 10:29:32.720705 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.720665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.720886 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.720745    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.720886 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.720782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.720886 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.720807    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.721003 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.720918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.721003 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.720947    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npjw9\" (UniqueName: \"kubernetes.io/projected/75727cf9-eb49-44c5-bbba-8bcc879f8b29-kube-api-access-npjw9\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.721003 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.720968    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.721003 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.720990    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.721150 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.721035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822299 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822205    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822299 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822253    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjw9\" (UniqueName: \"kubernetes.io/projected/75727cf9-eb49-44c5-bbba-8bcc879f8b29-kube-api-access-npjw9\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822299 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822278    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822634 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822634 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822368    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822634 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822634 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822634 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822634 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822967 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.822967 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822689    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.823070 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.822960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.823126 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.823091    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.823216 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.823188    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.824926 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.824903    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.825288 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.825269    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.843658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.843619    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75727cf9-eb49-44c5-bbba-8bcc879f8b29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:32.882417 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:32.882382    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npjw9\" (UniqueName: \"kubernetes.io/projected/75727cf9-eb49-44c5-bbba-8bcc879f8b29-kube-api-access-npjw9\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd\" (UID: \"75727cf9-eb49-44c5-bbba-8bcc879f8b29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:33.174325 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:33.174290    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:33.474236 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:33.474116    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"]
Sep 14 10:29:34.335409 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.335373    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"]
Sep 14 10:29:34.335899 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.335576    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q" podUID="6069bd39-ca80-4cfb-9c9b-c8e3184aac46" containerName="discovery" containerID="cri-o://24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7" gracePeriod=30
Sep 14 10:29:34.336452 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.336430    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:34.355581 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.355546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd" event={"ID":"75727cf9-eb49-44c5-bbba-8bcc879f8b29","Type":"ContainerStarted","Data":"0cb24a9920c4f6f16dc2bd5226ccd21183038c198c91dac9a4ab7eaa8c39f23d"}
Sep 14 10:29:34.602827 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.602755    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:34.748388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.744023    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-dns-cert\") pod \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") "
Sep 14 10:29:34.748388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.744118    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-ca-configmap\") pod \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") "
Sep 14 10:29:34.748388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.744152    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-cacerts\") pod \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") "
Sep 14 10:29:34.748388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.744190    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-local-certs\") pod \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") "
Sep 14 10:29:34.748388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.744230    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrchj\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-kube-api-access-mrchj\") pod \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") "
Sep 14 10:29:34.748388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.744253    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-kubeconfig\") pod \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") "
Sep 14 10:29:34.748388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.744279    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-token\") pod \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\" (UID: \"6069bd39-ca80-4cfb-9c9b-c8e3184aac46\") "
Sep 14 10:29:34.748388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.746850    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6069bd39-ca80-4cfb-9c9b-c8e3184aac46" (UID: "6069bd39-ca80-4cfb-9c9b-c8e3184aac46"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:29:34.749366 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.749333    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6069bd39-ca80-4cfb-9c9b-c8e3184aac46" (UID: "6069bd39-ca80-4cfb-9c9b-c8e3184aac46"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:29:34.749451 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.749364    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-kube-api-access-mrchj" (OuterVolumeSpecName: "kube-api-access-mrchj") pod "6069bd39-ca80-4cfb-9c9b-c8e3184aac46" (UID: "6069bd39-ca80-4cfb-9c9b-c8e3184aac46"). InnerVolumeSpecName "kube-api-access-mrchj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:29:34.749537 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.749496    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-cacerts" (OuterVolumeSpecName: "cacerts") pod "6069bd39-ca80-4cfb-9c9b-c8e3184aac46" (UID: "6069bd39-ca80-4cfb-9c9b-c8e3184aac46"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:29:34.749734 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.749710    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6069bd39-ca80-4cfb-9c9b-c8e3184aac46" (UID: "6069bd39-ca80-4cfb-9c9b-c8e3184aac46"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:29:34.749916 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.749893    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-token" (OuterVolumeSpecName: "istio-token") pod "6069bd39-ca80-4cfb-9c9b-c8e3184aac46" (UID: "6069bd39-ca80-4cfb-9c9b-c8e3184aac46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:29:34.750118 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.750087    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-local-certs" (OuterVolumeSpecName: "local-certs") pod "6069bd39-ca80-4cfb-9c9b-c8e3184aac46" (UID: "6069bd39-ca80-4cfb-9c9b-c8e3184aac46"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:29:34.845754 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.845716    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-dns-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:29:34.845754 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.845761    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-csr-ca-configmap\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:29:34.846060 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.845779    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-cacerts\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:29:34.846060 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.845794    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-local-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:29:34.846060 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.845810    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrchj\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-kube-api-access-mrchj\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:29:34.846060 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.845825    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-kubeconfig\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:29:34.846060 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:34.845838    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6069bd39-ca80-4cfb-9c9b-c8e3184aac46-istio-token\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:29:35.015129 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.014621    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"]
Sep 14 10:29:35.015129 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.015047    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6069bd39-ca80-4cfb-9c9b-c8e3184aac46" containerName="discovery"
Sep 14 10:29:35.015129 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.015061    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6069bd39-ca80-4cfb-9c9b-c8e3184aac46" containerName="discovery"
Sep 14 10:29:35.015129 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.015133    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6069bd39-ca80-4cfb-9c9b-c8e3184aac46" containerName="discovery"
Sep 14 10:29:35.018675 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.018651    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:29:35.022034 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.022006    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qpf7l\""
Sep 14 10:29:35.022179 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.022117    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 14 10:29:35.037392 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.037315    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"]
Sep 14 10:29:35.049019 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.048979    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"]
Sep 14 10:29:35.056943 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.056907    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:29:35.063229 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.063108    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 14 10:29:35.064833 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.064793    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fq4x5\""
Sep 14 10:29:35.071070 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.071041    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"]
Sep 14 10:29:35.149814 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.149779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6wj\" (UniqueName: \"kubernetes.io/projected/32a82ab9-5a10-4073-a440-06ded49a6eeb-kube-api-access-ml6wj\") pod \"kserve-controller-manager-d6f4b65b8-qpfhm\" (UID: \"32a82ab9-5a10-4073-a440-06ded49a6eeb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:29:35.150018 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.149822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15a3ac82-cc12-488e-ad68-498d92930d61-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fxcxp\" (UID: \"15a3ac82-cc12-488e-ad68-498d92930d61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:29:35.150018 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.149858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32a82ab9-5a10-4073-a440-06ded49a6eeb-cert\") pod \"kserve-controller-manager-d6f4b65b8-qpfhm\" (UID: \"32a82ab9-5a10-4073-a440-06ded49a6eeb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:29:35.150018 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.149976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67zt9\" (UniqueName: \"kubernetes.io/projected/15a3ac82-cc12-488e-ad68-498d92930d61-kube-api-access-67zt9\") pod \"llmisvc-controller-manager-777c6bd7d5-fxcxp\" (UID: \"15a3ac82-cc12-488e-ad68-498d92930d61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:29:35.250752 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.250711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6wj\" (UniqueName: \"kubernetes.io/projected/32a82ab9-5a10-4073-a440-06ded49a6eeb-kube-api-access-ml6wj\") pod \"kserve-controller-manager-d6f4b65b8-qpfhm\" (UID: \"32a82ab9-5a10-4073-a440-06ded49a6eeb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:29:35.250984 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.250761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15a3ac82-cc12-488e-ad68-498d92930d61-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fxcxp\" (UID: \"15a3ac82-cc12-488e-ad68-498d92930d61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:29:35.250984 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.250792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32a82ab9-5a10-4073-a440-06ded49a6eeb-cert\") pod \"kserve-controller-manager-d6f4b65b8-qpfhm\" (UID: \"32a82ab9-5a10-4073-a440-06ded49a6eeb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:29:35.250984 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.250834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67zt9\" (UniqueName: \"kubernetes.io/projected/15a3ac82-cc12-488e-ad68-498d92930d61-kube-api-access-67zt9\") pod \"llmisvc-controller-manager-777c6bd7d5-fxcxp\" (UID: \"15a3ac82-cc12-488e-ad68-498d92930d61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:29:35.253855 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.253797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32a82ab9-5a10-4073-a440-06ded49a6eeb-cert\") pod \"kserve-controller-manager-d6f4b65b8-qpfhm\" (UID: \"32a82ab9-5a10-4073-a440-06ded49a6eeb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:29:35.253855 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.253824    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15a3ac82-cc12-488e-ad68-498d92930d61-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fxcxp\" (UID: \"15a3ac82-cc12-488e-ad68-498d92930d61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:29:35.270287 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.270219    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6wj\" (UniqueName: \"kubernetes.io/projected/32a82ab9-5a10-4073-a440-06ded49a6eeb-kube-api-access-ml6wj\") pod \"kserve-controller-manager-d6f4b65b8-qpfhm\" (UID: \"32a82ab9-5a10-4073-a440-06ded49a6eeb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:29:35.270441 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.270394    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67zt9\" (UniqueName: \"kubernetes.io/projected/15a3ac82-cc12-488e-ad68-498d92930d61-kube-api-access-67zt9\") pod \"llmisvc-controller-manager-777c6bd7d5-fxcxp\" (UID: \"15a3ac82-cc12-488e-ad68-498d92930d61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:29:35.333017 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.332920    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:29:35.362321 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.362284    2574 generic.go:356] "Generic (PLEG): container finished" podID="6069bd39-ca80-4cfb-9c9b-c8e3184aac46" containerID="24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7" exitCode=0
Sep 14 10:29:35.362738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.362349    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"
Sep 14 10:29:35.362738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.362358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q" event={"ID":"6069bd39-ca80-4cfb-9c9b-c8e3184aac46","Type":"ContainerDied","Data":"24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7"}
Sep 14 10:29:35.362738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.362404    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q" event={"ID":"6069bd39-ca80-4cfb-9c9b-c8e3184aac46","Type":"ContainerDied","Data":"0d5a66eaee33e28c00b70e3f2543aaaf2f54afed3a19d66c1f1e1535dac32bb8"}
Sep 14 10:29:35.362738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.362425    2574 scope.go:117] "RemoveContainer" containerID="24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7"
Sep 14 10:29:35.370717 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.370690    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:29:35.408565 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.408530    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"]
Sep 14 10:29:35.415273 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.415238    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b2j7q"]
Sep 14 10:29:35.609586 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:35.609504    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6069bd39-ca80-4cfb-9c9b-c8e3184aac46" path="/var/lib/kubelet/pods/6069bd39-ca80-4cfb-9c9b-c8e3184aac46/volumes"
Sep 14 10:29:36.136347 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:36.136326    2574 scope.go:117] "RemoveContainer" containerID="24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7"
Sep 14 10:29:36.136717 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:29:36.136695    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7\": container with ID starting with 24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7 not found: ID does not exist" containerID="24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7"
Sep 14 10:29:36.136762 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:36.136729    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7"} err="failed to get container status \"24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7\": rpc error: code = NotFound desc = could not find container \"24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7\": container with ID starting with 24331a553a7820032cc04c5ff2868da2d530ed84bef71bde34672bc96aad67f7 not found: ID does not exist"
Sep 14 10:29:36.209697 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:36.209654    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:29:36.209793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:36.209747    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:29:36.209832 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:36.209791    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:29:36.371260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:36.371226    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd" event={"ID":"75727cf9-eb49-44c5-bbba-8bcc879f8b29","Type":"ContainerStarted","Data":"fab114fc21147b1b01241885008df4101ad5ed3d0c78d6ac3cee14919e76054a"}
Sep 14 10:29:36.438658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:36.438605    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd" podStartSLOduration=1.7090317160000001 podStartE2EDuration="4.438587055s" totalImagesPullingTime="2.729555339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:29:36.437428096 +0000 UTC m=+299.322497207" watchObservedRunningTime="2026-09-14 10:29:36.438587055 +0000 UTC m=+299.323656226"
Sep 14 10:29:36.442610 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:36.442576    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"]
Sep 14 10:29:36.443047 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:29:36.443026    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a82ab9_5a10_4073_a440_06ded49a6eeb.slice/crio-75ce4672a8e213adf29aad5883c400efa8f9d6aac8dc72cb89c5ee55019f2956 WatchSource:0}: Error finding container 75ce4672a8e213adf29aad5883c400efa8f9d6aac8dc72cb89c5ee55019f2956: Status 404 returned error can't find the container with id 75ce4672a8e213adf29aad5883c400efa8f9d6aac8dc72cb89c5ee55019f2956
Sep 14 10:29:36.483034 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:36.483006    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"]
Sep 14 10:29:36.483954 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:29:36.483924    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod15a3ac82_cc12_488e_ad68_498d92930d61.slice/crio-e0d5434eded861c78881a32edff956d80457c3f2bfebe88f21648af79d13025d WatchSource:0}: Error finding container e0d5434eded861c78881a32edff956d80457c3f2bfebe88f21648af79d13025d: Status 404 returned error can't find the container with id e0d5434eded861c78881a32edff956d80457c3f2bfebe88f21648af79d13025d
Sep 14 10:29:37.174822 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:37.174787    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:37.179676 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:37.179650    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:37.379257 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:37.379218    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp" event={"ID":"15a3ac82-cc12-488e-ad68-498d92930d61","Type":"ContainerStarted","Data":"e0d5434eded861c78881a32edff956d80457c3f2bfebe88f21648af79d13025d"}
Sep 14 10:29:37.380933 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:37.380900    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm" event={"ID":"32a82ab9-5a10-4073-a440-06ded49a6eeb","Type":"ContainerStarted","Data":"75ce4672a8e213adf29aad5883c400efa8f9d6aac8dc72cb89c5ee55019f2956"}
Sep 14 10:29:37.381234 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:37.381212    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:37.382405 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:37.382380    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd"
Sep 14 10:29:38.046067 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:38.046037    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:29:38.047318 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:38.047284    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:29:38.060420 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:38.060396    2574 kubelet.go:1648] "Image garbage collection succeeded"
Sep 14 10:29:40.398482 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:40.398442    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm" event={"ID":"32a82ab9-5a10-4073-a440-06ded49a6eeb","Type":"ContainerStarted","Data":"639c86482fceae862c1c6aa9a3147e9d098e61e9cdfe196ab06241184a885053"}
Sep 14 10:29:40.398971 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:40.398543    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:29:40.400340 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:40.400312    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp" event={"ID":"15a3ac82-cc12-488e-ad68-498d92930d61","Type":"ContainerStarted","Data":"3345c9dd6586bac231d0ff7f0f7b1720d764bdb6a019564e89658c6f35108ca4"}
Sep 14 10:29:40.400473 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:40.400359    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:29:40.441991 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:40.441928    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm" podStartSLOduration=3.335800696 podStartE2EDuration="6.441910962s" totalImagesPullingTime="3.106110266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:29:40.441524829 +0000 UTC m=+303.326593939" watchObservedRunningTime="2026-09-14 10:29:40.441910962 +0000 UTC m=+303.326980069"
Sep 14 10:29:40.471417 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:40.471362    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp" podStartSLOduration=2.402440534 podStartE2EDuration="5.471342665s" totalImagesPullingTime="3.068902131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:29:40.470096003 +0000 UTC m=+303.355165112" watchObservedRunningTime="2026-09-14 10:29:40.471342665 +0000 UTC m=+303.356411774"
Sep 14 10:29:41.341052 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:41.341018    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-m92ch"
Sep 14 10:29:41.344895 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:29:41.344858    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zmqzh"
Sep 14 10:30:11.408458 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:11.408425    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxcxp"
Sep 14 10:30:11.411643 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:11.411619    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qpfhm"
Sep 14 10:30:58.444251 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.444158    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"]
Sep 14 10:30:58.446818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.446794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:30:58.451519 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.451497    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 14 10:30:58.451519 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.451509    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-png22\""
Sep 14 10:30:58.451681 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.451550    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 14 10:30:58.463903 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.463852    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"]
Sep 14 10:30:58.581622 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.581578    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" (UID: \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:30:58.581812 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.581636    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q2pg\" (UniqueName: \"kubernetes.io/projected/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-kube-api-access-5q2pg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" (UID: \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:30:58.682791 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.682746    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" (UID: \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:30:58.683026 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.682808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q2pg\" (UniqueName: \"kubernetes.io/projected/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-kube-api-access-5q2pg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" (UID: \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:30:58.683234 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.683210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" (UID: \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:30:58.716023 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.715950    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q2pg\" (UniqueName: \"kubernetes.io/projected/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-kube-api-access-5q2pg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" (UID: \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:30:58.757467 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:58.757428    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:30:59.038659 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:59.038631    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"]
Sep 14 10:30:59.044492 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:30:59.044465    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b614f4e_aac7_41b7_8bf6_8f7f48cf0041.slice/crio-f79b2576cc98ac4cae0e9fac8f450c79b535538119c87464039cbd48f9eb3e3b WatchSource:0}: Error finding container f79b2576cc98ac4cae0e9fac8f450c79b535538119c87464039cbd48f9eb3e3b: Status 404 returned error can't find the container with id f79b2576cc98ac4cae0e9fac8f450c79b535538119c87464039cbd48f9eb3e3b
Sep 14 10:30:59.047712 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:59.047692    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:30:59.765151 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:30:59.765116    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv" event={"ID":"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041","Type":"ContainerStarted","Data":"f79b2576cc98ac4cae0e9fac8f450c79b535538119c87464039cbd48f9eb3e3b"}
Sep 14 10:31:00.840578 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.840515    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59fbffc489-ls4sl"]
Sep 14 10:31:00.848142 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.848111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:00.852127 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.851173    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 10:31:00.852127 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.851213    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r7wmm\""
Sep 14 10:31:00.852765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.852642    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 10:31:00.852765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.852655    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 10:31:00.852765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.852670    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 10:31:00.853076 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.852840    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 10:31:00.860373 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.859995    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fbffc489-ls4sl"]
Sep 14 10:31:00.863067 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:00.863035    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 10:31:01.004150 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.004098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-oauth-serving-cert\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.004346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.004173    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-trusted-ca-bundle\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.004346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.004209    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-service-ca\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.004346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.004243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c51462b-939b-4152-bbab-0fdfdd909c95-console-oauth-config\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.004346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.004277    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c51462b-939b-4152-bbab-0fdfdd909c95-console-serving-cert\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.004346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.004306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwrsb\" (UniqueName: \"kubernetes.io/projected/2c51462b-939b-4152-bbab-0fdfdd909c95-kube-api-access-wwrsb\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.004605 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.004412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-console-config\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.105556 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.105469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-trusted-ca-bundle\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.105556 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.105515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-service-ca\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.105556 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.105555    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c51462b-939b-4152-bbab-0fdfdd909c95-console-oauth-config\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.105848 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.105724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c51462b-939b-4152-bbab-0fdfdd909c95-console-serving-cert\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.105848 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.105775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwrsb\" (UniqueName: \"kubernetes.io/projected/2c51462b-939b-4152-bbab-0fdfdd909c95-kube-api-access-wwrsb\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.105848 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.105838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-console-config\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.106020 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.105952    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-oauth-serving-cert\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.106586 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.106530    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-service-ca\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.106985 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.106939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-oauth-serving-cert\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.107107 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.107040    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-trusted-ca-bundle\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.107300 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.107242    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c51462b-939b-4152-bbab-0fdfdd909c95-console-config\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.108656 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.108634    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c51462b-939b-4152-bbab-0fdfdd909c95-console-oauth-config\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.108823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.108804    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c51462b-939b-4152-bbab-0fdfdd909c95-console-serving-cert\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.133797 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.133764    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwrsb\" (UniqueName: \"kubernetes.io/projected/2c51462b-939b-4152-bbab-0fdfdd909c95-kube-api-access-wwrsb\") pod \"console-59fbffc489-ls4sl\" (UID: \"2c51462b-939b-4152-bbab-0fdfdd909c95\") " pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.166032 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.165758    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:01.659858 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.659827    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fbffc489-ls4sl"]
Sep 14 10:31:01.661827 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:31:01.661795    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c51462b_939b_4152_bbab_0fdfdd909c95.slice/crio-f15963c31206350ed869d650a7d8ba9d76c73fc7dad8759e00bc7980c2610c47 WatchSource:0}: Error finding container f15963c31206350ed869d650a7d8ba9d76c73fc7dad8759e00bc7980c2610c47: Status 404 returned error can't find the container with id f15963c31206350ed869d650a7d8ba9d76c73fc7dad8759e00bc7980c2610c47
Sep 14 10:31:01.778538 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.778497    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fbffc489-ls4sl" event={"ID":"2c51462b-939b-4152-bbab-0fdfdd909c95","Type":"ContainerStarted","Data":"499b749ff8c75fc9475d05cb15dbce00fb5eb846c4f922e4af242a3b8269fa8b"}
Sep 14 10:31:01.778725 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.778554    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fbffc489-ls4sl" event={"ID":"2c51462b-939b-4152-bbab-0fdfdd909c95","Type":"ContainerStarted","Data":"f15963c31206350ed869d650a7d8ba9d76c73fc7dad8759e00bc7980c2610c47"}
Sep 14 10:31:01.800492 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:01.800436    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59fbffc489-ls4sl" podStartSLOduration=1.8004192890000001 podStartE2EDuration="1.800419289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:31:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:01.79894852 +0000 UTC m=+384.684017630" watchObservedRunningTime="2026-09-14 10:31:01.800419289 +0000 UTC m=+384.685488392"
Sep 14 10:31:03.791426 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:03.791387    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv" event={"ID":"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041","Type":"ContainerStarted","Data":"7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5"}
Sep 14 10:31:03.791923 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:03.791474    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:31:03.822111 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:03.822052    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv" podStartSLOduration=1.815706381 podStartE2EDuration="5.82203469s" totalImagesPullingTime="4.006328309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:03.81976804 +0000 UTC m=+386.704837147" watchObservedRunningTime="2026-09-14 10:31:03.82203469 +0000 UTC m=+386.707103797"
Sep 14 10:31:04.899355 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:04.899313    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"]
Sep 14 10:31:04.902040 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:04.902012    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"
Sep 14 10:31:04.905191 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:04.905163    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 14 10:31:04.905345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:04.905235    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dm9xm\""
Sep 14 10:31:04.913240 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:04.913205    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"]
Sep 14 10:31:05.044286 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:05.044251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt7m2\" (UniqueName: \"kubernetes.io/projected/59e02da0-d8eb-4b17-9739-f9fe55a62f04-kube-api-access-zt7m2\") pod \"dns-operator-controller-manager-7b84cd7c9c-w5hm5\" (UID: \"59e02da0-d8eb-4b17-9739-f9fe55a62f04\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"
Sep 14 10:31:05.145757 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:05.145713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7m2\" (UniqueName: \"kubernetes.io/projected/59e02da0-d8eb-4b17-9739-f9fe55a62f04-kube-api-access-zt7m2\") pod \"dns-operator-controller-manager-7b84cd7c9c-w5hm5\" (UID: \"59e02da0-d8eb-4b17-9739-f9fe55a62f04\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"
Sep 14 10:31:05.158859 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:05.158790    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt7m2\" (UniqueName: \"kubernetes.io/projected/59e02da0-d8eb-4b17-9739-f9fe55a62f04-kube-api-access-zt7m2\") pod \"dns-operator-controller-manager-7b84cd7c9c-w5hm5\" (UID: \"59e02da0-d8eb-4b17-9739-f9fe55a62f04\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"
Sep 14 10:31:05.214725 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:05.214691    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"
Sep 14 10:31:05.492382 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:05.492238    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"]
Sep 14 10:31:05.495647 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:31:05.495619    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e02da0_d8eb_4b17_9739_f9fe55a62f04.slice/crio-120818c08a72375a13f3232340272bb2951a87a6ac5c828cf1ceefa3b86984ac WatchSource:0}: Error finding container 120818c08a72375a13f3232340272bb2951a87a6ac5c828cf1ceefa3b86984ac: Status 404 returned error can't find the container with id 120818c08a72375a13f3232340272bb2951a87a6ac5c828cf1ceefa3b86984ac
Sep 14 10:31:05.802670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:05.802586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5" event={"ID":"59e02da0-d8eb-4b17-9739-f9fe55a62f04","Type":"ContainerStarted","Data":"120818c08a72375a13f3232340272bb2951a87a6ac5c828cf1ceefa3b86984ac"}
Sep 14 10:31:06.171784 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.171744    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"]
Sep 14 10:31:06.175025 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.175003    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.179303 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.179266    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 14 10:31:06.179303 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.179292    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tk8d8\""
Sep 14 10:31:06.179542 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.179292    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 14 10:31:06.188470 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.188444    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"]
Sep 14 10:31:06.255607 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.255562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0bdf6be4-0c54-4a87-9822-4fcda13ae7ef-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vlpnb\" (UID: \"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.255607 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.255613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bdf6be4-0c54-4a87-9822-4fcda13ae7ef-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vlpnb\" (UID: \"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.255837 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.255678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xx2j\" (UniqueName: \"kubernetes.io/projected/0bdf6be4-0c54-4a87-9822-4fcda13ae7ef-kube-api-access-2xx2j\") pod \"kuadrant-console-plugin-fbdd4f445-vlpnb\" (UID: \"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.356221 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.356188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0bdf6be4-0c54-4a87-9822-4fcda13ae7ef-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vlpnb\" (UID: \"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.356440 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.356238    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bdf6be4-0c54-4a87-9822-4fcda13ae7ef-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vlpnb\" (UID: \"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.356440 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.356278    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xx2j\" (UniqueName: \"kubernetes.io/projected/0bdf6be4-0c54-4a87-9822-4fcda13ae7ef-kube-api-access-2xx2j\") pod \"kuadrant-console-plugin-fbdd4f445-vlpnb\" (UID: \"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.356983 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.356962    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0bdf6be4-0c54-4a87-9822-4fcda13ae7ef-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vlpnb\" (UID: \"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.358922 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.358899    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bdf6be4-0c54-4a87-9822-4fcda13ae7ef-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vlpnb\" (UID: \"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.364648 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.364624    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xx2j\" (UniqueName: \"kubernetes.io/projected/0bdf6be4-0c54-4a87-9822-4fcda13ae7ef-kube-api-access-2xx2j\") pod \"kuadrant-console-plugin-fbdd4f445-vlpnb\" (UID: \"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.486321 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.486207    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"
Sep 14 10:31:06.755838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.755809    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb"]
Sep 14 10:31:06.757510 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:31:06.757481    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bdf6be4_0c54_4a87_9822_4fcda13ae7ef.slice/crio-51a7820ed9a2a82c940f817150968cd385de46f7f896237dafed944a7916983a WatchSource:0}: Error finding container 51a7820ed9a2a82c940f817150968cd385de46f7f896237dafed944a7916983a: Status 404 returned error can't find the container with id 51a7820ed9a2a82c940f817150968cd385de46f7f896237dafed944a7916983a
Sep 14 10:31:06.809255 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:06.809219    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb" event={"ID":"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef","Type":"ContainerStarted","Data":"51a7820ed9a2a82c940f817150968cd385de46f7f896237dafed944a7916983a"}
Sep 14 10:31:11.166660 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:11.166607    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:11.167176 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:11.166693    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:11.172411 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:11.172368    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:11.837660 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:11.837629    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb" event={"ID":"0bdf6be4-0c54-4a87-9822-4fcda13ae7ef","Type":"ContainerStarted","Data":"b3f72195d598d6c7a3224a64068423f264b8cd77716b23209171b1071d4eb9cf"}
Sep 14 10:31:11.839521 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:11.839494    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5" event={"ID":"59e02da0-d8eb-4b17-9739-f9fe55a62f04","Type":"ContainerStarted","Data":"94cf5072cf5757aaf7898ec57094c566c4bb9c1cc4094770389a28c7ba738dba"}
Sep 14 10:31:11.839683 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:11.839609    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"
Sep 14 10:31:11.843417 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:11.843394    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59fbffc489-ls4sl"
Sep 14 10:31:11.855201 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:11.855113    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vlpnb" podStartSLOduration=0.973132719 podStartE2EDuration="5.855099032s" totalImagesPullingTime="4.881966313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:11.853964359 +0000 UTC m=+394.739033468" watchObservedRunningTime="2026-09-14 10:31:11.855099032 +0000 UTC m=+394.740168133"
Sep 14 10:31:11.875364 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:11.875301    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5" podStartSLOduration=1.771810957 podStartE2EDuration="7.875263137s" totalImagesPullingTime="6.10345218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:11.873767638 +0000 UTC m=+394.758836769" watchObservedRunningTime="2026-09-14 10:31:11.875263137 +0000 UTC m=+394.760332247"
Sep 14 10:31:14.799481 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:14.799449    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:31:16.813271 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:16.813239    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"]
Sep 14 10:31:16.816459 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:16.816443    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:16.857519 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:16.857485    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"]
Sep 14 10:31:16.957644 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:16.957609    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-2b9wv\" (UID: \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:16.957838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:16.957757    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f6t4\" (UniqueName: \"kubernetes.io/projected/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-kube-api-access-9f6t4\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-2b9wv\" (UID: \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.058945 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.058829    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f6t4\" (UniqueName: \"kubernetes.io/projected/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-kube-api-access-9f6t4\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-2b9wv\" (UID: \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.059106 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.058946    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-2b9wv\" (UID: \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.059379 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.059358    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-2b9wv\" (UID: \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.081922 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.081898    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f6t4\" (UniqueName: \"kubernetes.io/projected/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-kube-api-access-9f6t4\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-2b9wv\" (UID: \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.126746 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.126718    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.261464 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.261434    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"]
Sep 14 10:31:17.261639 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.261619    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv" podUID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" containerName="manager" containerID="cri-o://7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5" gracePeriod=2
Sep 14 10:31:17.288800 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.288771    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"]
Sep 14 10:31:17.296101 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:17.296058    2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\": pods \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:31:17.304698 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.304671    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"]
Sep 14 10:31:17.309324 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.309234    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"]
Sep 14 10:31:17.309843 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.309824    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" containerName="manager"
Sep 14 10:31:17.309953 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.309848    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" containerName="manager"
Sep 14 10:31:17.310004 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.309978    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" containerName="manager"
Sep 14 10:31:17.314694 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.314676    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"]
Sep 14 10:31:17.314821 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.314760    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:17.317461 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:17.317433    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:31:17.336313 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.336277    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"]
Sep 14 10:31:17.361188 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.361156    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tg8dv\" (UID: \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:17.361188 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.361197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw86z\" (UniqueName: \"kubernetes.io/projected/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-kube-api-access-qw86z\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tg8dv\" (UID: \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:17.363948 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.363923    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"]
Sep 14 10:31:17.366582 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.366561    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:17.392418 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:17.392379    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:31:17.422854 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.422827    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"]
Sep 14 10:31:17.461974 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.461939    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqwfq\" (UniqueName: \"kubernetes.io/projected/e34123e7-ea0a-458e-bb64-c9c328d6c03e-kube-api-access-xqwfq\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-54554\" (UID: \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:17.462119 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.462097    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tg8dv\" (UID: \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:17.462157 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.462140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw86z\" (UniqueName: \"kubernetes.io/projected/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-kube-api-access-qw86z\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tg8dv\" (UID: \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:17.462206 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.462187    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e34123e7-ea0a-458e-bb64-c9c328d6c03e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-54554\" (UID: \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:17.462532 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.462504    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tg8dv\" (UID: \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:17.478032 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.478006    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw86z\" (UniqueName: \"kubernetes.io/projected/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-kube-api-access-qw86z\") pod \"kuadrant-operator-controller-manager-76f8f686bf-tg8dv\" (UID: \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:17.508682 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.508660    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:31:17.511861 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:17.511836    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:31:17.529415 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:17.529381    2574 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 14 10:31:17.529415 ip-10-0-141-156 kubenswrapper[2574]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-2b9wv_kuadrant-system_32d2bd3c-1e98-4bdd-ae13-bd883b518c0c_0(dae9e1220e05904ba26144a4fc6a5e24ea2d4568e8ed95120b434853660c39e2): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-2b9wv to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"dae9e1220e05904ba26144a4fc6a5e24ea2d4568e8ed95120b434853660c39e2" Netns:"/var/run/netns/635621d8-40ad-4dc7-aed2-df941a2dfc6d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-2b9wv;K8S_POD_INFRA_CONTAINER_ID=dae9e1220e05904ba26144a4fc6a5e24ea2d4568e8ed95120b434853660c39e2;K8S_POD_UID=32d2bd3c-1e98-4bdd-ae13-bd883b518c0c" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv dae9e1220e05904ba26144a4fc6a5e24ea2d4568e8ed95120b434853660c39e2 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:29 [10.132.0.41/23]
Sep 14 10:31:17.529415 ip-10-0-141-156 kubenswrapper[2574]:         '
Sep 14 10:31:17.529415 ip-10-0-141-156 kubenswrapper[2574]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 14 10:31:17.529415 ip-10-0-141-156 kubenswrapper[2574]:  >
Sep 14 10:31:17.529606 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:17.529443    2574 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 14 10:31:17.529606 ip-10-0-141-156 kubenswrapper[2574]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-2b9wv_kuadrant-system_32d2bd3c-1e98-4bdd-ae13-bd883b518c0c_0(dae9e1220e05904ba26144a4fc6a5e24ea2d4568e8ed95120b434853660c39e2): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-2b9wv to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"dae9e1220e05904ba26144a4fc6a5e24ea2d4568e8ed95120b434853660c39e2" Netns:"/var/run/netns/635621d8-40ad-4dc7-aed2-df941a2dfc6d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-2b9wv;K8S_POD_INFRA_CONTAINER_ID=dae9e1220e05904ba26144a4fc6a5e24ea2d4568e8ed95120b434853660c39e2;K8S_POD_UID=32d2bd3c-1e98-4bdd-ae13-bd883b518c0c" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv dae9e1220e05904ba26144a4fc6a5e24ea2d4568e8ed95120b434853660c39e2 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:29 [10.132.0.41/23]
Sep 14 10:31:17.529606 ip-10-0-141-156 kubenswrapper[2574]:         '
Sep 14 10:31:17.529606 ip-10-0-141-156 kubenswrapper[2574]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 14 10:31:17.529606 ip-10-0-141-156 kubenswrapper[2574]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.562814 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.562735    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-extensions-socket-volume\") pod \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\" (UID: \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\") "
Sep 14 10:31:17.562814 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.562775    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q2pg\" (UniqueName: \"kubernetes.io/projected/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-kube-api-access-5q2pg\") pod \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\" (UID: \"3b614f4e-aac7-41b7-8bf6-8f7f48cf0041\") "
Sep 14 10:31:17.563033 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.562926    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e34123e7-ea0a-458e-bb64-c9c328d6c03e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-54554\" (UID: \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:17.563033 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.562994    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqwfq\" (UniqueName: \"kubernetes.io/projected/e34123e7-ea0a-458e-bb64-c9c328d6c03e-kube-api-access-xqwfq\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-54554\" (UID: \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:17.563346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.563305    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" (UID: "3b614f4e-aac7-41b7-8bf6-8f7f48cf0041"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:31:17.563443 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.563384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e34123e7-ea0a-458e-bb64-c9c328d6c03e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-54554\" (UID: \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:17.565281 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.565255    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-kube-api-access-5q2pg" (OuterVolumeSpecName: "kube-api-access-5q2pg") pod "3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" (UID: "3b614f4e-aac7-41b7-8bf6-8f7f48cf0041"). InnerVolumeSpecName "kube-api-access-5q2pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:31:17.575186 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.575162    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqwfq\" (UniqueName: \"kubernetes.io/projected/e34123e7-ea0a-458e-bb64-c9c328d6c03e-kube-api-access-xqwfq\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-54554\" (UID: \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:17.608078 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:17.608052    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-lbmgv\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:31:17.609409 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.609383    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" path="/var/lib/kubelet/pods/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041/volumes"
Sep 14 10:31:17.646215 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.646187    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:17.663744 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.663721    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-extensions-socket-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:31:17.663838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.663758    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q2pg\" (UniqueName: \"kubernetes.io/projected/3b614f4e-aac7-41b7-8bf6-8f7f48cf0041-kube-api-access-5q2pg\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:31:17.678086 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.678052    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:17.870981 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.870859    2574 generic.go:356] "Generic (PLEG): container finished" podID="3b614f4e-aac7-41b7-8bf6-8f7f48cf0041" containerID="7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5" exitCode=0
Sep 14 10:31:17.870981 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.870917    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lbmgv"
Sep 14 10:31:17.870981 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.870948    2574 scope.go:117] "RemoveContainer" containerID="7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5"
Sep 14 10:31:17.871557 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.871032    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.882983 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.882952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.884502 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.884479    2574 scope.go:117] "RemoveContainer" containerID="7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5"
Sep 14 10:31:17.884796 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:17.884775    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5\": container with ID starting with 7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5 not found: ID does not exist" containerID="7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5"
Sep 14 10:31:17.884857 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.884810    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5"} err="failed to get container status \"7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5\": rpc error: code = NotFound desc = could not find container \"7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5\": container with ID starting with 7989439d065d0eabf61ea64bc38bc65cf66b9d9e39311310bb2fb7de1cfd6bc5 not found: ID does not exist"
Sep 14 10:31:17.885795 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:17.885770    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-2b9wv\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="32d2bd3c-1e98-4bdd-ae13-bd883b518c0c" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:17.938818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.938787    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"]
Sep 14 10:31:17.940499 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:31:17.940473    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536f58fc_8991_426e_b0c2_8c2d55f6e4c4.slice/crio-89a0cc64982793d4fb4d6366ff5e0ac07ebb765ad5a4121482ff6d1a12f13db8 WatchSource:0}: Error finding container 89a0cc64982793d4fb4d6366ff5e0ac07ebb765ad5a4121482ff6d1a12f13db8: Status 404 returned error can't find the container with id 89a0cc64982793d4fb4d6366ff5e0ac07ebb765ad5a4121482ff6d1a12f13db8
Sep 14 10:31:17.966023 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.966000    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-extensions-socket-volume\") pod \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\" (UID: \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\") "
Sep 14 10:31:17.966109 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.966096    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f6t4\" (UniqueName: \"kubernetes.io/projected/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-kube-api-access-9f6t4\") pod \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\" (UID: \"32d2bd3c-1e98-4bdd-ae13-bd883b518c0c\") "
Sep 14 10:31:17.966301 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.966274    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "32d2bd3c-1e98-4bdd-ae13-bd883b518c0c" (UID: "32d2bd3c-1e98-4bdd-ae13-bd883b518c0c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:31:17.966382 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.966368    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-extensions-socket-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:31:17.968288 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.968264    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-kube-api-access-9f6t4" (OuterVolumeSpecName: "kube-api-access-9f6t4") pod "32d2bd3c-1e98-4bdd-ae13-bd883b518c0c" (UID: "32d2bd3c-1e98-4bdd-ae13-bd883b518c0c"). InnerVolumeSpecName "kube-api-access-9f6t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:31:17.982561 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:31:17.982533    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34123e7_ea0a_458e_bb64_c9c328d6c03e.slice/crio-a1835c57d4e1ddbfc39cc56b3c9f81150dd0d0ed33285473afe743ac400ffa42 WatchSource:0}: Error finding container a1835c57d4e1ddbfc39cc56b3c9f81150dd0d0ed33285473afe743ac400ffa42: Status 404 returned error can't find the container with id a1835c57d4e1ddbfc39cc56b3c9f81150dd0d0ed33285473afe743ac400ffa42
Sep 14 10:31:17.983093 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:17.983073    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"]
Sep 14 10:31:18.067176 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:18.067146    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f6t4\" (UniqueName: \"kubernetes.io/projected/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c-kube-api-access-9f6t4\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:31:18.878332 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:18.878297    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554" event={"ID":"e34123e7-ea0a-458e-bb64-c9c328d6c03e","Type":"ContainerStarted","Data":"68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa"}
Sep 14 10:31:18.878894 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:18.878345    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554" event={"ID":"e34123e7-ea0a-458e-bb64-c9c328d6c03e","Type":"ContainerStarted","Data":"a1835c57d4e1ddbfc39cc56b3c9f81150dd0d0ed33285473afe743ac400ffa42"}
Sep 14 10:31:18.878894 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:18.878402    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:18.881087 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:18.881069    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:18.881166 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:18.881065    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv" event={"ID":"536f58fc-8991-426e-b0c2-8c2d55f6e4c4","Type":"ContainerStarted","Data":"a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7"}
Sep 14 10:31:18.881252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:18.881201    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv" event={"ID":"536f58fc-8991-426e-b0c2-8c2d55f6e4c4","Type":"ContainerStarted","Data":"89a0cc64982793d4fb4d6366ff5e0ac07ebb765ad5a4121482ff6d1a12f13db8"}
Sep 14 10:31:18.914684 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:18.914630    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554" podStartSLOduration=1.9146127800000001 podStartE2EDuration="1.91461278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:18.912179042 +0000 UTC m=+401.797248157" watchObservedRunningTime="2026-09-14 10:31:18.91461278 +0000 UTC m=+401.799681887"
Sep 14 10:31:18.915847 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:18.915819    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-2b9wv\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="32d2bd3c-1e98-4bdd-ae13-bd883b518c0c" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:18.952050 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:18.951996    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv" podStartSLOduration=1.9519797840000002 podStartE2EDuration="1.951979784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:18.950925967 +0000 UTC m=+401.835995075" watchObservedRunningTime="2026-09-14 10:31:18.951979784 +0000 UTC m=+401.837048890"
Sep 14 10:31:18.954151 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:18.954124    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-2b9wv\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="32d2bd3c-1e98-4bdd-ae13-bd883b518c0c" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-2b9wv"
Sep 14 10:31:19.608843 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:19.608810    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32d2bd3c-1e98-4bdd-ae13-bd883b518c0c" path="/var/lib/kubelet/pods/32d2bd3c-1e98-4bdd-ae13-bd883b518c0c/volumes"
Sep 14 10:31:19.886163 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:19.886081    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:22.847361 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:22.847325    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-w5hm5"
Sep 14 10:31:29.888095 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:29.888065    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:29.948127 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:29.948093    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"]
Sep 14 10:31:29.948384 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:29.948355    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv" podUID="536f58fc-8991-426e-b0c2-8c2d55f6e4c4" containerName="manager" containerID="cri-o://a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7" gracePeriod=10
Sep 14 10:31:29.950382 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:29.950361    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:30.200298 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.200275    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:30.278414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.278380    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-extensions-socket-volume\") pod \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\" (UID: \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\") "
Sep 14 10:31:30.278414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.278415    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw86z\" (UniqueName: \"kubernetes.io/projected/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-kube-api-access-qw86z\") pod \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\" (UID: \"536f58fc-8991-426e-b0c2-8c2d55f6e4c4\") "
Sep 14 10:31:30.278859 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.278828    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "536f58fc-8991-426e-b0c2-8c2d55f6e4c4" (UID: "536f58fc-8991-426e-b0c2-8c2d55f6e4c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:31:30.280954 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.280924    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-kube-api-access-qw86z" (OuterVolumeSpecName: "kube-api-access-qw86z") pod "536f58fc-8991-426e-b0c2-8c2d55f6e4c4" (UID: "536f58fc-8991-426e-b0c2-8c2d55f6e4c4"). InnerVolumeSpecName "kube-api-access-qw86z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:31:30.283603 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.283580    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"]
Sep 14 10:31:30.284107 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.284090    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536f58fc-8991-426e-b0c2-8c2d55f6e4c4" containerName="manager"
Sep 14 10:31:30.284107 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.284107    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="536f58fc-8991-426e-b0c2-8c2d55f6e4c4" containerName="manager"
Sep 14 10:31:30.284245 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.284172    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="536f58fc-8991-426e-b0c2-8c2d55f6e4c4" containerName="manager"
Sep 14 10:31:30.287377 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.287362    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:30.304174 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.304141    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"]
Sep 14 10:31:30.379646 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.379601    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79456edb-d358-4c32-b3c9-b73407a0c47d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l5wbx\" (UID: \"79456edb-d358-4c32-b3c9-b73407a0c47d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:30.379851 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.379713    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46lnw\" (UniqueName: \"kubernetes.io/projected/79456edb-d358-4c32-b3c9-b73407a0c47d-kube-api-access-46lnw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l5wbx\" (UID: \"79456edb-d358-4c32-b3c9-b73407a0c47d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:30.379851 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.379790    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-extensions-socket-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:31:30.379851 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.379805    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw86z\" (UniqueName: \"kubernetes.io/projected/536f58fc-8991-426e-b0c2-8c2d55f6e4c4-kube-api-access-qw86z\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:31:30.480961 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.480832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79456edb-d358-4c32-b3c9-b73407a0c47d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l5wbx\" (UID: \"79456edb-d358-4c32-b3c9-b73407a0c47d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:30.481109 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.480965    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46lnw\" (UniqueName: \"kubernetes.io/projected/79456edb-d358-4c32-b3c9-b73407a0c47d-kube-api-access-46lnw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l5wbx\" (UID: \"79456edb-d358-4c32-b3c9-b73407a0c47d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:30.481265 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.481244    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79456edb-d358-4c32-b3c9-b73407a0c47d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l5wbx\" (UID: \"79456edb-d358-4c32-b3c9-b73407a0c47d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:30.491235 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.491210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46lnw\" (UniqueName: \"kubernetes.io/projected/79456edb-d358-4c32-b3c9-b73407a0c47d-kube-api-access-46lnw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l5wbx\" (UID: \"79456edb-d358-4c32-b3c9-b73407a0c47d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:30.598011 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.597973    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:30.880689 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.880661    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"]
Sep 14 10:31:30.882535 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:31:30.882507    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79456edb_d358_4c32_b3c9_b73407a0c47d.slice/crio-54bfcf2cce1cb86a59013653ca6094904c28d58f3a133c6f411ba04b93ca3c0d WatchSource:0}: Error finding container 54bfcf2cce1cb86a59013653ca6094904c28d58f3a133c6f411ba04b93ca3c0d: Status 404 returned error can't find the container with id 54bfcf2cce1cb86a59013653ca6094904c28d58f3a133c6f411ba04b93ca3c0d
Sep 14 10:31:30.944095 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.944069    2574 generic.go:356] "Generic (PLEG): container finished" podID="536f58fc-8991-426e-b0c2-8c2d55f6e4c4" containerID="a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7" exitCode=0
Sep 14 10:31:30.944504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.944114    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"
Sep 14 10:31:30.944504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.944138    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv" event={"ID":"536f58fc-8991-426e-b0c2-8c2d55f6e4c4","Type":"ContainerDied","Data":"a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7"}
Sep 14 10:31:30.944504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.944180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv" event={"ID":"536f58fc-8991-426e-b0c2-8c2d55f6e4c4","Type":"ContainerDied","Data":"89a0cc64982793d4fb4d6366ff5e0ac07ebb765ad5a4121482ff6d1a12f13db8"}
Sep 14 10:31:30.944504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.944207    2574 scope.go:117] "RemoveContainer" containerID="a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7"
Sep 14 10:31:30.946459 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.946433    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx" event={"ID":"79456edb-d358-4c32-b3c9-b73407a0c47d","Type":"ContainerStarted","Data":"54bfcf2cce1cb86a59013653ca6094904c28d58f3a133c6f411ba04b93ca3c0d"}
Sep 14 10:31:30.953150 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.952982    2574 scope.go:117] "RemoveContainer" containerID="a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7"
Sep 14 10:31:30.953348 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:30.953328    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7\": container with ID starting with a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7 not found: ID does not exist" containerID="a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7"
Sep 14 10:31:30.953413 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:30.953357    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7"} err="failed to get container status \"a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7\": rpc error: code = NotFound desc = could not find container \"a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7\": container with ID starting with a1f678de973057205e9136baaa499b4898dcddef9d7b7957a678475f5a58d8d7 not found: ID does not exist"
Sep 14 10:31:31.005177 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:31.005137    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"]
Sep 14 10:31:31.018094 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:31.018063    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-tg8dv"]
Sep 14 10:31:31.609678 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:31.609644    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="536f58fc-8991-426e-b0c2-8c2d55f6e4c4" path="/var/lib/kubelet/pods/536f58fc-8991-426e-b0c2-8c2d55f6e4c4/volumes"
Sep 14 10:31:31.953457 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:31.953419    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx" event={"ID":"79456edb-d358-4c32-b3c9-b73407a0c47d","Type":"ContainerStarted","Data":"709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed"}
Sep 14 10:31:31.953848 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:31.953548    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:31.996714 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:31.996664    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx" podStartSLOduration=1.996647691 podStartE2EDuration="1.996647691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:31.995462228 +0000 UTC m=+414.880531338" watchObservedRunningTime="2026-09-14 10:31:31.996647691 +0000 UTC m=+414.881716800"
Sep 14 10:31:42.961270 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:42.961238    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 10:31:43.017976 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:43.017942    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"]
Sep 14 10:31:43.018192 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:43.018170    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554" podUID="e34123e7-ea0a-458e-bb64-c9c328d6c03e" containerName="manager" containerID="cri-o://68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa" gracePeriod=10
Sep 14 10:31:43.266357 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:43.266334    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:43.397699 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:43.397660    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqwfq\" (UniqueName: \"kubernetes.io/projected/e34123e7-ea0a-458e-bb64-c9c328d6c03e-kube-api-access-xqwfq\") pod \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\" (UID: \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\") "
Sep 14 10:31:43.397920 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:43.397751    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e34123e7-ea0a-458e-bb64-c9c328d6c03e-extensions-socket-volume\") pod \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\" (UID: \"e34123e7-ea0a-458e-bb64-c9c328d6c03e\") "
Sep 14 10:31:43.398129 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:43.398105    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e34123e7-ea0a-458e-bb64-c9c328d6c03e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e34123e7-ea0a-458e-bb64-c9c328d6c03e" (UID: "e34123e7-ea0a-458e-bb64-c9c328d6c03e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:31:43.400105 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:43.400085    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e34123e7-ea0a-458e-bb64-c9c328d6c03e-kube-api-access-xqwfq" (OuterVolumeSpecName: "kube-api-access-xqwfq") pod "e34123e7-ea0a-458e-bb64-c9c328d6c03e" (UID: "e34123e7-ea0a-458e-bb64-c9c328d6c03e"). InnerVolumeSpecName "kube-api-access-xqwfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:31:43.498613 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:43.498522    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e34123e7-ea0a-458e-bb64-c9c328d6c03e-extensions-socket-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:31:43.498613 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:43.498549    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqwfq\" (UniqueName: \"kubernetes.io/projected/e34123e7-ea0a-458e-bb64-c9c328d6c03e-kube-api-access-xqwfq\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:31:44.023329 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:44.023292    2574 generic.go:356] "Generic (PLEG): container finished" podID="e34123e7-ea0a-458e-bb64-c9c328d6c03e" containerID="68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa" exitCode=0
Sep 14 10:31:44.023750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:44.023335    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554" event={"ID":"e34123e7-ea0a-458e-bb64-c9c328d6c03e","Type":"ContainerDied","Data":"68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa"}
Sep 14 10:31:44.023750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:44.023345    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"
Sep 14 10:31:44.023750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:44.023386    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554" event={"ID":"e34123e7-ea0a-458e-bb64-c9c328d6c03e","Type":"ContainerDied","Data":"a1835c57d4e1ddbfc39cc56b3c9f81150dd0d0ed33285473afe743ac400ffa42"}
Sep 14 10:31:44.024292 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:44.023417    2574 scope.go:117] "RemoveContainer" containerID="68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa"
Sep 14 10:31:44.034547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:44.034515    2574 scope.go:117] "RemoveContainer" containerID="68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa"
Sep 14 10:31:44.039321 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:31:44.039292    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa\": container with ID starting with 68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa not found: ID does not exist" containerID="68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa"
Sep 14 10:31:44.039438 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:44.039331    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa"} err="failed to get container status \"68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa\": rpc error: code = NotFound desc = could not find container \"68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa\": container with ID starting with 68cf558dca048756d3c18db7688d90a6ee977119bcd113982cec99f62aaf10aa not found: ID does not exist"
Sep 14 10:31:44.051082 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:44.051058    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"]
Sep 14 10:31:44.057352 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:44.057323    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-54554"]
Sep 14 10:31:45.608161 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:45.608128    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e34123e7-ea0a-458e-bb64-c9c328d6c03e" path="/var/lib/kubelet/pods/e34123e7-ea0a-458e-bb64-c9c328d6c03e/volumes"
Sep 14 10:31:46.444748 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.444699    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"]
Sep 14 10:31:46.445136 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.445119    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34123e7-ea0a-458e-bb64-c9c328d6c03e" containerName="manager"
Sep 14 10:31:46.445136 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.445136    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34123e7-ea0a-458e-bb64-c9c328d6c03e" containerName="manager"
Sep 14 10:31:46.445269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.445195    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34123e7-ea0a-458e-bb64-c9c328d6c03e" containerName="manager"
Sep 14 10:31:46.447916 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.447863    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.450578 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.450558    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-m8ftv\""
Sep 14 10:31:46.463373 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.463339    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"]
Sep 14 10:31:46.526091 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.526055    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.526269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.526110    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.526269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.526141    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7rgp\" (UniqueName: \"kubernetes.io/projected/a3ca7d48-2152-44d9-a235-89bad9b45782-kube-api-access-z7rgp\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.526269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.526180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.526269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.526199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.526269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.526216    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.526435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.526332    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.526435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.526378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3ca7d48-2152-44d9-a235-89bad9b45782-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.526435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.526425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.627786 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.627733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.627808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.627860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.627923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7rgp\" (UniqueName: \"kubernetes.io/projected/a3ca7d48-2152-44d9-a235-89bad9b45782-kube-api-access-z7rgp\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.627971    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.628002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.628031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.628065    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.628097    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3ca7d48-2152-44d9-a235-89bad9b45782-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.628310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628742 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.628476    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628742 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.628556    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.628742 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.628597    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.629079 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.629061    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3ca7d48-2152-44d9-a235-89bad9b45782-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.630970 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.630944    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.631128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.631110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.637409 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.637385    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3ca7d48-2152-44d9-a235-89bad9b45782-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.637540 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.637519    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7rgp\" (UniqueName: \"kubernetes.io/projected/a3ca7d48-2152-44d9-a235-89bad9b45782-kube-api-access-z7rgp\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkbk\" (UID: \"a3ca7d48-2152-44d9-a235-89bad9b45782\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:46.758777 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:46.758664    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:47.043500 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:47.043412    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"]
Sep 14 10:31:47.047780 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:31:47.047749    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ca7d48_2152_44d9_a235_89bad9b45782.slice/crio-cb1c1efe78abd12e33cc2921acf8d65ef6cd1799fac7b57957d38e1933df3ff1 WatchSource:0}: Error finding container cb1c1efe78abd12e33cc2921acf8d65ef6cd1799fac7b57957d38e1933df3ff1: Status 404 returned error can't find the container with id cb1c1efe78abd12e33cc2921acf8d65ef6cd1799fac7b57957d38e1933df3ff1
Sep 14 10:31:47.050031 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:47.049999    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:31:47.050136 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:47.050066    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:31:47.050136 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:47.050091    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:31:48.045982 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:48.045952    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" event={"ID":"a3ca7d48-2152-44d9-a235-89bad9b45782","Type":"ContainerStarted","Data":"8fda197d45723936f7f21632cdb17eca3cc55c483cfb954ce3f3712aeaf7d717"}
Sep 14 10:31:48.046396 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:48.046010    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" event={"ID":"a3ca7d48-2152-44d9-a235-89bad9b45782","Type":"ContainerStarted","Data":"cb1c1efe78abd12e33cc2921acf8d65ef6cd1799fac7b57957d38e1933df3ff1"}
Sep 14 10:31:48.066310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:48.066255    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" podStartSLOduration=2.066237638 podStartE2EDuration="2.066237638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:31:48.066061451 +0000 UTC m=+430.951130560" watchObservedRunningTime="2026-09-14 10:31:48.066237638 +0000 UTC m=+430.951306774"
Sep 14 10:31:48.758933 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:48.758886    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:48.763818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:48.763791    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:49.051198 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:49.051104    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:31:49.052067 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:31:49.052045    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:32:01.980681 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:01.980603    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dfxsg"]
Sep 14 10:32:01.984242 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:01.984223    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:01.988144 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:01.988118    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 14 10:32:02.002181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.002153    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dfxsg"]
Sep 14 10:32:02.074092 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.074054    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dfxsg"]
Sep 14 10:32:02.172744 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.172705    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q67n\" (UniqueName: \"kubernetes.io/projected/62672534-1d88-4a7c-9cd6-681d9f8807a0-kube-api-access-6q67n\") pod \"limitador-limitador-8588749977-dfxsg\" (UID: \"62672534-1d88-4a7c-9cd6-681d9f8807a0\") " pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:02.172972 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.172774    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62672534-1d88-4a7c-9cd6-681d9f8807a0-config-file\") pod \"limitador-limitador-8588749977-dfxsg\" (UID: \"62672534-1d88-4a7c-9cd6-681d9f8807a0\") " pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:02.274226 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.274137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q67n\" (UniqueName: \"kubernetes.io/projected/62672534-1d88-4a7c-9cd6-681d9f8807a0-kube-api-access-6q67n\") pod \"limitador-limitador-8588749977-dfxsg\" (UID: \"62672534-1d88-4a7c-9cd6-681d9f8807a0\") " pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:02.274379 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.274230    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62672534-1d88-4a7c-9cd6-681d9f8807a0-config-file\") pod \"limitador-limitador-8588749977-dfxsg\" (UID: \"62672534-1d88-4a7c-9cd6-681d9f8807a0\") " pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:02.274924 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.274904    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62672534-1d88-4a7c-9cd6-681d9f8807a0-config-file\") pod \"limitador-limitador-8588749977-dfxsg\" (UID: \"62672534-1d88-4a7c-9cd6-681d9f8807a0\") " pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:02.284044 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.284018    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q67n\" (UniqueName: \"kubernetes.io/projected/62672534-1d88-4a7c-9cd6-681d9f8807a0-kube-api-access-6q67n\") pod \"limitador-limitador-8588749977-dfxsg\" (UID: \"62672534-1d88-4a7c-9cd6-681d9f8807a0\") " pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:02.295725 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.295700    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:02.574470 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:02.574434    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dfxsg"]
Sep 14 10:32:02.576825 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:32:02.576802    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62672534_1d88_4a7c_9cd6_681d9f8807a0.slice/crio-f3bdfe20871d57eaf4de932b5fff1e955d91b386b25b8934fdc95633c8da132c WatchSource:0}: Error finding container f3bdfe20871d57eaf4de932b5fff1e955d91b386b25b8934fdc95633c8da132c: Status 404 returned error can't find the container with id f3bdfe20871d57eaf4de932b5fff1e955d91b386b25b8934fdc95633c8da132c
Sep 14 10:32:03.121906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:03.121858    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg" event={"ID":"62672534-1d88-4a7c-9cd6-681d9f8807a0","Type":"ContainerStarted","Data":"f3bdfe20871d57eaf4de932b5fff1e955d91b386b25b8934fdc95633c8da132c"}
Sep 14 10:32:05.134865 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:05.134830    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg" event={"ID":"62672534-1d88-4a7c-9cd6-681d9f8807a0","Type":"ContainerStarted","Data":"1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa"}
Sep 14 10:32:05.135289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:05.134939    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:05.154458 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:05.154403    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg" podStartSLOduration=2.532832054 podStartE2EDuration="4.154386176s" totalImagesPullingTime="1.621554122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:32:05.153730503 +0000 UTC m=+448.038799623" watchObservedRunningTime="2026-09-14 10:32:05.154386176 +0000 UTC m=+448.039455315"
Sep 14 10:32:15.794004 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:15.793963    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dfxsg"]
Sep 14 10:32:15.794427 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:15.794192    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg" podUID="62672534-1d88-4a7c-9cd6-681d9f8807a0" containerName="limitador" containerID="cri-o://1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa" gracePeriod=30
Sep 14 10:32:15.794925 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:15.794905    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:16.351622 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:16.351598    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:16.412973 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:16.412943    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62672534-1d88-4a7c-9cd6-681d9f8807a0-config-file\") pod \"62672534-1d88-4a7c-9cd6-681d9f8807a0\" (UID: \"62672534-1d88-4a7c-9cd6-681d9f8807a0\") "
Sep 14 10:32:16.413175 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:16.412996    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q67n\" (UniqueName: \"kubernetes.io/projected/62672534-1d88-4a7c-9cd6-681d9f8807a0-kube-api-access-6q67n\") pod \"62672534-1d88-4a7c-9cd6-681d9f8807a0\" (UID: \"62672534-1d88-4a7c-9cd6-681d9f8807a0\") "
Sep 14 10:32:16.413352 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:16.413329    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62672534-1d88-4a7c-9cd6-681d9f8807a0-config-file" (OuterVolumeSpecName: "config-file") pod "62672534-1d88-4a7c-9cd6-681d9f8807a0" (UID: "62672534-1d88-4a7c-9cd6-681d9f8807a0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:32:16.415258 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:16.415235    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62672534-1d88-4a7c-9cd6-681d9f8807a0-kube-api-access-6q67n" (OuterVolumeSpecName: "kube-api-access-6q67n") pod "62672534-1d88-4a7c-9cd6-681d9f8807a0" (UID: "62672534-1d88-4a7c-9cd6-681d9f8807a0"). InnerVolumeSpecName "kube-api-access-6q67n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:32:16.514038 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:16.514001    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62672534-1d88-4a7c-9cd6-681d9f8807a0-config-file\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:32:16.514038 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:16.514033    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q67n\" (UniqueName: \"kubernetes.io/projected/62672534-1d88-4a7c-9cd6-681d9f8807a0-kube-api-access-6q67n\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:32:17.198590 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.198553    2574 generic.go:356] "Generic (PLEG): container finished" podID="62672534-1d88-4a7c-9cd6-681d9f8807a0" containerID="1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa" exitCode=0
Sep 14 10:32:17.199055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.198601    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg"
Sep 14 10:32:17.199055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.198600    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg" event={"ID":"62672534-1d88-4a7c-9cd6-681d9f8807a0","Type":"ContainerDied","Data":"1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa"}
Sep 14 10:32:17.199055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.198709    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-dfxsg" event={"ID":"62672534-1d88-4a7c-9cd6-681d9f8807a0","Type":"ContainerDied","Data":"f3bdfe20871d57eaf4de932b5fff1e955d91b386b25b8934fdc95633c8da132c"}
Sep 14 10:32:17.199055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.198738    2574 scope.go:117] "RemoveContainer" containerID="1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa"
Sep 14 10:32:17.208050 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.208031    2574 scope.go:117] "RemoveContainer" containerID="1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa"
Sep 14 10:32:17.208339 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:32:17.208319    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa\": container with ID starting with 1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa not found: ID does not exist" containerID="1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa"
Sep 14 10:32:17.208401 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.208347    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa"} err="failed to get container status \"1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa\": rpc error: code = NotFound desc = could not find container \"1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa\": container with ID starting with 1611a2b238fd44544d26e8240ed392ac4483e7512797b3dc00ea6349e0509bfa not found: ID does not exist"
Sep 14 10:32:17.222856 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.222817    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dfxsg"]
Sep 14 10:32:17.225015 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.224995    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dfxsg"]
Sep 14 10:32:17.610113 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:17.610035    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62672534-1d88-4a7c-9cd6-681d9f8807a0" path="/var/lib/kubelet/pods/62672534-1d88-4a7c-9cd6-681d9f8807a0/volumes"
Sep 14 10:32:21.155640 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.155608    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"]
Sep 14 10:32:21.156027 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.156013    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62672534-1d88-4a7c-9cd6-681d9f8807a0" containerName="limitador"
Sep 14 10:32:21.156082 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.156028    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62672534-1d88-4a7c-9cd6-681d9f8807a0" containerName="limitador"
Sep 14 10:32:21.156120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.156087    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62672534-1d88-4a7c-9cd6-681d9f8807a0" containerName="limitador"
Sep 14 10:32:21.160385 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.160364    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:21.163464 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.163410    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 14 10:32:21.163464 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.163418    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 10:32:21.164699 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.164679    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-h4tgq\""
Sep 14 10:32:21.164808 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.164732    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 14 10:32:21.168864 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.168839    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"]
Sep 14 10:32:21.254528 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.254491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ftwv\" (UniqueName: \"kubernetes.io/projected/433a4c66-ff1c-444c-bf3e-dedaa6416cb9-kube-api-access-7ftwv\") pod \"postgres-69fb4594cf-2qmbr\" (UID: \"433a4c66-ff1c-444c-bf3e-dedaa6416cb9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:21.254709 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.254590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/433a4c66-ff1c-444c-bf3e-dedaa6416cb9-data\") pod \"postgres-69fb4594cf-2qmbr\" (UID: \"433a4c66-ff1c-444c-bf3e-dedaa6416cb9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:21.355603 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.355570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/433a4c66-ff1c-444c-bf3e-dedaa6416cb9-data\") pod \"postgres-69fb4594cf-2qmbr\" (UID: \"433a4c66-ff1c-444c-bf3e-dedaa6416cb9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:21.355786 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.355653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ftwv\" (UniqueName: \"kubernetes.io/projected/433a4c66-ff1c-444c-bf3e-dedaa6416cb9-kube-api-access-7ftwv\") pod \"postgres-69fb4594cf-2qmbr\" (UID: \"433a4c66-ff1c-444c-bf3e-dedaa6416cb9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:21.356011 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.355991    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/433a4c66-ff1c-444c-bf3e-dedaa6416cb9-data\") pod \"postgres-69fb4594cf-2qmbr\" (UID: \"433a4c66-ff1c-444c-bf3e-dedaa6416cb9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:21.365115 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.365088    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ftwv\" (UniqueName: \"kubernetes.io/projected/433a4c66-ff1c-444c-bf3e-dedaa6416cb9-kube-api-access-7ftwv\") pod \"postgres-69fb4594cf-2qmbr\" (UID: \"433a4c66-ff1c-444c-bf3e-dedaa6416cb9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:21.473286 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.473174    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:21.745953 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:21.745925    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"]
Sep 14 10:32:21.748641 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:32:21.748613    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433a4c66_ff1c_444c_bf3e_dedaa6416cb9.slice/crio-2f4a7d421d0a7df1c71c777357e7faa7b46b90147a9cc46b48a72eb46641211f WatchSource:0}: Error finding container 2f4a7d421d0a7df1c71c777357e7faa7b46b90147a9cc46b48a72eb46641211f: Status 404 returned error can't find the container with id 2f4a7d421d0a7df1c71c777357e7faa7b46b90147a9cc46b48a72eb46641211f
Sep 14 10:32:22.225965 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:22.225919    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr" event={"ID":"433a4c66-ff1c-444c-bf3e-dedaa6416cb9","Type":"ContainerStarted","Data":"2f4a7d421d0a7df1c71c777357e7faa7b46b90147a9cc46b48a72eb46641211f"}
Sep 14 10:32:25.245966 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:25.245927    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr" event={"ID":"433a4c66-ff1c-444c-bf3e-dedaa6416cb9","Type":"ContainerStarted","Data":"65f53e820ad8d2cab2946df1251d7c3e07ada1f7370cae39dab2751a059aa61e"}
Sep 14 10:32:25.246426 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:25.246155    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:25.269338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:25.269279    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr" podStartSLOduration=1.64677308 podStartE2EDuration="4.269261312s" totalImagesPullingTime="2.622488232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:32:25.267429313 +0000 UTC m=+468.152498420" watchObservedRunningTime="2026-09-14 10:32:25.269261312 +0000 UTC m=+468.154330420"
Sep 14 10:32:31.280629 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:31.280598    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qmbr"
Sep 14 10:32:38.799754 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.799718    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7465769cc9-tqw2n"]
Sep 14 10:32:38.805710 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.805683    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:38.808738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.808713    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 14 10:32:38.808944 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.808900    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 14 10:32:38.809031 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.809017    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7ckql\""
Sep 14 10:32:38.809265 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.809248    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 14 10:32:38.815586 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.815561    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7465769cc9-tqw2n"]
Sep 14 10:32:38.920441 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.920399    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-metrics-certs\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:38.920625 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.920476    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-webhook-cert\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:38.920625 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:38.920544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bszl5\" (UniqueName: \"kubernetes.io/projected/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-kube-api-access-bszl5\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:39.001204 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.001171    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6555589997-8jpzl"]
Sep 14 10:32:39.003734 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.003717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.015668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.015642    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6555589997-8jpzl"]
Sep 14 10:32:39.021111 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.021086    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-webhook-cert\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:39.021308 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.021116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bszl5\" (UniqueName: \"kubernetes.io/projected/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-kube-api-access-bszl5\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:39.021308 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.021177    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-metrics-certs\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:39.021308 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:32:39.021268    2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 14 10:32:39.021670 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:32:39.021325    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-metrics-certs podName:8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b nodeName:}" failed. No retries permitted until 2026-09-14 10:32:39.521308603 +0000 UTC m=+482.406377690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-metrics-certs") pod "maas-controller-7465769cc9-tqw2n" (UID: "8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b") : secret "maas-controller-metrics-tls" not found
Sep 14 10:32:39.023900 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.023858    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-webhook-cert\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:39.031105 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.031080    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bszl5\" (UniqueName: \"kubernetes.io/projected/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-kube-api-access-bszl5\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:39.122467 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.122372    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-webhook-cert\") pod \"maas-controller-6555589997-8jpzl\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") " pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.122467 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.122417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2xk\" (UniqueName: \"kubernetes.io/projected/0c72753d-076b-4d96-9422-135fcd201781-kube-api-access-vr2xk\") pod \"maas-controller-6555589997-8jpzl\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") " pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.122708 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.122541    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-metrics-certs\") pod \"maas-controller-6555589997-8jpzl\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") " pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.223310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.223266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-webhook-cert\") pod \"maas-controller-6555589997-8jpzl\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") " pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.223310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.223316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2xk\" (UniqueName: \"kubernetes.io/projected/0c72753d-076b-4d96-9422-135fcd201781-kube-api-access-vr2xk\") pod \"maas-controller-6555589997-8jpzl\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") " pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.223550 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.223368    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-metrics-certs\") pod \"maas-controller-6555589997-8jpzl\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") " pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.225935 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.225912    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-metrics-certs\") pod \"maas-controller-6555589997-8jpzl\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") " pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.225935 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.225932    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-webhook-cert\") pod \"maas-controller-6555589997-8jpzl\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") " pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.235248 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.235218    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2xk\" (UniqueName: \"kubernetes.io/projected/0c72753d-076b-4d96-9422-135fcd201781-kube-api-access-vr2xk\") pod \"maas-controller-6555589997-8jpzl\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") " pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.314345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.314314    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:39.526508 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.526473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-metrics-certs\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:39.529055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.529032    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-metrics-certs\") pod \"maas-controller-7465769cc9-tqw2n\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") " pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:39.587010 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.586985    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6555589997-8jpzl"]
Sep 14 10:32:39.589037 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:32:39.589011    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c72753d_076b_4d96_9422_135fcd201781.slice/crio-c6f2c0125c439a1a786c14963ef470de219418bf16773d4db67baf948b796ab7 WatchSource:0}: Error finding container c6f2c0125c439a1a786c14963ef470de219418bf16773d4db67baf948b796ab7: Status 404 returned error can't find the container with id c6f2c0125c439a1a786c14963ef470de219418bf16773d4db67baf948b796ab7
Sep 14 10:32:39.719127 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.719086    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:39.996982 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:39.996904    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7465769cc9-tqw2n"]
Sep 14 10:32:39.999706 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:32:39.999670    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbb6227_3de0_4e6f_8394_6dc2e2ddab4b.slice/crio-180064a977c5b04a90b24f8408add7cdbda019678cc88466ae304073d36d2dfc WatchSource:0}: Error finding container 180064a977c5b04a90b24f8408add7cdbda019678cc88466ae304073d36d2dfc: Status 404 returned error can't find the container with id 180064a977c5b04a90b24f8408add7cdbda019678cc88466ae304073d36d2dfc
Sep 14 10:32:40.320265 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:40.320179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7465769cc9-tqw2n" event={"ID":"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b","Type":"ContainerStarted","Data":"180064a977c5b04a90b24f8408add7cdbda019678cc88466ae304073d36d2dfc"}
Sep 14 10:32:40.321357 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:40.321333    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-8jpzl" event={"ID":"0c72753d-076b-4d96-9422-135fcd201781","Type":"ContainerStarted","Data":"c6f2c0125c439a1a786c14963ef470de219418bf16773d4db67baf948b796ab7"}
Sep 14 10:32:43.342545 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:43.342504    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7465769cc9-tqw2n" event={"ID":"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b","Type":"ContainerStarted","Data":"aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414"}
Sep 14 10:32:43.343085 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:43.342573    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:43.344069 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:43.344049    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-8jpzl" event={"ID":"0c72753d-076b-4d96-9422-135fcd201781","Type":"ContainerStarted","Data":"330a42bfd78009f9595a29ec847e757bd3ac6aaee5d86d19960cb92f7626f3f9"}
Sep 14 10:32:43.344214 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:43.344197    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:43.391394 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:43.391345    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7465769cc9-tqw2n" podStartSLOduration=2.861940768 podStartE2EDuration="5.391326753s" totalImagesPullingTime="2.529385985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:32:43.366606609 +0000 UTC m=+486.251675718" watchObservedRunningTime="2026-09-14 10:32:43.391326753 +0000 UTC m=+486.276395859"
Sep 14 10:32:43.392478 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:43.392444    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6555589997-8jpzl" podStartSLOduration=2.456630369 podStartE2EDuration="5.392431575s" totalImagesPullingTime="2.935801206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:32:43.390844288 +0000 UTC m=+486.275913393" watchObservedRunningTime="2026-09-14 10:32:43.392431575 +0000 UTC m=+486.277500682"
Sep 14 10:32:54.351724 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.351686    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:32:54.352210 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.351759    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:54.423753 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.423711    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7465769cc9-tqw2n"]
Sep 14 10:32:54.424281 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.424220    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7465769cc9-tqw2n" podUID="8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b" containerName="manager" containerID="cri-o://aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414" gracePeriod=30
Sep 14 10:32:54.680339 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.680313    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:54.766648 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.766614    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bszl5\" (UniqueName: \"kubernetes.io/projected/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-kube-api-access-bszl5\") pod \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") "
Sep 14 10:32:54.766843 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.766723    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-metrics-certs\") pod \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") "
Sep 14 10:32:54.766843 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.766750    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-webhook-cert\") pod \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\" (UID: \"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b\") "
Sep 14 10:32:54.769099 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.769064    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b" (UID: "8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:32:54.769214 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.769102    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-kube-api-access-bszl5" (OuterVolumeSpecName: "kube-api-access-bszl5") pod "8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b" (UID: "8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b"). InnerVolumeSpecName "kube-api-access-bszl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:32:54.769214 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.769154    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b" (UID: "8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:32:54.867839 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.867795    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bszl5\" (UniqueName: \"kubernetes.io/projected/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-kube-api-access-bszl5\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:32:54.867839 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.867832    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-metrics-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:32:54.867839 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:54.867841    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b-webhook-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:32:55.407501 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.407466    2574 generic.go:356] "Generic (PLEG): container finished" podID="8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b" containerID="aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414" exitCode=0
Sep 14 10:32:55.408013 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.407513    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465769cc9-tqw2n"
Sep 14 10:32:55.408013 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.407548    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7465769cc9-tqw2n" event={"ID":"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b","Type":"ContainerDied","Data":"aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414"}
Sep 14 10:32:55.408013 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.407597    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7465769cc9-tqw2n" event={"ID":"8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b","Type":"ContainerDied","Data":"180064a977c5b04a90b24f8408add7cdbda019678cc88466ae304073d36d2dfc"}
Sep 14 10:32:55.408013 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.407618    2574 scope.go:117] "RemoveContainer" containerID="aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414"
Sep 14 10:32:55.416928 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.416917    2574 scope.go:117] "RemoveContainer" containerID="aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414"
Sep 14 10:32:55.417216 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:32:55.417200    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414\": container with ID starting with aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414 not found: ID does not exist" containerID="aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414"
Sep 14 10:32:55.417272 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.417223    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414"} err="failed to get container status \"aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414\": rpc error: code = NotFound desc = could not find container \"aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414\": container with ID starting with aba3b5205c96a4a5bb70a13d3701f292bac044fbb8416d756bdf664be6c80414 not found: ID does not exist"
Sep 14 10:32:55.429645 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.429613    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7465769cc9-tqw2n"]
Sep 14 10:32:55.436095 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.436070    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7465769cc9-tqw2n"]
Sep 14 10:32:55.609579 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:32:55.609542    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b" path="/var/lib/kubelet/pods/8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b/volumes"
Sep 14 10:33:16.416780 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.416748    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"]
Sep 14 10:33:16.417209 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.417178    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b" containerName="manager"
Sep 14 10:33:16.417209 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.417189    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b" containerName="manager"
Sep 14 10:33:16.417291 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.417257    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cbb6227-3de0-4e6f-8394-6dc2e2ddab4b" containerName="manager"
Sep 14 10:33:16.422305 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.422282    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:16.426052 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.426027    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 14 10:33:16.441056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.441026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"]
Sep 14 10:33:16.442927 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.442910    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"]
Sep 14 10:33:16.446219 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.446198    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:16.449391 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.449366    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kpwbq\""
Sep 14 10:33:16.463412 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.463382    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"]
Sep 14 10:33:16.567390 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.567350    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpg6s\" (UniqueName: \"kubernetes.io/projected/70af39b3-c409-42a2-8453-02e61a6a03ee-kube-api-access-gpg6s\") pod \"payload-processing-5b54b7fbb7-ncl9j\" (UID: \"70af39b3-c409-42a2-8453-02e61a6a03ee\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:16.567585 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.567474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5lsn\" (UniqueName: \"kubernetes.io/projected/f502e30f-c158-4a43-8c65-4fbe958bb3e4-kube-api-access-v5lsn\") pod \"payload-pre-processing-59fbc47bf8-wkmjz\" (UID: \"f502e30f-c158-4a43-8c65-4fbe958bb3e4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:16.567585 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.567537    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f502e30f-c158-4a43-8c65-4fbe958bb3e4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wkmjz\" (UID: \"f502e30f-c158-4a43-8c65-4fbe958bb3e4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:16.567585 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.567573    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70af39b3-c409-42a2-8453-02e61a6a03ee-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ncl9j\" (UID: \"70af39b3-c409-42a2-8453-02e61a6a03ee\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:16.669002 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.668900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpg6s\" (UniqueName: \"kubernetes.io/projected/70af39b3-c409-42a2-8453-02e61a6a03ee-kube-api-access-gpg6s\") pod \"payload-processing-5b54b7fbb7-ncl9j\" (UID: \"70af39b3-c409-42a2-8453-02e61a6a03ee\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:16.669182 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.669011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5lsn\" (UniqueName: \"kubernetes.io/projected/f502e30f-c158-4a43-8c65-4fbe958bb3e4-kube-api-access-v5lsn\") pod \"payload-pre-processing-59fbc47bf8-wkmjz\" (UID: \"f502e30f-c158-4a43-8c65-4fbe958bb3e4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:16.669182 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.669064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f502e30f-c158-4a43-8c65-4fbe958bb3e4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wkmjz\" (UID: \"f502e30f-c158-4a43-8c65-4fbe958bb3e4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:16.669182 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.669104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70af39b3-c409-42a2-8453-02e61a6a03ee-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ncl9j\" (UID: \"70af39b3-c409-42a2-8453-02e61a6a03ee\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:16.669910 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.669856    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70af39b3-c409-42a2-8453-02e61a6a03ee-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ncl9j\" (UID: \"70af39b3-c409-42a2-8453-02e61a6a03ee\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:16.670076 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.670053    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f502e30f-c158-4a43-8c65-4fbe958bb3e4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wkmjz\" (UID: \"f502e30f-c158-4a43-8c65-4fbe958bb3e4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:16.679014 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.678987    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpg6s\" (UniqueName: \"kubernetes.io/projected/70af39b3-c409-42a2-8453-02e61a6a03ee-kube-api-access-gpg6s\") pod \"payload-processing-5b54b7fbb7-ncl9j\" (UID: \"70af39b3-c409-42a2-8453-02e61a6a03ee\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:16.679152 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.679130    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5lsn\" (UniqueName: \"kubernetes.io/projected/f502e30f-c158-4a43-8c65-4fbe958bb3e4-kube-api-access-v5lsn\") pod \"payload-pre-processing-59fbc47bf8-wkmjz\" (UID: \"f502e30f-c158-4a43-8c65-4fbe958bb3e4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:16.733892 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.733843    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:16.760896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:16.760833    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:17.034746 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:17.034712    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"]
Sep 14 10:33:17.037512 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:33:17.037481    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf502e30f_c158_4a43_8c65_4fbe958bb3e4.slice/crio-0b24ba56184f914b7396345e10549cbc4b37f8114ae6b74e9e565d8670207da7 WatchSource:0}: Error finding container 0b24ba56184f914b7396345e10549cbc4b37f8114ae6b74e9e565d8670207da7: Status 404 returned error can't find the container with id 0b24ba56184f914b7396345e10549cbc4b37f8114ae6b74e9e565d8670207da7
Sep 14 10:33:17.084045 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:17.084012    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"]
Sep 14 10:33:17.087032 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:33:17.087001    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70af39b3_c409_42a2_8453_02e61a6a03ee.slice/crio-e52792436b903bbc105c98e319700c5fb3d3dc6848d4cc17134578d8a4501882 WatchSource:0}: Error finding container e52792436b903bbc105c98e319700c5fb3d3dc6848d4cc17134578d8a4501882: Status 404 returned error can't find the container with id e52792436b903bbc105c98e319700c5fb3d3dc6848d4cc17134578d8a4501882
Sep 14 10:33:17.526104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:17.525995    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j" event={"ID":"70af39b3-c409-42a2-8453-02e61a6a03ee","Type":"ContainerStarted","Data":"e52792436b903bbc105c98e319700c5fb3d3dc6848d4cc17134578d8a4501882"}
Sep 14 10:33:17.528345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:17.528273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz" event={"ID":"f502e30f-c158-4a43-8c65-4fbe958bb3e4","Type":"ContainerStarted","Data":"0b24ba56184f914b7396345e10549cbc4b37f8114ae6b74e9e565d8670207da7"}
Sep 14 10:33:20.554176 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:20.554073    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j" event={"ID":"70af39b3-c409-42a2-8453-02e61a6a03ee","Type":"ContainerStarted","Data":"83a1e4a1734e3b42faa3aa0cad2dade59a1d04a9cf8ff256e9cecfaee058fe7a"}
Sep 14 10:33:20.554176 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:20.554175    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:20.556106 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:20.556072    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz" event={"ID":"f502e30f-c158-4a43-8c65-4fbe958bb3e4","Type":"ContainerStarted","Data":"84760468259f620f85c45ffd57d5e2750038b16e5542726622a63ede75558ac4"}
Sep 14 10:33:20.556265 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:20.556153    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:20.573158 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:20.573106    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j" podStartSLOduration=1.392864009 podStartE2EDuration="4.573088708s" totalImagesPullingTime="3.180224699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:33:20.572099617 +0000 UTC m=+523.457168727" watchObservedRunningTime="2026-09-14 10:33:20.573088708 +0000 UTC m=+523.458157816"
Sep 14 10:33:20.590327 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:20.590269    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz" podStartSLOduration=1.369372286 podStartE2EDuration="4.590249902s" totalImagesPullingTime="3.220877616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:33:20.588760037 +0000 UTC m=+523.473829157" watchObservedRunningTime="2026-09-14 10:33:20.590249902 +0000 UTC m=+523.475319007"
Sep 14 10:33:26.588063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:26.588028    2574 generic.go:356] "Generic (PLEG): container finished" podID="a3ca7d48-2152-44d9-a235-89bad9b45782" containerID="8fda197d45723936f7f21632cdb17eca3cc55c483cfb954ce3f3712aeaf7d717" exitCode=0
Sep 14 10:33:26.588488 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:26.588074    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" event={"ID":"a3ca7d48-2152-44d9-a235-89bad9b45782","Type":"ContainerDied","Data":"8fda197d45723936f7f21632cdb17eca3cc55c483cfb954ce3f3712aeaf7d717"}
Sep 14 10:33:26.588488 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:26.588468    2574 scope.go:117] "RemoveContainer" containerID="8fda197d45723936f7f21632cdb17eca3cc55c483cfb954ce3f3712aeaf7d717"
Sep 14 10:33:26.589581 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:26.589549    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:33:26.589656 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:26.589639    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:33:26.589710 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:26.589696    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:33:27.596722 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:27.596669    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" event={"ID":"a3ca7d48-2152-44d9-a235-89bad9b45782","Type":"ContainerStarted","Data":"9b964b39078df2caa6bf6bc9825dbe05029f840017e62098c4f31847952467ac"}
Sep 14 10:33:27.758832 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:27.758799    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:33:27.759092 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:27.759067    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 14 10:33:27.759163 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:27.759143    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" podUID="a3ca7d48-2152-44d9-a235-89bad9b45782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 14 10:33:28.759847 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:28.759754    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 14 10:33:28.759847 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:28.759816    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" podUID="a3ca7d48-2152-44d9-a235-89bad9b45782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 14 10:33:29.759675 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:29.759639    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 14 10:33:29.759896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:29.759694    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" podUID="a3ca7d48-2152-44d9-a235-89bad9b45782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 14 10:33:30.759369 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:30.759328    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 14 10:33:30.759547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:30.759391    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" podUID="a3ca7d48-2152-44d9-a235-89bad9b45782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 14 10:33:31.563621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:31.563590    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-ncl9j"
Sep 14 10:33:31.564104 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:31.563907    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wkmjz"
Sep 14 10:33:31.759621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:31.759583    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 14 10:33:31.759838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:31.759651    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk" podUID="a3ca7d48-2152-44d9-a235-89bad9b45782" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 14 10:33:32.763013 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:32.762977    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:33:32.763416 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:32.763232    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:33:32.763919 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:32.763899    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkbk"
Sep 14 10:33:33.483321 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.483283    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"]
Sep 14 10:33:33.486375 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.486354    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.489132 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.489099    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 14 10:33:33.490435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.490411    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 14 10:33:33.490570 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.490411    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f5d8v\""
Sep 14 10:33:33.490570 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.490473    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 14 10:33:33.498728 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.498701    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"]
Sep 14 10:33:33.567345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.567306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.567345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.567351    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.567573 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.567405    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7pdb\" (UniqueName: \"kubernetes.io/projected/248e7256-4e3c-4db8-9946-2ac084c96c0c-kube-api-access-g7pdb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.567573 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.567505    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.567573 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.567537    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.567573 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.567553    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/248e7256-4e3c-4db8-9946-2ac084c96c0c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.668730 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.668686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.668730 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.668738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.669041 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.668793    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7pdb\" (UniqueName: \"kubernetes.io/projected/248e7256-4e3c-4db8-9946-2ac084c96c0c-kube-api-access-g7pdb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.669041 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.668864    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.669041 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.668931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.669041 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.668957    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/248e7256-4e3c-4db8-9946-2ac084c96c0c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.669306 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.669285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.669363 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.669318    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.669363 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.669353    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.671260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.671237    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/248e7256-4e3c-4db8-9946-2ac084c96c0c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.671520 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.671503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/248e7256-4e3c-4db8-9946-2ac084c96c0c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.677534 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.677507    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7pdb\" (UniqueName: \"kubernetes.io/projected/248e7256-4e3c-4db8-9946-2ac084c96c0c-kube-api-access-g7pdb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7\" (UID: \"248e7256-4e3c-4db8-9946-2ac084c96c0c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:33.799141 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:33.799039    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:34.076287 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:34.076261    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"]
Sep 14 10:33:34.079469 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:33:34.079419    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248e7256_4e3c_4db8_9946_2ac084c96c0c.slice/crio-c85fc2cda8bfc89762312b5b3ded34b324ec5e0c1cfd7a4cec8bafd632c7f5e8 WatchSource:0}: Error finding container c85fc2cda8bfc89762312b5b3ded34b324ec5e0c1cfd7a4cec8bafd632c7f5e8: Status 404 returned error can't find the container with id c85fc2cda8bfc89762312b5b3ded34b324ec5e0c1cfd7a4cec8bafd632c7f5e8
Sep 14 10:33:34.658854 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:34.658810    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7" event={"ID":"248e7256-4e3c-4db8-9946-2ac084c96c0c","Type":"ContainerStarted","Data":"c85fc2cda8bfc89762312b5b3ded34b324ec5e0c1cfd7a4cec8bafd632c7f5e8"}
Sep 14 10:33:35.665785 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:35.665750    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7" event={"ID":"248e7256-4e3c-4db8-9946-2ac084c96c0c","Type":"ContainerStarted","Data":"19ba466b9e93b59784a666935b806496bac71627dc3618f2fcad7aec2b356f38"}
Sep 14 10:33:35.688100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:35.688050    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7" podStartSLOduration=1.640274612 podStartE2EDuration="2.688032243s" totalImagesPullingTime="1.047757631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:33:35.68747361 +0000 UTC m=+538.572542728" watchObservedRunningTime="2026-09-14 10:33:35.688032243 +0000 UTC m=+538.573101350"
Sep 14 10:33:43.799744 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:43.799706    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:43.800220 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:43.799813    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:43.813059 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:43.813029    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:44.724690 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:44.724660    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7"
Sep 14 10:33:54.669807 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.669770    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"]
Sep 14 10:33:54.676765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.676741    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.679572 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.679548    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 14 10:33:54.683801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.683778    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"]
Sep 14 10:33:54.778045 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.778007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.778243 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.778072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.778243 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.778109    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx4gz\" (UniqueName: \"kubernetes.io/projected/30a117e6-d4f5-4173-b787-7e31e02d89c2-kube-api-access-wx4gz\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.778243 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.778157    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.778243 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.778230    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.778408 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.778256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30a117e6-d4f5-4173-b787-7e31e02d89c2-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.879372 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.879330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.879372 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.879372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30a117e6-d4f5-4173-b787-7e31e02d89c2-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.879643 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.879391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.879643 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.879429    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.879643 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.879459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx4gz\" (UniqueName: \"kubernetes.io/projected/30a117e6-d4f5-4173-b787-7e31e02d89c2-kube-api-access-wx4gz\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.879643 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.879510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.879936 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.879907    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.879936 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.879923    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.880047 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.879921    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.882128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.882093    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30a117e6-d4f5-4173-b787-7e31e02d89c2-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.882257 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.882226    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30a117e6-d4f5-4173-b787-7e31e02d89c2-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.890367 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.890337    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx4gz\" (UniqueName: \"kubernetes.io/projected/30a117e6-d4f5-4173-b787-7e31e02d89c2-kube-api-access-wx4gz\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn\" (UID: \"30a117e6-d4f5-4173-b787-7e31e02d89c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:54.988943 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:54.988806    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:33:55.269438 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:55.269412    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"]
Sep 14 10:33:55.271616 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:33:55.271587    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a117e6_d4f5_4173_b787_7e31e02d89c2.slice/crio-4b1c98fd16d5c5e3885fe7e699c4afd8791775a13ecee1b266111b3639b6d5bb WatchSource:0}: Error finding container 4b1c98fd16d5c5e3885fe7e699c4afd8791775a13ecee1b266111b3639b6d5bb: Status 404 returned error can't find the container with id 4b1c98fd16d5c5e3885fe7e699c4afd8791775a13ecee1b266111b3639b6d5bb
Sep 14 10:33:55.773256 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:55.773168    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn" event={"ID":"30a117e6-d4f5-4173-b787-7e31e02d89c2","Type":"ContainerStarted","Data":"72a4eed7a45757e5fa371bad2ffe6ab1a2af2cbec5e453d00b2584d2941e5425"}
Sep 14 10:33:55.773256 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:55.773217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn" event={"ID":"30a117e6-d4f5-4173-b787-7e31e02d89c2","Type":"ContainerStarted","Data":"4b1c98fd16d5c5e3885fe7e699c4afd8791775a13ecee1b266111b3639b6d5bb"}
Sep 14 10:33:55.794222 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:33:55.794167    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn" podStartSLOduration=1.6032378619999998 podStartE2EDuration="1.794147336s" totalImagesPullingTime="190.909474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:33:55.792916848 +0000 UTC m=+558.677985957" watchObservedRunningTime="2026-09-14 10:33:55.794147336 +0000 UTC m=+558.679216444"
Sep 14 10:34:04.989845 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:34:04.989798    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:34:04.990419 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:34:04.989862    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:34:05.002385 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:34:05.002353    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:34:05.841086 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:34:05.841056    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn"
Sep 14 10:34:38.081795 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:34:38.081768    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:34:38.085580 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:34:38.085548    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:36:13.389167 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.389132    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"]
Sep 14 10:36:13.392462 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.392442    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.395811 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.395789    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-85d3ec-openshift-default-dockercfg-f5r97\""
Sep 14 10:36:13.411811 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.411773    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"]
Sep 14 10:36:13.467476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.467444    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"]
Sep 14 10:36:13.470680 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.470656    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.473554 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.473533    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d36f67-openshift-default-dockercfg-ncwlk\""
Sep 14 10:36:13.494933 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.494901    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"]
Sep 14 10:36:13.504253 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.504179    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-certs\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.504507 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.504490    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-credential-socket\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.504680 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.504656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istiod-ca-cert\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.504856 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.504816    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-credential-socket\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.505816 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.505795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-certs\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.506044 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.506021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-socket\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.506246 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.506232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ca311d-639a-4f2a-adad-43c369ca829b-istiod-ca-cert\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.506398 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.506384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-data\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.506543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.506530    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-envoy\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.506679 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.506666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-socket\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.506929 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.506863    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-podinfo\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.507065 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.506945    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-envoy\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.507065 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.507021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-data\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.507195 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.507097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf6qk\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-kube-api-access-bf6qk\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.507195 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.507163    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ca311d-639a-4f2a-adad-43c369ca829b-istio-podinfo\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.507325 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.507244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdxht\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-kube-api-access-kdxht\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.507388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.507324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-istio-token\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.507445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.507387    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-token\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.609309 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.609277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-credential-socket\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.609595 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.609568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-certs\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.609778 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.609761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-socket\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.609941 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.609923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ca311d-639a-4f2a-adad-43c369ca829b-istiod-ca-cert\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.610071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.610054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-data\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.610188 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.610173    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-envoy\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.610305 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.610291    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-socket\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.610418 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.610404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-podinfo\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.610533 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.610518    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-envoy\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.610684 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.610649    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-data\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.610816 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.610801    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf6qk\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-kube-api-access-bf6qk\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.610981 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.610964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ca311d-639a-4f2a-adad-43c369ca829b-istio-podinfo\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.611159 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.611130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdxht\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-kube-api-access-kdxht\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.611252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.611184    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-istio-token\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.611252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.611220    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-token\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.611341 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.611285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-certs\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.611341 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.611325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-credential-socket\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.611408 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.611357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istiod-ca-cert\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.612202 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.612170    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istiod-ca-cert\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.612514 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.612493    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-credential-socket\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.612753 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.612734    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-certs\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.613061 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.613036    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-socket\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.613148 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.613123    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-data\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.613590 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.613568    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ca311d-639a-4f2a-adad-43c369ca829b-istiod-ca-cert\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.613852 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.613834    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-data\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.614520 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.614500    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-socket\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.617660 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.617542    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-envoy\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.619310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.618377    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-credential-socket\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.619310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.618604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-certs\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.619310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.619089    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-podinfo\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.619310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.619185    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ca311d-639a-4f2a-adad-43c369ca829b-istio-podinfo\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.623073 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.623050    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-envoy\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.627448 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.627403    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-istio-token\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.627862 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.627837    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf6qk\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-kube-api-access-bf6qk\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.628605 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.628573    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdxht\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-kube-api-access-kdxht\") pod \"e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") " pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:13.629003 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.628966    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-token\") pod \"e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") " pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.711462 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.711157    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:13.785452 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:13.785303    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:14.001650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.001628    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"]
Sep 14 10:36:14.003695 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:36:14.003662    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3d8e37_79cc_4a31_9eea_9a930ce9c067.slice/crio-09dc08c2700cde24ba70d409a49e5dd8487938209cc042f5f1f65307265036c0 WatchSource:0}: Error finding container 09dc08c2700cde24ba70d409a49e5dd8487938209cc042f5f1f65307265036c0: Status 404 returned error can't find the container with id 09dc08c2700cde24ba70d409a49e5dd8487938209cc042f5f1f65307265036c0
Sep 14 10:36:14.006263 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.006230    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:14.006371 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.006299    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:14.006371 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.006326    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:14.079595 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.079567    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"]
Sep 14 10:36:14.081637 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:36:14.081612    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ca311d_639a_4f2a_adad_43c369ca829b.slice/crio-dc97e6b57792e33df61bac6b115fe84e72d11e2e96d6caa68f938315e14a3cfe WatchSource:0}: Error finding container dc97e6b57792e33df61bac6b115fe84e72d11e2e96d6caa68f938315e14a3cfe: Status 404 returned error can't find the container with id dc97e6b57792e33df61bac6b115fe84e72d11e2e96d6caa68f938315e14a3cfe
Sep 14 10:36:14.084195 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.084153    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:14.084314 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.084251    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:14.084314 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.084290    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:14.541473 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.541439    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" event={"ID":"85ca311d-639a-4f2a-adad-43c369ca829b","Type":"ContainerStarted","Data":"794382e526e4023349b3682b8649927909edc2c0989c3ef635a6f1974fdb2e61"}
Sep 14 10:36:14.541973 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.541521    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" event={"ID":"85ca311d-639a-4f2a-adad-43c369ca829b","Type":"ContainerStarted","Data":"dc97e6b57792e33df61bac6b115fe84e72d11e2e96d6caa68f938315e14a3cfe"}
Sep 14 10:36:14.543469 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.543443    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" event={"ID":"3f3d8e37-79cc-4a31-9eea-9a930ce9c067","Type":"ContainerStarted","Data":"3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828"}
Sep 14 10:36:14.543581 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.543495    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" event={"ID":"3f3d8e37-79cc-4a31-9eea-9a930ce9c067","Type":"ContainerStarted","Data":"09dc08c2700cde24ba70d409a49e5dd8487938209cc042f5f1f65307265036c0"}
Sep 14 10:36:14.580726 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.580670    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" podStartSLOduration=1.580651507 podStartE2EDuration="1.580651507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:14.577281031 +0000 UTC m=+697.462350140" watchObservedRunningTime="2026-09-14 10:36:14.580651507 +0000 UTC m=+697.465720615"
Sep 14 10:36:14.601554 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.601492    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" podStartSLOduration=1.6014690040000001 podStartE2EDuration="1.601469004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:14.598161562 +0000 UTC m=+697.483230671" watchObservedRunningTime="2026-09-14 10:36:14.601469004 +0000 UTC m=+697.486538113"
Sep 14 10:36:14.712096 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.712058    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:14.785649 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:14.785595    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:15.717819 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:15.717785    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:15.791359 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:15.791328    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:16.556823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:16.556791    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:16.556823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:16.556855    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:16.557941 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:16.557915    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:16.558119 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:16.558102    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:19.114846 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.114804    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"]
Sep 14 10:36:19.118668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.118635    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:19.121465 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.121441    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-d36f67\""
Sep 14 10:36:19.121620 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.121571    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-d36f67-dockercfg-57n2d\""
Sep 14 10:36:19.130481 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.130451    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"]
Sep 14 10:36:19.134282 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.134251    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"]
Sep 14 10:36:19.138065 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.138038    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:19.159832 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.159806    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"]
Sep 14 10:36:19.168583 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.168546    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8123b320-7109-452a-b5ed-71aaa7af247a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m\" (UID: \"8123b320-7109-452a-b5ed-71aaa7af247a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:19.168776 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.168753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p87kc\" (UniqueName: \"kubernetes.io/projected/8123b320-7109-452a-b5ed-71aaa7af247a-kube-api-access-p87kc\") pod \"payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m\" (UID: \"8123b320-7109-452a-b5ed-71aaa7af247a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:19.269474 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.269434    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24809952-00d0-41f2-bb37-9ffee84d4419-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl\" (UID: \"24809952-00d0-41f2-bb37-9ffee84d4419\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:19.269664 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.269534    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87kc\" (UniqueName: \"kubernetes.io/projected/8123b320-7109-452a-b5ed-71aaa7af247a-kube-api-access-p87kc\") pod \"payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m\" (UID: \"8123b320-7109-452a-b5ed-71aaa7af247a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:19.269664 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.269556    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m86d6\" (UniqueName: \"kubernetes.io/projected/24809952-00d0-41f2-bb37-9ffee84d4419-kube-api-access-m86d6\") pod \"payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl\" (UID: \"24809952-00d0-41f2-bb37-9ffee84d4419\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:19.269664 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.269594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8123b320-7109-452a-b5ed-71aaa7af247a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m\" (UID: \"8123b320-7109-452a-b5ed-71aaa7af247a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:19.270430 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.270402    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8123b320-7109-452a-b5ed-71aaa7af247a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m\" (UID: \"8123b320-7109-452a-b5ed-71aaa7af247a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:19.279255 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.279217    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p87kc\" (UniqueName: \"kubernetes.io/projected/8123b320-7109-452a-b5ed-71aaa7af247a-kube-api-access-p87kc\") pod \"payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m\" (UID: \"8123b320-7109-452a-b5ed-71aaa7af247a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:19.370911 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.370794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24809952-00d0-41f2-bb37-9ffee84d4419-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl\" (UID: \"24809952-00d0-41f2-bb37-9ffee84d4419\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:19.371087 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.370961    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m86d6\" (UniqueName: \"kubernetes.io/projected/24809952-00d0-41f2-bb37-9ffee84d4419-kube-api-access-m86d6\") pod \"payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl\" (UID: \"24809952-00d0-41f2-bb37-9ffee84d4419\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:19.371733 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.371711    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24809952-00d0-41f2-bb37-9ffee84d4419-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl\" (UID: \"24809952-00d0-41f2-bb37-9ffee84d4419\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:19.391789 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.391758    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m86d6\" (UniqueName: \"kubernetes.io/projected/24809952-00d0-41f2-bb37-9ffee84d4419-kube-api-access-m86d6\") pod \"payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl\" (UID: \"24809952-00d0-41f2-bb37-9ffee84d4419\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:19.432392 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.432355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:19.459203 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.459167    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:19.726651 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.726625    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"]
Sep 14 10:36:19.728625 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:36:19.728597    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8123b320_7109_452a_b5ed_71aaa7af247a.slice/crio-574c3758a119305e79198e6fdf83456b886c006182451f6c3d7b5c074f6e7150 WatchSource:0}: Error finding container 574c3758a119305e79198e6fdf83456b886c006182451f6c3d7b5c074f6e7150: Status 404 returned error can't find the container with id 574c3758a119305e79198e6fdf83456b886c006182451f6c3d7b5c074f6e7150
Sep 14 10:36:19.761837 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:19.761809    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"]
Sep 14 10:36:19.768115 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:36:19.768091    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24809952_00d0_41f2_bb37_9ffee84d4419.slice/crio-64b386a9d785ad245601954ecfdd683e45ebc5c16ca64451c73720483dad8a58 WatchSource:0}: Error finding container 64b386a9d785ad245601954ecfdd683e45ebc5c16ca64451c73720483dad8a58: Status 404 returned error can't find the container with id 64b386a9d785ad245601954ecfdd683e45ebc5c16ca64451c73720483dad8a58
Sep 14 10:36:20.582775 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:20.582742    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m" event={"ID":"8123b320-7109-452a-b5ed-71aaa7af247a","Type":"ContainerStarted","Data":"12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841"}
Sep 14 10:36:20.583233 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:20.582805    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m" event={"ID":"8123b320-7109-452a-b5ed-71aaa7af247a","Type":"ContainerStarted","Data":"574c3758a119305e79198e6fdf83456b886c006182451f6c3d7b5c074f6e7150"}
Sep 14 10:36:20.583233 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:20.583014    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:20.584721 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:20.584692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl" event={"ID":"24809952-00d0-41f2-bb37-9ffee84d4419","Type":"ContainerStarted","Data":"f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189"}
Sep 14 10:36:20.584851 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:20.584737    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl" event={"ID":"24809952-00d0-41f2-bb37-9ffee84d4419","Type":"ContainerStarted","Data":"64b386a9d785ad245601954ecfdd683e45ebc5c16ca64451c73720483dad8a58"}
Sep 14 10:36:20.584851 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:20.584821    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:20.614731 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:20.614670    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m" podStartSLOduration=1.614649291 podStartE2EDuration="1.614649291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:20.610862645 +0000 UTC m=+703.495931778" watchObservedRunningTime="2026-09-14 10:36:20.614649291 +0000 UTC m=+703.499718403"
Sep 14 10:36:20.644728 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:20.644672    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl" podStartSLOduration=1.644654993 podStartE2EDuration="1.644654993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:20.641714709 +0000 UTC m=+703.526783817" watchObservedRunningTime="2026-09-14 10:36:20.644654993 +0000 UTC m=+703.529724133"
Sep 14 10:36:21.445004 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.444969    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"]
Sep 14 10:36:21.448635 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.448605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.453288 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.453266    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-30eaba-openshift-default-dockercfg-2v7mg\""
Sep 14 10:36:21.480543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.480511    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"]
Sep 14 10:36:21.594512 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.594479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-certs\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.594512 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.594511    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-credential-socket\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.595055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.594537    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-istio-token\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.595055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.594593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-socket\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.595055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.594624    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64cc308-fe39-45ba-9118-9ac366262509-istiod-ca-cert\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.595055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.594648    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-envoy\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.595055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.594664    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64cc308-fe39-45ba-9118-9ac366262509-istio-podinfo\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.595055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.594707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxkkj\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-kube-api-access-bxkkj\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.595055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.594726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-data\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696057 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.695955    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-istio-token\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696057 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-socket\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696057 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64cc308-fe39-45ba-9118-9ac366262509-istiod-ca-cert\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696057 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696038    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-envoy\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696419 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64cc308-fe39-45ba-9118-9ac366262509-istio-podinfo\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696419 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxkkj\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-kube-api-access-bxkkj\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696419 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696303    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-data\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696580 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696500    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-socket\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696640 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-certs\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696695 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-credential-socket\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696776    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64cc308-fe39-45ba-9118-9ac366262509-istiod-ca-cert\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.696900 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.696834    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-certs\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.697269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.697245    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-data\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.697363 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.697249    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-credential-socket\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.698946 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.698927    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-envoy\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.699336 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.699319    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64cc308-fe39-45ba-9118-9ac366262509-istio-podinfo\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.707553 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.707474    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxkkj\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-kube-api-access-bxkkj\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.708853 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.708804    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-istio-token\") pod \"e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") " pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:21.760952 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:21.760919    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:22.050916 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:22.050788    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"]
Sep 14 10:36:22.053449 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:36:22.053418    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64cc308_fe39_45ba_9118_9ac366262509.slice/crio-11539e75ff5288a7c1df5188bd64878c604204183b2b56d5d09fa20eaac648e3 WatchSource:0}: Error finding container 11539e75ff5288a7c1df5188bd64878c604204183b2b56d5d09fa20eaac648e3: Status 404 returned error can't find the container with id 11539e75ff5288a7c1df5188bd64878c604204183b2b56d5d09fa20eaac648e3
Sep 14 10:36:22.056175 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:22.056142    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:22.056276 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:22.056220    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:22.056338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:22.056279    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:22.598853 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:22.598815    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" event={"ID":"e64cc308-fe39-45ba-9118-9ac366262509","Type":"ContainerStarted","Data":"1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad"}
Sep 14 10:36:22.599269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:22.598929    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" event={"ID":"e64cc308-fe39-45ba-9118-9ac366262509","Type":"ContainerStarted","Data":"11539e75ff5288a7c1df5188bd64878c604204183b2b56d5d09fa20eaac648e3"}
Sep 14 10:36:22.628326 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:22.628267    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" podStartSLOduration=1.628251438 podStartE2EDuration="1.628251438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:22.625767713 +0000 UTC m=+705.510836820" watchObservedRunningTime="2026-09-14 10:36:22.628251438 +0000 UTC m=+705.513320546"
Sep 14 10:36:22.761301 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:22.761262    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:23.766860 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:23.766828    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:24.613227 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:24.613187    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:24.614679 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:24.614654    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:27.979264 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:27.979230    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"]
Sep 14 10:36:27.982689 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:27.982671    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:27.985289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:27.985267    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-30eaba\""
Sep 14 10:36:27.995135 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:27.995110    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"]
Sep 14 10:36:28.070857 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:28.070818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n47g9\" (UniqueName: \"kubernetes.io/projected/02efdac2-be90-45ba-bb50-38e06f2b4d27-kube-api-access-n47g9\") pod \"payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm\" (UID: \"02efdac2-be90-45ba-bb50-38e06f2b4d27\") " pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:28.071044 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:28.070989    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02efdac2-be90-45ba-bb50-38e06f2b4d27-plugins-config-volume\") pod \"payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm\" (UID: \"02efdac2-be90-45ba-bb50-38e06f2b4d27\") " pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:28.174898 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:28.173491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n47g9\" (UniqueName: \"kubernetes.io/projected/02efdac2-be90-45ba-bb50-38e06f2b4d27-kube-api-access-n47g9\") pod \"payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm\" (UID: \"02efdac2-be90-45ba-bb50-38e06f2b4d27\") " pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:28.174898 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:28.173630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02efdac2-be90-45ba-bb50-38e06f2b4d27-plugins-config-volume\") pod \"payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm\" (UID: \"02efdac2-be90-45ba-bb50-38e06f2b4d27\") " pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:28.174898 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:28.174624    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02efdac2-be90-45ba-bb50-38e06f2b4d27-plugins-config-volume\") pod \"payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm\" (UID: \"02efdac2-be90-45ba-bb50-38e06f2b4d27\") " pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:28.183421 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:28.183389    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n47g9\" (UniqueName: \"kubernetes.io/projected/02efdac2-be90-45ba-bb50-38e06f2b4d27-kube-api-access-n47g9\") pod \"payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm\" (UID: \"02efdac2-be90-45ba-bb50-38e06f2b4d27\") " pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:28.295143 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:28.295047    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:28.610453 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:28.610307    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"]
Sep 14 10:36:28.627011 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:36:28.625919    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02efdac2_be90_45ba_bb50_38e06f2b4d27.slice/crio-716cfc0e717de6f3aafa66cea1491e0c5e5a232a0aa547b5b521368b3635b820 WatchSource:0}: Error finding container 716cfc0e717de6f3aafa66cea1491e0c5e5a232a0aa547b5b521368b3635b820: Status 404 returned error can't find the container with id 716cfc0e717de6f3aafa66cea1491e0c5e5a232a0aa547b5b521368b3635b820
Sep 14 10:36:28.644140 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:28.644106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm" event={"ID":"02efdac2-be90-45ba-bb50-38e06f2b4d27","Type":"ContainerStarted","Data":"716cfc0e717de6f3aafa66cea1491e0c5e5a232a0aa547b5b521368b3635b820"}
Sep 14 10:36:29.654370 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:29.654325    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm" event={"ID":"02efdac2-be90-45ba-bb50-38e06f2b4d27","Type":"ContainerStarted","Data":"a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba"}
Sep 14 10:36:29.655408 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:29.655382    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:29.673840 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:29.673772    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm" podStartSLOduration=2.673751798 podStartE2EDuration="2.673751798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:29.67214016 +0000 UTC m=+712.557209270" watchObservedRunningTime="2026-09-14 10:36:29.673751798 +0000 UTC m=+712.558820911"
Sep 14 10:36:31.593418 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:31.593370    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:36:31.593835 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:31.593467    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:36:32.088750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.088709    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"]
Sep 14 10:36:32.091695 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.091670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.097731 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.097602    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e9cc98-openshift-default-dockercfg-sspms\""
Sep 14 10:36:32.127894 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.124977    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"]
Sep 14 10:36:32.235896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.232484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-credential-socket\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.235896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.232553    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-podinfo\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.235896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.232601    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fgrp\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-kube-api-access-7fgrp\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.235896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.232630    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istiod-ca-cert\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.235896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.232699    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-socket\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.235896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.232726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-certs\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.235896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.232750    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-token\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.235896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.232834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-envoy\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.235896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.232896    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-data\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.334444    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-podinfo\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.334520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fgrp\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-kube-api-access-7fgrp\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.334550    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istiod-ca-cert\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.334621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-socket\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.334652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-certs\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.334678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-token\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.334767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-envoy\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.334808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-data\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.334889    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-credential-socket\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.335801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.335391    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-credential-socket\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.338433 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.337595    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istiod-ca-cert\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.338433 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.338138    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-socket\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.338433 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.338373    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-data\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.339338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.339268    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-certs\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.344160 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.344135    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-envoy\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.349307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.349251    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-podinfo\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.353664 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.353607    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fgrp\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-kube-api-access-7fgrp\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.354144 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.354121    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-token\") pod \"e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") " pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.419467 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.419382    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:32.755949 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.750558    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"]
Sep 14 10:36:32.763052 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.762915    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:32.763710 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.763687    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:32.763991 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:32.763971    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:33.686861 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:33.686823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" event={"ID":"9139bc5f-b0c6-453f-bc05-27d5caffd2c1","Type":"ContainerStarted","Data":"ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13"}
Sep 14 10:36:33.687061 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:33.686899    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" event={"ID":"9139bc5f-b0c6-453f-bc05-27d5caffd2c1","Type":"ContainerStarted","Data":"c2ac64a0a71b26525dc0de340dbccc17df3ac67c11e3773022f0c09409c29ebd"}
Sep 14 10:36:33.714418 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:33.714345    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" podStartSLOduration=1.714322744 podStartE2EDuration="1.714322744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:33.710284569 +0000 UTC m=+716.595353678" watchObservedRunningTime="2026-09-14 10:36:33.714322744 +0000 UTC m=+716.599391853"
Sep 14 10:36:34.421392 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:34.421356    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:34.440606 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:34.440566    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:34.693324 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:34.693236    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:34.694412 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:34.694385    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:36:35.559770 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.559731    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"]
Sep 14 10:36:35.563191 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.563170    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:35.565808 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.565783    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3be523b2\""
Sep 14 10:36:35.565808 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.565825    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3be523b2-dockercfg-kcdxh\""
Sep 14 10:36:35.577179 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.577151    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"]
Sep 14 10:36:35.689021 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.688982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2x5x\" (UniqueName: \"kubernetes.io/projected/0f44899e-1a2b-4811-842d-52bd53ba96d4-kube-api-access-h2x5x\") pod \"payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq\" (UID: \"0f44899e-1a2b-4811-842d-52bd53ba96d4\") " pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:35.689234 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.689195    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f44899e-1a2b-4811-842d-52bd53ba96d4-plugins-config-volume\") pod \"payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq\" (UID: \"0f44899e-1a2b-4811-842d-52bd53ba96d4\") " pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:35.790456 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.790407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2x5x\" (UniqueName: \"kubernetes.io/projected/0f44899e-1a2b-4811-842d-52bd53ba96d4-kube-api-access-h2x5x\") pod \"payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq\" (UID: \"0f44899e-1a2b-4811-842d-52bd53ba96d4\") " pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:35.790661 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.790557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f44899e-1a2b-4811-842d-52bd53ba96d4-plugins-config-volume\") pod \"payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq\" (UID: \"0f44899e-1a2b-4811-842d-52bd53ba96d4\") " pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:35.791386 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.791359    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f44899e-1a2b-4811-842d-52bd53ba96d4-plugins-config-volume\") pod \"payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq\" (UID: \"0f44899e-1a2b-4811-842d-52bd53ba96d4\") " pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:35.799415 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.799388    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2x5x\" (UniqueName: \"kubernetes.io/projected/0f44899e-1a2b-4811-842d-52bd53ba96d4-kube-api-access-h2x5x\") pod \"payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq\" (UID: \"0f44899e-1a2b-4811-842d-52bd53ba96d4\") " pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:35.879078 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:35.878994    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:36.180958 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:36.180924    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"]
Sep 14 10:36:36.181711 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:36:36.181682    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f44899e_1a2b_4811_842d_52bd53ba96d4.slice/crio-ae4093ed02efc8d8251501e6bbdb52ee2f452c6f04895b81d3ba883b56efa01f WatchSource:0}: Error finding container ae4093ed02efc8d8251501e6bbdb52ee2f452c6f04895b81d3ba883b56efa01f: Status 404 returned error can't find the container with id ae4093ed02efc8d8251501e6bbdb52ee2f452c6f04895b81d3ba883b56efa01f
Sep 14 10:36:36.710289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:36.710150    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq" event={"ID":"0f44899e-1a2b-4811-842d-52bd53ba96d4","Type":"ContainerStarted","Data":"a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30"}
Sep 14 10:36:36.710289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:36.710220    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq" event={"ID":"0f44899e-1a2b-4811-842d-52bd53ba96d4","Type":"ContainerStarted","Data":"ae4093ed02efc8d8251501e6bbdb52ee2f452c6f04895b81d3ba883b56efa01f"}
Sep 14 10:36:36.710898 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:36.710720    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:36.730105 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:36.730060    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq" podStartSLOduration=1.730045483 podStartE2EDuration="1.730045483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:36:36.72851829 +0000 UTC m=+719.613587409" watchObservedRunningTime="2026-09-14 10:36:36.730045483 +0000 UTC m=+719.615114591"
Sep 14 10:36:37.718885 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:37.718834    2574 generic.go:356] "Generic (PLEG): container finished" podID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerID="3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828" exitCode=0
Sep 14 10:36:37.719433 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:37.718907    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" event={"ID":"3f3d8e37-79cc-4a31-9eea-9a930ce9c067","Type":"ContainerDied","Data":"3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828"}
Sep 14 10:36:37.719519 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:37.719447    2574 scope.go:117] "RemoveContainer" containerID="3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828"
Sep 14 10:36:37.720710 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:37.720683    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:37.720816 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:37.720764    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:37.720907 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:37.720822    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:38.730737 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:38.730626    2574 generic.go:356] "Generic (PLEG): container finished" podID="85ca311d-639a-4f2a-adad-43c369ca829b" containerID="794382e526e4023349b3682b8649927909edc2c0989c3ef635a6f1974fdb2e61" exitCode=0
Sep 14 10:36:38.731311 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:38.730763    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" event={"ID":"85ca311d-639a-4f2a-adad-43c369ca829b","Type":"ContainerDied","Data":"794382e526e4023349b3682b8649927909edc2c0989c3ef635a6f1974fdb2e61"}
Sep 14 10:36:38.731311 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:38.731233    2574 scope.go:117] "RemoveContainer" containerID="794382e526e4023349b3682b8649927909edc2c0989c3ef635a6f1974fdb2e61"
Sep 14 10:36:38.732660 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:38.732620    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:38.732753 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:38.732720    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:38.732820 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:38.732765    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:38.735218 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:38.735191    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" event={"ID":"3f3d8e37-79cc-4a31-9eea-9a930ce9c067","Type":"ContainerStarted","Data":"1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85"}
Sep 14 10:36:39.711614 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:39.711574    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:39.712424 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:39.712319    2574 patch_prober.go:28] interesting pod/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 14 10:36:39.712701 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:39.712677    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 14 10:36:39.748578 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:39.748537    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" event={"ID":"85ca311d-639a-4f2a-adad-43c369ca829b","Type":"ContainerStarted","Data":"4fe8bce0b1e8122dc1838b1e2f0a8f429120612545a1aedb4e1be4025b90d5d4"}
Sep 14 10:36:39.785669 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:39.785636    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:39.785945 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:39.785920    2574 patch_prober.go:28] interesting pod/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:36:39.786016 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:39.785976    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 14 10:36:40.712257 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:40.712211    2574 patch_prober.go:28] interesting pod/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 14 10:36:40.712472 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:40.712282    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 14 10:36:40.786181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:40.786146    2574 patch_prober.go:28] interesting pod/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:36:40.786541 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:40.786196    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 14 10:36:41.676100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:41.676064    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:36:41.712337 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:41.712301    2574 patch_prober.go:28] interesting pod/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 14 10:36:41.712659 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:41.712625    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 14 10:36:41.792732 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:41.792697    2574 patch_prober.go:28] interesting pod/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:36:41.793323 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:41.793289    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 14 10:36:42.712703 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:42.712661    2574 patch_prober.go:28] interesting pod/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 14 10:36:42.712972 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:42.712742    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 14 10:36:42.786421 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:42.786385    2574 patch_prober.go:28] interesting pod/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:36:42.786702 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:42.786676    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 14 10:36:43.712837 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:43.712801    2574 patch_prober.go:28] interesting pod/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 14 10:36:43.713475 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:43.713444    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 14 10:36:43.786756 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:43.786316    2574 patch_prober.go:28] interesting pod/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:36:43.786756 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:43.786382    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 14 10:36:44.720252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:44.720214    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:44.721624 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:44.721593    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:44.733936 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:44.732096    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:36:44.786937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:44.786489    2574 patch_prober.go:28] interesting pod/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 14 10:36:44.786937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:44.786549    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 14 10:36:45.790564 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:45.790532    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:45.791011 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:45.790993    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:45.791771 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:45.791753    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:36:48.738677 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:48.738044    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:36:50.883440 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:50.883323    2574 generic.go:356] "Generic (PLEG): container finished" podID="e64cc308-fe39-45ba-9118-9ac366262509" containerID="1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad" exitCode=0
Sep 14 10:36:50.883440 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:50.883391    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" event={"ID":"e64cc308-fe39-45ba-9118-9ac366262509","Type":"ContainerDied","Data":"1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad"}
Sep 14 10:36:50.884316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:50.883787    2574 scope.go:117] "RemoveContainer" containerID="1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad"
Sep 14 10:36:50.885046 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:50.885015    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:50.885155 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:50.885085    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:50.885155 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:50.885113    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:36:51.899316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:51.899266    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" event={"ID":"e64cc308-fe39-45ba-9118-9ac366262509","Type":"ContainerStarted","Data":"0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a"}
Sep 14 10:36:52.761503 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:52.761465    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:52.762604 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:52.762575    2574 patch_prober.go:28] interesting pod/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:36:52.762729 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:52.762649    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 14 10:36:53.762080 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:53.762033    2574 patch_prober.go:28] interesting pod/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:36:53.762590 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:53.762114    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 14 10:36:54.613926 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:54.613890    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:54.762089 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:54.762054    2574 patch_prober.go:28] interesting pod/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:36:54.762490 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:54.762109    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 14 10:36:55.762412 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:55.762245    2574 patch_prober.go:28] interesting pod/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:36:55.762412 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:55.762315    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 14 10:36:56.761681 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:56.761650    2574 patch_prober.go:28] interesting pod/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:36:56.761951 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:56.761919    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 14 10:36:57.766064 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:57.766035    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:36:57.767220 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:36:57.767198    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:37:01.533919 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.533799    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"]
Sep 14 10:37:01.535994 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.534670    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq" podUID="0f44899e-1a2b-4811-842d-52bd53ba96d4" containerName="payload-processing" containerID="cri-o://a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30" gracePeriod=30
Sep 14 10:37:01.856481 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.856452    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:37:01.975791 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.975754    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f44899e-1a2b-4811-842d-52bd53ba96d4-plugins-config-volume\") pod \"0f44899e-1a2b-4811-842d-52bd53ba96d4\" (UID: \"0f44899e-1a2b-4811-842d-52bd53ba96d4\") "
Sep 14 10:37:01.976026 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.975809    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2x5x\" (UniqueName: \"kubernetes.io/projected/0f44899e-1a2b-4811-842d-52bd53ba96d4-kube-api-access-h2x5x\") pod \"0f44899e-1a2b-4811-842d-52bd53ba96d4\" (UID: \"0f44899e-1a2b-4811-842d-52bd53ba96d4\") "
Sep 14 10:37:01.976026 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.975986    2574 generic.go:356] "Generic (PLEG): container finished" podID="0f44899e-1a2b-4811-842d-52bd53ba96d4" containerID="a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30" exitCode=0
Sep 14 10:37:01.976168 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.976105    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq" event={"ID":"0f44899e-1a2b-4811-842d-52bd53ba96d4","Type":"ContainerDied","Data":"a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30"}
Sep 14 10:37:01.976168 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.976159    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq" event={"ID":"0f44899e-1a2b-4811-842d-52bd53ba96d4","Type":"ContainerDied","Data":"ae4093ed02efc8d8251501e6bbdb52ee2f452c6f04895b81d3ba883b56efa01f"}
Sep 14 10:37:01.976275 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.976193    2574 scope.go:117] "RemoveContainer" containerID="a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30"
Sep 14 10:37:01.976275 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.976227    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f44899e-1a2b-4811-842d-52bd53ba96d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0f44899e-1a2b-4811-842d-52bd53ba96d4" (UID: "0f44899e-1a2b-4811-842d-52bd53ba96d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:37:01.976384 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.976326    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"
Sep 14 10:37:01.978638 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.978610    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f44899e-1a2b-4811-842d-52bd53ba96d4-kube-api-access-h2x5x" (OuterVolumeSpecName: "kube-api-access-h2x5x") pod "0f44899e-1a2b-4811-842d-52bd53ba96d4" (UID: "0f44899e-1a2b-4811-842d-52bd53ba96d4"). InnerVolumeSpecName "kube-api-access-h2x5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:37:01.997748 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.997035    2574 scope.go:117] "RemoveContainer" containerID="a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30"
Sep 14 10:37:01.997824 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:37:01.997746    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30\": container with ID starting with a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30 not found: ID does not exist" containerID="a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30"
Sep 14 10:37:01.997824 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:01.997787    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30"} err="failed to get container status \"a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30\": rpc error: code = NotFound desc = could not find container \"a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30\": container with ID starting with a68363bcabda02dbc195be9355982b9b1b8b27bbe5eb46e46b65f95e68c8bf30 not found: ID does not exist"
Sep 14 10:37:02.077655 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:02.077538    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f44899e-1a2b-4811-842d-52bd53ba96d4-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:37:02.077655 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:02.077576    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2x5x\" (UniqueName: \"kubernetes.io/projected/0f44899e-1a2b-4811-842d-52bd53ba96d4-kube-api-access-h2x5x\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:37:02.309606 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:02.309538    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"]
Sep 14 10:37:02.313170 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:02.313138    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3be523b2-547cbc54d7-jjvhq"]
Sep 14 10:37:03.610370 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:03.610324    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f44899e-1a2b-4811-842d-52bd53ba96d4" path="/var/lib/kubelet/pods/0f44899e-1a2b-4811-842d-52bd53ba96d4/volumes"
Sep 14 10:37:04.694674 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:04.694638    2574 patch_prober.go:28] interesting pod/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 14 10:37:04.695169 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:04.694697    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 14 10:37:04.997344 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:04.997242    2574 generic.go:356] "Generic (PLEG): container finished" podID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerID="ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13" exitCode=0
Sep 14 10:37:04.997344 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:04.997316    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" event={"ID":"9139bc5f-b0c6-453f-bc05-27d5caffd2c1","Type":"ContainerDied","Data":"ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13"}
Sep 14 10:37:04.997912 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:04.997859    2574 scope.go:117] "RemoveContainer" containerID="ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13"
Sep 14 10:37:04.999148 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:04.999117    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:37:04.999224 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:04.999188    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:37:04.999261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:04.999223    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 14 10:37:06.006557 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:06.006509    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" event={"ID":"9139bc5f-b0c6-453f-bc05-27d5caffd2c1","Type":"ContainerStarted","Data":"f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501"}
Sep 14 10:37:06.420335 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:06.420293    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:37:06.420557 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:06.420420    2574 patch_prober.go:28] interesting pod/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 14 10:37:06.420557 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:06.420465    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 14 10:37:07.420472 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:07.420429    2574 patch_prober.go:28] interesting pod/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 14 10:37:07.421028 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:07.420523    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 14 10:37:08.420515 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:08.420467    2574 patch_prober.go:28] interesting pod/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 14 10:37:08.421090 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:08.420540    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 14 10:37:09.420937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:09.420858    2574 patch_prober.go:28] interesting pod/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 14 10:37:09.421566 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:09.421529    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 14 10:37:10.420686 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:10.420647    2574 patch_prober.go:28] interesting pod/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 14 10:37:10.421022 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:10.420988    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 14 10:37:11.424805 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:11.424774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:37:11.425304 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:11.425091    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:37:11.425820 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:11.425804    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:37:30.657024 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.656992    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"]
Sep 14 10:37:30.657704 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.657684    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f44899e-1a2b-4811-842d-52bd53ba96d4" containerName="payload-processing"
Sep 14 10:37:30.657803 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.657709    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f44899e-1a2b-4811-842d-52bd53ba96d4" containerName="payload-processing"
Sep 14 10:37:30.657904 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.657858    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f44899e-1a2b-4811-842d-52bd53ba96d4" containerName="payload-processing"
Sep 14 10:37:30.660133 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.660111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"
Sep 14 10:37:30.663238 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.663212    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:37:30.669975 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.669953    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"]
Sep 14 10:37:30.780436 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.780393    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1625bde-2a25-4fd8-afdf-b63c624ce073-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc\" (UID: \"f1625bde-2a25-4fd8-afdf-b63c624ce073\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"
Sep 14 10:37:30.882063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.882010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1625bde-2a25-4fd8-afdf-b63c624ce073-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc\" (UID: \"f1625bde-2a25-4fd8-afdf-b63c624ce073\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"
Sep 14 10:37:30.882657 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.882637    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1625bde-2a25-4fd8-afdf-b63c624ce073-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc\" (UID: \"f1625bde-2a25-4fd8-afdf-b63c624ce073\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"
Sep 14 10:37:30.973074 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:30.972990    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"
Sep 14 10:37:31.252650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:31.252608    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"]
Sep 14 10:37:31.254574 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:37:31.254546    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1625bde_2a25_4fd8_afdf_b63c624ce073.slice/crio-ea036556af2029eedffc29169f3bd8c86a95c253dd1cf6bad489d021b99ac734 WatchSource:0}: Error finding container ea036556af2029eedffc29169f3bd8c86a95c253dd1cf6bad489d021b99ac734: Status 404 returned error can't find the container with id ea036556af2029eedffc29169f3bd8c86a95c253dd1cf6bad489d021b99ac734
Sep 14 10:37:31.256967 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:31.256951    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:37:32.171768 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:32.171734    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc" event={"ID":"f1625bde-2a25-4fd8-afdf-b63c624ce073","Type":"ContainerStarted","Data":"ea036556af2029eedffc29169f3bd8c86a95c253dd1cf6bad489d021b99ac734"}
Sep 14 10:37:46.258140 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:46.258104    2574 generic.go:356] "Generic (PLEG): container finished" podID="f1625bde-2a25-4fd8-afdf-b63c624ce073" containerID="e97923fc224ab61d4f8f86777438968fde6a7f09b75e134171174776ad252f3e" exitCode=0
Sep 14 10:37:46.258510 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:46.258185    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc" event={"ID":"f1625bde-2a25-4fd8-afdf-b63c624ce073","Type":"ContainerDied","Data":"e97923fc224ab61d4f8f86777438968fde6a7f09b75e134171174776ad252f3e"}
Sep 14 10:37:47.416831 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:47.416806    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"
Sep 14 10:37:47.561944 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:47.561841    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1625bde-2a25-4fd8-afdf-b63c624ce073-maas-api-service-ca\") pod \"f1625bde-2a25-4fd8-afdf-b63c624ce073\" (UID: \"f1625bde-2a25-4fd8-afdf-b63c624ce073\") "
Sep 14 10:37:47.562214 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:47.562187    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1625bde-2a25-4fd8-afdf-b63c624ce073-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1625bde-2a25-4fd8-afdf-b63c624ce073" (UID: "f1625bde-2a25-4fd8-afdf-b63c624ce073"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:37:47.663758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:47.663725    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1625bde-2a25-4fd8-afdf-b63c624ce073-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:37:48.270425 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:48.270388    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc" event={"ID":"f1625bde-2a25-4fd8-afdf-b63c624ce073","Type":"ContainerDied","Data":"ea036556af2029eedffc29169f3bd8c86a95c253dd1cf6bad489d021b99ac734"}
Sep 14 10:37:48.270732 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:48.270443    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea036556af2029eedffc29169f3bd8c86a95c253dd1cf6bad489d021b99ac734"
Sep 14 10:37:48.270732 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:48.270404    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"
Sep 14 10:37:57.619404 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:57.619361    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"]
Sep 14 10:37:57.621616 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:57.621595    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77bab00f-t52bc"]
Sep 14 10:37:59.613253 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:37:59.613160    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1625bde-2a25-4fd8-afdf-b63c624ce073" path="/var/lib/kubelet/pods/f1625bde-2a25-4fd8-afdf-b63c624ce073/volumes"
Sep 14 10:38:26.772564 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.772531    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"]
Sep 14 10:38:26.773100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.773075    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1625bde-2a25-4fd8-afdf-b63c624ce073" containerName="revoke-keys"
Sep 14 10:38:26.773100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.773089    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1625bde-2a25-4fd8-afdf-b63c624ce073" containerName="revoke-keys"
Sep 14 10:38:26.773194 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.773183    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1625bde-2a25-4fd8-afdf-b63c624ce073" containerName="revoke-keys"
Sep 14 10:38:26.776823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.776799    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"
Sep 14 10:38:26.779404 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.779359    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:38:26.784317 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.784279    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"]
Sep 14 10:38:26.869480 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.869444    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae00dad2-8d5b-4118-933d-91dc71540ab3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c\" (UID: \"ae00dad2-8d5b-4118-933d-91dc71540ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"
Sep 14 10:38:26.970770 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.970738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae00dad2-8d5b-4118-933d-91dc71540ab3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c\" (UID: \"ae00dad2-8d5b-4118-933d-91dc71540ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"
Sep 14 10:38:26.971425 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:26.971403    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae00dad2-8d5b-4118-933d-91dc71540ab3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c\" (UID: \"ae00dad2-8d5b-4118-933d-91dc71540ab3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"
Sep 14 10:38:27.091760 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:27.091662    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"
Sep 14 10:38:27.368890 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:27.368842    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"]
Sep 14 10:38:27.370229 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:38:27.370198    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae00dad2_8d5b_4118_933d_91dc71540ab3.slice/crio-50e3cb48c50c2448a7e028efd6538f59cd34c81f6d5c4af76c710aa0ff2f0db2 WatchSource:0}: Error finding container 50e3cb48c50c2448a7e028efd6538f59cd34c81f6d5c4af76c710aa0ff2f0db2: Status 404 returned error can't find the container with id 50e3cb48c50c2448a7e028efd6538f59cd34c81f6d5c4af76c710aa0ff2f0db2
Sep 14 10:38:27.506728 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:27.506693    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c" event={"ID":"ae00dad2-8d5b-4118-933d-91dc71540ab3","Type":"ContainerStarted","Data":"50e3cb48c50c2448a7e028efd6538f59cd34c81f6d5c4af76c710aa0ff2f0db2"}
Sep 14 10:38:28.514776 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:28.514732    2574 generic.go:356] "Generic (PLEG): container finished" podID="ae00dad2-8d5b-4118-933d-91dc71540ab3" containerID="d13e0063a6aee6a7aa2165e79ebaaeaf056d64575b3a7319472549c544c912e5" exitCode=0
Sep 14 10:38:28.515257 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:28.514826    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c" event={"ID":"ae00dad2-8d5b-4118-933d-91dc71540ab3","Type":"ContainerDied","Data":"d13e0063a6aee6a7aa2165e79ebaaeaf056d64575b3a7319472549c544c912e5"}
Sep 14 10:38:29.687823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:29.687798    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"
Sep 14 10:38:29.697056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:29.697016    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae00dad2-8d5b-4118-933d-91dc71540ab3-maas-api-service-ca\") pod \"ae00dad2-8d5b-4118-933d-91dc71540ab3\" (UID: \"ae00dad2-8d5b-4118-933d-91dc71540ab3\") "
Sep 14 10:38:29.697414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:29.697386    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae00dad2-8d5b-4118-933d-91dc71540ab3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ae00dad2-8d5b-4118-933d-91dc71540ab3" (UID: "ae00dad2-8d5b-4118-933d-91dc71540ab3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:38:29.798695 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:29.798613    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae00dad2-8d5b-4118-933d-91dc71540ab3-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:38:30.529009 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:30.528981    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"
Sep 14 10:38:30.529261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:30.529015    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c" event={"ID":"ae00dad2-8d5b-4118-933d-91dc71540ab3","Type":"ContainerDied","Data":"50e3cb48c50c2448a7e028efd6538f59cd34c81f6d5c4af76c710aa0ff2f0db2"}
Sep 14 10:38:30.529261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:30.529069    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50e3cb48c50c2448a7e028efd6538f59cd34c81f6d5c4af76c710aa0ff2f0db2"
Sep 14 10:38:32.841134 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:32.841094    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"]
Sep 14 10:38:32.844903 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:32.844857    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18c04da2-x7d7c"]
Sep 14 10:38:33.610593 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:33.610560    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae00dad2-8d5b-4118-933d-91dc71540ab3" path="/var/lib/kubelet/pods/ae00dad2-8d5b-4118-933d-91dc71540ab3/volumes"
Sep 14 10:38:58.607259 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.607219    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"]
Sep 14 10:38:58.607791 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.607701    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae00dad2-8d5b-4118-933d-91dc71540ab3" containerName="revoke-keys"
Sep 14 10:38:58.607791 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.607714    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae00dad2-8d5b-4118-933d-91dc71540ab3" containerName="revoke-keys"
Sep 14 10:38:58.607944 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.607796    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae00dad2-8d5b-4118-933d-91dc71540ab3" containerName="revoke-keys"
Sep 14 10:38:58.611984 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.611948    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"
Sep 14 10:38:58.614589 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.614559    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:38:58.620021 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.619987    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"]
Sep 14 10:38:58.714255 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.714212    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168a77c2-dbfc-48fb-97e4-c0ef8c88efe3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-30eaba-wpk4d\" (UID: \"168a77c2-dbfc-48fb-97e4-c0ef8c88efe3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"
Sep 14 10:38:58.815507 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.815467    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168a77c2-dbfc-48fb-97e4-c0ef8c88efe3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-30eaba-wpk4d\" (UID: \"168a77c2-dbfc-48fb-97e4-c0ef8c88efe3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"
Sep 14 10:38:58.816183 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.816164    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168a77c2-dbfc-48fb-97e4-c0ef8c88efe3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-30eaba-wpk4d\" (UID: \"168a77c2-dbfc-48fb-97e4-c0ef8c88efe3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"
Sep 14 10:38:58.927459 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:58.927420    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"
Sep 14 10:38:59.226670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:59.226635    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"]
Sep 14 10:38:59.228368 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:38:59.228327    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168a77c2_dbfc_48fb_97e4_c0ef8c88efe3.slice/crio-97058274a6b05f728625113530f0b74f7c29ca3c237dd0bff8465593738b2ba1 WatchSource:0}: Error finding container 97058274a6b05f728625113530f0b74f7c29ca3c237dd0bff8465593738b2ba1: Status 404 returned error can't find the container with id 97058274a6b05f728625113530f0b74f7c29ca3c237dd0bff8465593738b2ba1
Sep 14 10:38:59.703648 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:59.703612    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d" event={"ID":"168a77c2-dbfc-48fb-97e4-c0ef8c88efe3","Type":"ContainerStarted","Data":"04b018af5595a68ee7c9960810adf8ab8237c8e1865df2ce2eedee4825bf4f27"}
Sep 14 10:38:59.704151 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:59.703676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d" event={"ID":"168a77c2-dbfc-48fb-97e4-c0ef8c88efe3","Type":"ContainerStarted","Data":"97058274a6b05f728625113530f0b74f7c29ca3c237dd0bff8465593738b2ba1"}
Sep 14 10:38:59.721769 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:38:59.721708    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d" podStartSLOduration=1.721691382 podStartE2EDuration="1.721691382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:38:59.719803511 +0000 UTC m=+862.604872620" watchObservedRunningTime="2026-09-14 10:38:59.721691382 +0000 UTC m=+862.606760489"
Sep 14 10:39:00.712441 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:00.712405    2574 generic.go:356] "Generic (PLEG): container finished" podID="168a77c2-dbfc-48fb-97e4-c0ef8c88efe3" containerID="04b018af5595a68ee7c9960810adf8ab8237c8e1865df2ce2eedee4825bf4f27" exitCode=0
Sep 14 10:39:00.712858 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:00.712488    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d" event={"ID":"168a77c2-dbfc-48fb-97e4-c0ef8c88efe3","Type":"ContainerDied","Data":"04b018af5595a68ee7c9960810adf8ab8237c8e1865df2ce2eedee4825bf4f27"}
Sep 14 10:39:01.880197 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:01.880164    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"
Sep 14 10:39:02.003480 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.003356    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"]
Sep 14 10:39:02.004215 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.004184    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168a77c2-dbfc-48fb-97e4-c0ef8c88efe3" containerName="revoke-keys"
Sep 14 10:39:02.004215 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.004217    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="168a77c2-dbfc-48fb-97e4-c0ef8c88efe3" containerName="revoke-keys"
Sep 14 10:39:02.004510 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.004382    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="168a77c2-dbfc-48fb-97e4-c0ef8c88efe3" containerName="revoke-keys"
Sep 14 10:39:02.009190 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.009153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"
Sep 14 10:39:02.016505 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.016477    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"]
Sep 14 10:39:02.044381 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.044350    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168a77c2-dbfc-48fb-97e4-c0ef8c88efe3-maas-api-service-ca\") pod \"168a77c2-dbfc-48fb-97e4-c0ef8c88efe3\" (UID: \"168a77c2-dbfc-48fb-97e4-c0ef8c88efe3\") "
Sep 14 10:39:02.044672 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.044652    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a743685d-536e-44eb-8c7f-452188446f80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv\" (UID: \"a743685d-536e-44eb-8c7f-452188446f80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"
Sep 14 10:39:02.044795 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.044765    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/168a77c2-dbfc-48fb-97e4-c0ef8c88efe3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "168a77c2-dbfc-48fb-97e4-c0ef8c88efe3" (UID: "168a77c2-dbfc-48fb-97e4-c0ef8c88efe3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:39:02.146069 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.146029    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a743685d-536e-44eb-8c7f-452188446f80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv\" (UID: \"a743685d-536e-44eb-8c7f-452188446f80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"
Sep 14 10:39:02.146272 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.146225    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168a77c2-dbfc-48fb-97e4-c0ef8c88efe3-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:02.146631 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.146610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a743685d-536e-44eb-8c7f-452188446f80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv\" (UID: \"a743685d-536e-44eb-8c7f-452188446f80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"
Sep 14 10:39:02.327277 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.327181    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"
Sep 14 10:39:02.612509 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.612483    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"]
Sep 14 10:39:02.614452 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:39:02.614418    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda743685d_536e_44eb_8c7f_452188446f80.slice/crio-30fae31f4017ed69ae3ff4290807e88a5352d35c75f09d6558c93cf735be8732 WatchSource:0}: Error finding container 30fae31f4017ed69ae3ff4290807e88a5352d35c75f09d6558c93cf735be8732: Status 404 returned error can't find the container with id 30fae31f4017ed69ae3ff4290807e88a5352d35c75f09d6558c93cf735be8732
Sep 14 10:39:02.726408 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.726377    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"
Sep 14 10:39:02.726408 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.726379    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d" event={"ID":"168a77c2-dbfc-48fb-97e4-c0ef8c88efe3","Type":"ContainerDied","Data":"97058274a6b05f728625113530f0b74f7c29ca3c237dd0bff8465593738b2ba1"}
Sep 14 10:39:02.726669 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.726441    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97058274a6b05f728625113530f0b74f7c29ca3c237dd0bff8465593738b2ba1"
Sep 14 10:39:02.727892 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:02.727852    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv" event={"ID":"a743685d-536e-44eb-8c7f-452188446f80","Type":"ContainerStarted","Data":"30fae31f4017ed69ae3ff4290807e88a5352d35c75f09d6558c93cf735be8732"}
Sep 14 10:39:03.743326 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:03.743222    2574 generic.go:356] "Generic (PLEG): container finished" podID="a743685d-536e-44eb-8c7f-452188446f80" containerID="3575b0df1cc4f587bd143947cb68615baeb9f9cb8bcb325321e6cac2b79de0ab" exitCode=0
Sep 14 10:39:03.743918 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:03.743365    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv" event={"ID":"a743685d-536e-44eb-8c7f-452188446f80","Type":"ContainerDied","Data":"3575b0df1cc4f587bd143947cb68615baeb9f9cb8bcb325321e6cac2b79de0ab"}
Sep 14 10:39:04.903244 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:04.903205    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"
Sep 14 10:39:04.976289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:04.976251    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a743685d-536e-44eb-8c7f-452188446f80-maas-api-service-ca\") pod \"a743685d-536e-44eb-8c7f-452188446f80\" (UID: \"a743685d-536e-44eb-8c7f-452188446f80\") "
Sep 14 10:39:04.976711 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:04.976686    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a743685d-536e-44eb-8c7f-452188446f80-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a743685d-536e-44eb-8c7f-452188446f80" (UID: "a743685d-536e-44eb-8c7f-452188446f80"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:39:05.078212 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:05.078130    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a743685d-536e-44eb-8c7f-452188446f80-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:05.756557 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:05.756523    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv" event={"ID":"a743685d-536e-44eb-8c7f-452188446f80","Type":"ContainerDied","Data":"30fae31f4017ed69ae3ff4290807e88a5352d35c75f09d6558c93cf735be8732"}
Sep 14 10:39:05.756557 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:05.756554    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"
Sep 14 10:39:05.756825 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:05.756572    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30fae31f4017ed69ae3ff4290807e88a5352d35c75f09d6558c93cf735be8732"
Sep 14 10:39:09.394612 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.394572    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"]
Sep 14 10:39:09.395101 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.394843    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm" podUID="02efdac2-be90-45ba-bb50-38e06f2b4d27" containerName="payload-processing" containerID="cri-o://a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba" gracePeriod=30
Sep 14 10:39:09.633796 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.633293    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"]
Sep 14 10:39:09.640468 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.640429    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30eaba-wpk4d"]
Sep 14 10:39:09.721135 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.721106    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:39:09.789559 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.789521    2574 generic.go:356] "Generic (PLEG): container finished" podID="02efdac2-be90-45ba-bb50-38e06f2b4d27" containerID="a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba" exitCode=0
Sep 14 10:39:09.790001 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.789967    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm" event={"ID":"02efdac2-be90-45ba-bb50-38e06f2b4d27","Type":"ContainerDied","Data":"a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba"}
Sep 14 10:39:09.790159 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.790033    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm" event={"ID":"02efdac2-be90-45ba-bb50-38e06f2b4d27","Type":"ContainerDied","Data":"716cfc0e717de6f3aafa66cea1491e0c5e5a232a0aa547b5b521368b3635b820"}
Sep 14 10:39:09.790159 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.790067    2574 scope.go:117] "RemoveContainer" containerID="a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba"
Sep 14 10:39:09.790279 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.790244    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"
Sep 14 10:39:09.818099 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.817954    2574 scope.go:117] "RemoveContainer" containerID="a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba"
Sep 14 10:39:09.818476 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:39:09.818452    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba\": container with ID starting with a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba not found: ID does not exist" containerID="a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba"
Sep 14 10:39:09.818575 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.818494    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba"} err="failed to get container status \"a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba\": rpc error: code = NotFound desc = could not find container \"a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba\": container with ID starting with a583a0aaed2643f893a314d53da31805b1d21176659a1c0794adc422164f68ba not found: ID does not exist"
Sep 14 10:39:09.833719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.833691    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n47g9\" (UniqueName: \"kubernetes.io/projected/02efdac2-be90-45ba-bb50-38e06f2b4d27-kube-api-access-n47g9\") pod \"02efdac2-be90-45ba-bb50-38e06f2b4d27\" (UID: \"02efdac2-be90-45ba-bb50-38e06f2b4d27\") "
Sep 14 10:39:09.833922 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.833804    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02efdac2-be90-45ba-bb50-38e06f2b4d27-plugins-config-volume\") pod \"02efdac2-be90-45ba-bb50-38e06f2b4d27\" (UID: \"02efdac2-be90-45ba-bb50-38e06f2b4d27\") "
Sep 14 10:39:09.834177 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.834148    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02efdac2-be90-45ba-bb50-38e06f2b4d27-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "02efdac2-be90-45ba-bb50-38e06f2b4d27" (UID: "02efdac2-be90-45ba-bb50-38e06f2b4d27"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:39:09.836262 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.836202    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02efdac2-be90-45ba-bb50-38e06f2b4d27-kube-api-access-n47g9" (OuterVolumeSpecName: "kube-api-access-n47g9") pod "02efdac2-be90-45ba-bb50-38e06f2b4d27" (UID: "02efdac2-be90-45ba-bb50-38e06f2b4d27"). InnerVolumeSpecName "kube-api-access-n47g9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:39:09.851065 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.851035    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"]
Sep 14 10:39:09.861347 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.861316    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c62bec51-wjwmv"]
Sep 14 10:39:09.935760 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.935721    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02efdac2-be90-45ba-bb50-38e06f2b4d27-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:09.935760 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:09.935754    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n47g9\" (UniqueName: \"kubernetes.io/projected/02efdac2-be90-45ba-bb50-38e06f2b4d27-kube-api-access-n47g9\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:10.114061 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:10.114025    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"]
Sep 14 10:39:10.118531 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:10.118499    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-30eaba-5f56c9b6d5-97rkm"]
Sep 14 10:39:11.610456 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:11.610418    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02efdac2-be90-45ba-bb50-38e06f2b4d27" path="/var/lib/kubelet/pods/02efdac2-be90-45ba-bb50-38e06f2b4d27/volumes"
Sep 14 10:39:11.610977 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:11.610808    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="168a77c2-dbfc-48fb-97e4-c0ef8c88efe3" path="/var/lib/kubelet/pods/168a77c2-dbfc-48fb-97e4-c0ef8c88efe3/volumes"
Sep 14 10:39:11.611175 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:11.611154    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a743685d-536e-44eb-8c7f-452188446f80" path="/var/lib/kubelet/pods/a743685d-536e-44eb-8c7f-452188446f80/volumes"
Sep 14 10:39:38.133423 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:38.133341    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:39:38.138839 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:38.138815    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:39:52.608680 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:52.608640    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"]
Sep 14 10:39:52.609330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:52.608942    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy" containerID="cri-o://0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a" gracePeriod=30
Sep 14 10:39:57.768300 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:57.768263    2574 patch_prober.go:28] interesting pod/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 14 10:39:57.768797 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:57.768320    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 14 10:39:57.889856 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:57.889780    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:39:58.056764 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.056726    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64cc308-fe39-45ba-9118-9ac366262509-istio-podinfo\") pod \"e64cc308-fe39-45ba-9118-9ac366262509\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") "
Sep 14 10:39:58.057001 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.056780    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-envoy\") pod \"e64cc308-fe39-45ba-9118-9ac366262509\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") "
Sep 14 10:39:58.057001 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.056824    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-certs\") pod \"e64cc308-fe39-45ba-9118-9ac366262509\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") "
Sep 14 10:39:58.057001 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.056841    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-socket\") pod \"e64cc308-fe39-45ba-9118-9ac366262509\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") "
Sep 14 10:39:58.057001 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.056911    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-credential-socket\") pod \"e64cc308-fe39-45ba-9118-9ac366262509\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") "
Sep 14 10:39:58.057217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057018    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64cc308-fe39-45ba-9118-9ac366262509-istiod-ca-cert\") pod \"e64cc308-fe39-45ba-9118-9ac366262509\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") "
Sep 14 10:39:58.057217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057055    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-data\") pod \"e64cc308-fe39-45ba-9118-9ac366262509\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") "
Sep 14 10:39:58.057217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057099    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-istio-token\") pod \"e64cc308-fe39-45ba-9118-9ac366262509\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") "
Sep 14 10:39:58.057217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057125    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxkkj\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-kube-api-access-bxkkj\") pod \"e64cc308-fe39-45ba-9118-9ac366262509\" (UID: \"e64cc308-fe39-45ba-9118-9ac366262509\") "
Sep 14 10:39:58.057430 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057210    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e64cc308-fe39-45ba-9118-9ac366262509" (UID: "e64cc308-fe39-45ba-9118-9ac366262509"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:39:58.057430 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057262    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e64cc308-fe39-45ba-9118-9ac366262509" (UID: "e64cc308-fe39-45ba-9118-9ac366262509"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:39:58.057430 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057247    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e64cc308-fe39-45ba-9118-9ac366262509" (UID: "e64cc308-fe39-45ba-9118-9ac366262509"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:39:58.057430 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057407    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-data" (OuterVolumeSpecName: "istio-data") pod "e64cc308-fe39-45ba-9118-9ac366262509" (UID: "e64cc308-fe39-45ba-9118-9ac366262509"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:39:58.057621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057517    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64cc308-fe39-45ba-9118-9ac366262509-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e64cc308-fe39-45ba-9118-9ac366262509" (UID: "e64cc308-fe39-45ba-9118-9ac366262509"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:39:58.057621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057597    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-data\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:58.057621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057612    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:58.057739 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057625    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-workload-socket\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:58.057739 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057638    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-credential-socket\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:58.057739 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.057646    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64cc308-fe39-45ba-9118-9ac366262509-istiod-ca-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:58.059218 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.059184    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e64cc308-fe39-45ba-9118-9ac366262509-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e64cc308-fe39-45ba-9118-9ac366262509" (UID: "e64cc308-fe39-45ba-9118-9ac366262509"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:39:58.059535 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.059513    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e64cc308-fe39-45ba-9118-9ac366262509" (UID: "e64cc308-fe39-45ba-9118-9ac366262509"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:39:58.059824 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.059800    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-istio-token" (OuterVolumeSpecName: "istio-token") pod "e64cc308-fe39-45ba-9118-9ac366262509" (UID: "e64cc308-fe39-45ba-9118-9ac366262509"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:39:58.059824 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.059819    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-kube-api-access-bxkkj" (OuterVolumeSpecName: "kube-api-access-bxkkj") pod "e64cc308-fe39-45ba-9118-9ac366262509" (UID: "e64cc308-fe39-45ba-9118-9ac366262509"). InnerVolumeSpecName "kube-api-access-bxkkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:39:58.094648 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.094615    2574 generic.go:356] "Generic (PLEG): container finished" podID="e64cc308-fe39-45ba-9118-9ac366262509" containerID="0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a" exitCode=0
Sep 14 10:39:58.094823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.094665    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"
Sep 14 10:39:58.094823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.094677    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" event={"ID":"e64cc308-fe39-45ba-9118-9ac366262509","Type":"ContainerDied","Data":"0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a"}
Sep 14 10:39:58.094823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.094722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc" event={"ID":"e64cc308-fe39-45ba-9118-9ac366262509","Type":"ContainerDied","Data":"11539e75ff5288a7c1df5188bd64878c604204183b2b56d5d09fa20eaac648e3"}
Sep 14 10:39:58.094823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.094744    2574 scope.go:117] "RemoveContainer" containerID="0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a"
Sep 14 10:39:58.109474 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.109453    2574 scope.go:117] "RemoveContainer" containerID="1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad"
Sep 14 10:39:58.123920 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.123799    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"]
Sep 14 10:39:58.124330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.124154    2574 scope.go:117] "RemoveContainer" containerID="0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a"
Sep 14 10:39:58.127835 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.127803    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-30eaba-openshift-default-7679f8495d-bfmlc"]
Sep 14 10:39:58.128039 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:39:58.127980    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a\": container with ID starting with 0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a not found: ID does not exist" containerID="0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a"
Sep 14 10:39:58.128039 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.128022    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a"} err="failed to get container status \"0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a\": rpc error: code = NotFound desc = could not find container \"0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a\": container with ID starting with 0e84276960358a162162da3aeac7d9519229114ab193ef995d26f351acfe8f2a not found: ID does not exist"
Sep 14 10:39:58.128507 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.128050    2574 scope.go:117] "RemoveContainer" containerID="1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad"
Sep 14 10:39:58.128612 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:39:58.128513    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad\": container with ID starting with 1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad not found: ID does not exist" containerID="1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad"
Sep 14 10:39:58.128688 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.128606    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad"} err="failed to get container status \"1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad\": rpc error: code = NotFound desc = could not find container \"1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad\": container with ID starting with 1dc88a37cbc72cef83a5e019327fc2fe3e78dbc7877085df74a2a42f4c4f68ad not found: ID does not exist"
Sep 14 10:39:58.158574 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.158542    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-istio-token\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:58.158574 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.158575    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxkkj\" (UniqueName: \"kubernetes.io/projected/e64cc308-fe39-45ba-9118-9ac366262509-kube-api-access-bxkkj\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:58.158796 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.158589    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64cc308-fe39-45ba-9118-9ac366262509-istio-podinfo\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:58.158796 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:58.158601    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64cc308-fe39-45ba-9118-9ac366262509-istio-envoy\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:39:59.612755 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:39:59.612720    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e64cc308-fe39-45ba-9118-9ac366262509" path="/var/lib/kubelet/pods/e64cc308-fe39-45ba-9118-9ac366262509/volumes"
Sep 14 10:40:57.737780 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.737735    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"]
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738246    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02efdac2-be90-45ba-bb50-38e06f2b4d27" containerName="payload-processing"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738260    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="02efdac2-be90-45ba-bb50-38e06f2b4d27" containerName="payload-processing"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738271    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738276    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738289    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a743685d-536e-44eb-8c7f-452188446f80" containerName="revoke-keys"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738295    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a743685d-536e-44eb-8c7f-452188446f80" containerName="revoke-keys"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738304    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738308    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738379    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a743685d-536e-44eb-8c7f-452188446f80" containerName="revoke-keys"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738385    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738392    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="02efdac2-be90-45ba-bb50-38e06f2b4d27" containerName="payload-processing"
Sep 14 10:40:57.738486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.738400    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64cc308-fe39-45ba-9118-9ac366262509" containerName="istio-proxy"
Sep 14 10:40:57.743047 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.743024    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:40:57.745693 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.745675    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-34925ca5-dockercfg-szbrp\""
Sep 14 10:40:57.745791 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.745726    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-34925ca5\""
Sep 14 10:40:57.750655 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.750629    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"]
Sep 14 10:40:57.865823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.865782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhsnp\" (UniqueName: \"kubernetes.io/projected/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-kube-api-access-lhsnp\") pod \"payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7\" (UID: \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\") " pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:40:57.866036 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.865906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-plugins-config-volume\") pod \"payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7\" (UID: \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\") " pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:40:57.967151 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.967106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhsnp\" (UniqueName: \"kubernetes.io/projected/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-kube-api-access-lhsnp\") pod \"payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7\" (UID: \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\") " pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:40:57.967151 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.967147    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-plugins-config-volume\") pod \"payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7\" (UID: \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\") " pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:40:57.967851 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.967831    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-plugins-config-volume\") pod \"payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7\" (UID: \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\") " pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:40:57.976514 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:57.976483    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhsnp\" (UniqueName: \"kubernetes.io/projected/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-kube-api-access-lhsnp\") pod \"payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7\" (UID: \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\") " pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:40:58.057042 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:58.056649    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:40:58.336446 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:58.336407    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"]
Sep 14 10:40:58.337746 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:40:58.337715    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45ebadf_17bc_4abc_aa76_c291b5dab3a8.slice/crio-579d6da50f711ab15483af557952e157f0513a4e328a8b780979048a17b18066 WatchSource:0}: Error finding container 579d6da50f711ab15483af557952e157f0513a4e328a8b780979048a17b18066: Status 404 returned error can't find the container with id 579d6da50f711ab15483af557952e157f0513a4e328a8b780979048a17b18066
Sep 14 10:40:58.470940 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:58.470908    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7" event={"ID":"a45ebadf-17bc-4abc-aa76-c291b5dab3a8","Type":"ContainerStarted","Data":"7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f"}
Sep 14 10:40:58.471120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:58.470960    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7" event={"ID":"a45ebadf-17bc-4abc-aa76-c291b5dab3a8","Type":"ContainerStarted","Data":"579d6da50f711ab15483af557952e157f0513a4e328a8b780979048a17b18066"}
Sep 14 10:40:58.471120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:58.471043    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:40:58.490987 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:40:58.490923    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7" podStartSLOduration=1.490900615 podStartE2EDuration="1.490900615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:40:58.486818824 +0000 UTC m=+981.371887931" watchObservedRunningTime="2026-09-14 10:40:58.490900615 +0000 UTC m=+981.375969726"
Sep 14 10:41:03.548464 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.548423    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"]
Sep 14 10:41:03.552165 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.552146    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.555101 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.555076    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-cc7bcd\"/\"kube-root-ca.crt\""
Sep 14 10:41:03.555252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.555115    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-cc7bcd\"/\"openshift-service-ca.crt\""
Sep 14 10:41:03.556355 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.556326    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-cc7bcd\"/\"explicit-model-cc7bcd-kserve-self-signed-certs\""
Sep 14 10:41:03.556462 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.556415    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-cc7bcd\"/\"default-dockercfg-9bt8w\""
Sep 14 10:41:03.561652 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.561629    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"]
Sep 14 10:41:03.626896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.626840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-dshm\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.627106 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.626924    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tls-certs\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.627106 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.626954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-home\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.627106 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.626988    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-model-cache\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.627106 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.627059    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tmp-dir\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.627340 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.627160    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmfj8\" (UniqueName: \"kubernetes.io/projected/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-kube-api-access-gmfj8\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.727997 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.727957    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-model-cache\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.728225 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.728030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tmp-dir\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.728305 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.728263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmfj8\" (UniqueName: \"kubernetes.io/projected/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-kube-api-access-gmfj8\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.728402 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.728382    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tmp-dir\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.728467 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.728439    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-model-cache\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.728520 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.728460    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-dshm\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.728520 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.728491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tls-certs\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.728617 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.728528    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-home\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.728807 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.728783    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-home\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.732085 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.732056    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tls-certs\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.732363 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.732069    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-dshm\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.737362 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.737335    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmfj8\" (UniqueName: \"kubernetes.io/projected/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-kube-api-access-gmfj8\") pod \"explicit-model-cc7bcd-kserve-6c9654699c-q62pq\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") " pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:03.863043 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:03.862948    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:04.138449 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:04.138422    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"]
Sep 14 10:41:04.140918 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:41:04.140854    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacfa8c82_f718_47e1_87fa_bfbd0b1e56f7.slice/crio-c203f0d5157e6fead89202f956d0bb570ba7b5e2c90bf2135f2d2a049ffa74cb WatchSource:0}: Error finding container c203f0d5157e6fead89202f956d0bb570ba7b5e2c90bf2135f2d2a049ffa74cb: Status 404 returned error can't find the container with id c203f0d5157e6fead89202f956d0bb570ba7b5e2c90bf2135f2d2a049ffa74cb
Sep 14 10:41:04.509042 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:04.509010    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq" event={"ID":"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7","Type":"ContainerStarted","Data":"5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235"}
Sep 14 10:41:04.509042 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:04.509050    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq" event={"ID":"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7","Type":"ContainerStarted","Data":"c203f0d5157e6fead89202f956d0bb570ba7b5e2c90bf2135f2d2a049ffa74cb"}
Sep 14 10:41:04.528968 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:04.528904    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq" podStartSLOduration=1.528861136 podStartE2EDuration="1.528861136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:41:04.526257971 +0000 UTC m=+987.411327080" watchObservedRunningTime="2026-09-14 10:41:04.528861136 +0000 UTC m=+987.413930244"
Sep 14 10:41:09.479693 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:09.479660    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:41:13.863519 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:13.863480    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:13.863963 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:13.863538    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:13.876624 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:13.876599    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:14.579969 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:14.579940    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:23.241789 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.241755    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"]
Sep 14 10:41:23.371120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.371084    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"]
Sep 14 10:41:23.375120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.375101    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"
Sep 14 10:41:23.377941 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.377916    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:41:23.383182 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.383155    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"]
Sep 14 10:41:23.437238 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.437196    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22441078-ec4d-470e-bdca-b566f3fd2519-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq\" (UID: \"22441078-ec4d-470e-bdca-b566f3fd2519\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"
Sep 14 10:41:23.538791 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.538694    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22441078-ec4d-470e-bdca-b566f3fd2519-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq\" (UID: \"22441078-ec4d-470e-bdca-b566f3fd2519\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"
Sep 14 10:41:23.539382 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.539356    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22441078-ec4d-470e-bdca-b566f3fd2519-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq\" (UID: \"22441078-ec4d-470e-bdca-b566f3fd2519\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"
Sep 14 10:41:23.689406 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.689366    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"
Sep 14 10:41:23.973259 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:23.972933    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"]
Sep 14 10:41:24.633285 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:24.633192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq" event={"ID":"22441078-ec4d-470e-bdca-b566f3fd2519","Type":"ContainerStarted","Data":"c39756c124b7b551903dc7500f48a4912e6b3b8140c54ba8c8ed30bf86da1707"}
Sep 14 10:41:24.633285 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:24.633252    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq" event={"ID":"22441078-ec4d-470e-bdca-b566f3fd2519","Type":"ContainerStarted","Data":"aae305c9a6c837e7d347d13fc464468d1e557bbc3b0a5dd76b32def614a36682"}
Sep 14 10:41:24.651008 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:24.650958    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq" podStartSLOduration=1.6509429180000001 podStartE2EDuration="1.650942918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:41:24.648788431 +0000 UTC m=+1007.533857539" watchObservedRunningTime="2026-09-14 10:41:24.650942918 +0000 UTC m=+1007.536012025"
Sep 14 10:41:25.641626 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:25.641584    2574 generic.go:356] "Generic (PLEG): container finished" podID="22441078-ec4d-470e-bdca-b566f3fd2519" containerID="c39756c124b7b551903dc7500f48a4912e6b3b8140c54ba8c8ed30bf86da1707" exitCode=0
Sep 14 10:41:25.642024 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:25.641626    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq" event={"ID":"22441078-ec4d-470e-bdca-b566f3fd2519","Type":"ContainerDied","Data":"c39756c124b7b551903dc7500f48a4912e6b3b8140c54ba8c8ed30bf86da1707"}
Sep 14 10:41:26.813936 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:26.813908    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"
Sep 14 10:41:26.872803 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:26.872751    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22441078-ec4d-470e-bdca-b566f3fd2519-maas-api-service-ca\") pod \"22441078-ec4d-470e-bdca-b566f3fd2519\" (UID: \"22441078-ec4d-470e-bdca-b566f3fd2519\") "
Sep 14 10:41:26.873175 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:26.873154    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22441078-ec4d-470e-bdca-b566f3fd2519-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "22441078-ec4d-470e-bdca-b566f3fd2519" (UID: "22441078-ec4d-470e-bdca-b566f3fd2519"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:41:26.974557 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:26.974464    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22441078-ec4d-470e-bdca-b566f3fd2519-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:27.655017 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:27.654989    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"
Sep 14 10:41:27.655195 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:27.655024    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq" event={"ID":"22441078-ec4d-470e-bdca-b566f3fd2519","Type":"ContainerDied","Data":"aae305c9a6c837e7d347d13fc464468d1e557bbc3b0a5dd76b32def614a36682"}
Sep 14 10:41:27.655195 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:27.655070    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aae305c9a6c837e7d347d13fc464468d1e557bbc3b0a5dd76b32def614a36682"
Sep 14 10:41:30.540861 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.540828    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"]
Sep 14 10:41:30.541542 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.541520    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22441078-ec4d-470e-bdca-b566f3fd2519" containerName="revoke-keys"
Sep 14 10:41:30.541651 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.541544    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="22441078-ec4d-470e-bdca-b566f3fd2519" containerName="revoke-keys"
Sep 14 10:41:30.541741 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.541727    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="22441078-ec4d-470e-bdca-b566f3fd2519" containerName="revoke-keys"
Sep 14 10:41:30.545530 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.545509    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"
Sep 14 10:41:30.548435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.548415    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:41:30.558186 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.556028    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"]
Sep 14 10:41:30.615268 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.615230    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f64b3b-4e6c-4342-aa2e-daf530c69f89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-34925ca5-cplx2\" (UID: \"e8f64b3b-4e6c-4342-aa2e-daf530c69f89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"
Sep 14 10:41:30.716681 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.716652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f64b3b-4e6c-4342-aa2e-daf530c69f89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-34925ca5-cplx2\" (UID: \"e8f64b3b-4e6c-4342-aa2e-daf530c69f89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"
Sep 14 10:41:30.717516 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.717489    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f64b3b-4e6c-4342-aa2e-daf530c69f89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-34925ca5-cplx2\" (UID: \"e8f64b3b-4e6c-4342-aa2e-daf530c69f89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"
Sep 14 10:41:30.859952 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:30.859824    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"
Sep 14 10:41:31.138606 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:31.138579    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"]
Sep 14 10:41:31.141045 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:41:31.141013    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f64b3b_4e6c_4342_aa2e_daf530c69f89.slice/crio-133e721f1ee80d89042dfe2804e468079243eac42a8017f52714a4574963c3cb WatchSource:0}: Error finding container 133e721f1ee80d89042dfe2804e468079243eac42a8017f52714a4574963c3cb: Status 404 returned error can't find the container with id 133e721f1ee80d89042dfe2804e468079243eac42a8017f52714a4574963c3cb
Sep 14 10:41:31.680778 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:31.680739    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2" event={"ID":"e8f64b3b-4e6c-4342-aa2e-daf530c69f89","Type":"ContainerStarted","Data":"2686ed18c02fe647a470a87ea77faea791a3f3477240a6c49faaa1fd445016a4"}
Sep 14 10:41:31.681225 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:31.680800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2" event={"ID":"e8f64b3b-4e6c-4342-aa2e-daf530c69f89","Type":"ContainerStarted","Data":"133e721f1ee80d89042dfe2804e468079243eac42a8017f52714a4574963c3cb"}
Sep 14 10:41:31.699378 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:31.699326    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2" podStartSLOduration=1.699308008 podStartE2EDuration="1.699308008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:41:31.698074543 +0000 UTC m=+1014.583143665" watchObservedRunningTime="2026-09-14 10:41:31.699308008 +0000 UTC m=+1014.584377118"
Sep 14 10:41:32.688213 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:32.688180    2574 generic.go:356] "Generic (PLEG): container finished" podID="e8f64b3b-4e6c-4342-aa2e-daf530c69f89" containerID="2686ed18c02fe647a470a87ea77faea791a3f3477240a6c49faaa1fd445016a4" exitCode=0
Sep 14 10:41:32.688624 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:32.688279    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2" event={"ID":"e8f64b3b-4e6c-4342-aa2e-daf530c69f89","Type":"ContainerDied","Data":"2686ed18c02fe647a470a87ea77faea791a3f3477240a6c49faaa1fd445016a4"}
Sep 14 10:41:33.863561 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:33.863538    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"
Sep 14 10:41:33.952622 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:33.952519    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f64b3b-4e6c-4342-aa2e-daf530c69f89-maas-api-service-ca\") pod \"e8f64b3b-4e6c-4342-aa2e-daf530c69f89\" (UID: \"e8f64b3b-4e6c-4342-aa2e-daf530c69f89\") "
Sep 14 10:41:33.952929 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:33.952907    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8f64b3b-4e6c-4342-aa2e-daf530c69f89-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e8f64b3b-4e6c-4342-aa2e-daf530c69f89" (UID: "e8f64b3b-4e6c-4342-aa2e-daf530c69f89"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:41:34.054150 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.054117    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f64b3b-4e6c-4342-aa2e-daf530c69f89-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:34.363962 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.363836    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"]
Sep 14 10:41:34.364361 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.364347    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8f64b3b-4e6c-4342-aa2e-daf530c69f89" containerName="revoke-keys"
Sep 14 10:41:34.364407 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.364363    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8f64b3b-4e6c-4342-aa2e-daf530c69f89" containerName="revoke-keys"
Sep 14 10:41:34.364454 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.364446    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8f64b3b-4e6c-4342-aa2e-daf530c69f89" containerName="revoke-keys"
Sep 14 10:41:34.367640 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.367621    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.371854 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.371827    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-85d3ec\"/\"openshift-service-ca.crt\""
Sep 14 10:41:34.372120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.372103    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-85d3ec\"/\"kube-root-ca.crt\""
Sep 14 10:41:34.372655 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.372639    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-85d3ec\"/\"default-dockercfg-wndsg\""
Sep 14 10:41:34.373364 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.373348    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-85d3ec\"/\"distinct-w0-85d3ec-kserve-self-signed-certs\""
Sep 14 10:41:34.385123 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.385092    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"]
Sep 14 10:41:34.457601 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.457553    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-model-cache\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.457774 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.457609    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-tmp-dir\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.457774 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.457636    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-home\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.457774 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.457712    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m9cd\" (UniqueName: \"kubernetes.io/projected/a89353f7-9719-4196-82e8-2446d9cba144-kube-api-access-7m9cd\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.457774 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.457740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-dshm\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.457774 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.457756    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a89353f7-9719-4196-82e8-2446d9cba144-tls-certs\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.558822 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.558781    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-model-cache\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.559063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.558847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-tmp-dir\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.559063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.558895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-home\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.559063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.558975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m9cd\" (UniqueName: \"kubernetes.io/projected/a89353f7-9719-4196-82e8-2446d9cba144-kube-api-access-7m9cd\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.559063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.559035    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-dshm\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.559063 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.559060    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a89353f7-9719-4196-82e8-2446d9cba144-tls-certs\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.559346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.559286    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-model-cache\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.559346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.559314    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-tmp-dir\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.559508 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.559488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-home\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.561582 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.561557    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-dshm\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.561929 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.561906    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a89353f7-9719-4196-82e8-2446d9cba144-tls-certs\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.568550 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.568518    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m9cd\" (UniqueName: \"kubernetes.io/projected/a89353f7-9719-4196-82e8-2446d9cba144-kube-api-access-7m9cd\") pod \"distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.678707 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.678667    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:34.705937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.702421    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2" event={"ID":"e8f64b3b-4e6c-4342-aa2e-daf530c69f89","Type":"ContainerDied","Data":"133e721f1ee80d89042dfe2804e468079243eac42a8017f52714a4574963c3cb"}
Sep 14 10:41:34.705937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.702484    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="133e721f1ee80d89042dfe2804e468079243eac42a8017f52714a4574963c3cb"
Sep 14 10:41:34.705937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.702567    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"
Sep 14 10:41:34.962309 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:34.962270    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"]
Sep 14 10:41:34.963734 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:41:34.963705    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda89353f7_9719_4196_82e8_2446d9cba144.slice/crio-0934c9f2e8c60cb1152a68ca7dc693ef4fd5ccb218d241a7ee3bc1027ea18eeb WatchSource:0}: Error finding container 0934c9f2e8c60cb1152a68ca7dc693ef4fd5ccb218d241a7ee3bc1027ea18eeb: Status 404 returned error can't find the container with id 0934c9f2e8c60cb1152a68ca7dc693ef4fd5ccb218d241a7ee3bc1027ea18eeb
Sep 14 10:41:35.529995 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:35.529946    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"]
Sep 14 10:41:35.532072 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:35.532047    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-cc7bcd-r84gq"]
Sep 14 10:41:35.612434 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:35.612402    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22441078-ec4d-470e-bdca-b566f3fd2519" path="/var/lib/kubelet/pods/22441078-ec4d-470e-bdca-b566f3fd2519/volumes"
Sep 14 10:41:35.720022 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:35.719977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9" event={"ID":"a89353f7-9719-4196-82e8-2446d9cba144","Type":"ContainerStarted","Data":"76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94"}
Sep 14 10:41:35.720318 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:35.720294    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9" event={"ID":"a89353f7-9719-4196-82e8-2446d9cba144","Type":"ContainerStarted","Data":"0934c9f2e8c60cb1152a68ca7dc693ef4fd5ccb218d241a7ee3bc1027ea18eeb"}
Sep 14 10:41:35.741027 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:35.740974    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9" podStartSLOduration=1.7409551699999999 podStartE2EDuration="1.74095517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:41:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:41:35.740005535 +0000 UTC m=+1018.625074644" watchObservedRunningTime="2026-09-14 10:41:35.74095517 +0000 UTC m=+1018.626024277"
Sep 14 10:41:38.263521 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.263452    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq" podUID="acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" containerName="main" containerID="cri-o://5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235" gracePeriod=45
Sep 14 10:41:38.536294 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.536268    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:38.599928 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.599895    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tmp-dir\") pod \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") "
Sep 14 10:41:38.600128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.599965    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-model-cache\") pod \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") "
Sep 14 10:41:38.600128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600012    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-home\") pod \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") "
Sep 14 10:41:38.600128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600086    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmfj8\" (UniqueName: \"kubernetes.io/projected/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-kube-api-access-gmfj8\") pod \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") "
Sep 14 10:41:38.600128 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600119    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tls-certs\") pod \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") "
Sep 14 10:41:38.600414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600145    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-dshm\") pod \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\" (UID: \"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7\") "
Sep 14 10:41:38.600414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600198    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" (UID: "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:41:38.600414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600209    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" (UID: "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:41:38.600414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600265    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-home" (OuterVolumeSpecName: "home") pod "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" (UID: "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:41:38.600613 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600565    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tmp-dir\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:38.600613 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600586    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-model-cache\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:38.600613 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.600597    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-home\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:38.603673 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.603049    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" (UID: "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:41:38.603673 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.603646    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-dshm" (OuterVolumeSpecName: "dshm") pod "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" (UID: "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:41:38.609027 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.608992    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-kube-api-access-gmfj8" (OuterVolumeSpecName: "kube-api-access-gmfj8") pod "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" (UID: "acfa8c82-f718-47e1-87fa-bfbd0b1e56f7"). InnerVolumeSpecName "kube-api-access-gmfj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:41:38.701617 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.701582    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmfj8\" (UniqueName: \"kubernetes.io/projected/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-kube-api-access-gmfj8\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:38.701617 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.701612    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-tls-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:38.701617 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.701622    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7-dshm\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:38.741475 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.741433    2574 generic.go:356] "Generic (PLEG): container finished" podID="acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" containerID="5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235" exitCode=0
Sep 14 10:41:38.741671 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.741526    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"
Sep 14 10:41:38.741671 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.741556    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq" event={"ID":"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7","Type":"ContainerDied","Data":"5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235"}
Sep 14 10:41:38.741671 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.741605    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq" event={"ID":"acfa8c82-f718-47e1-87fa-bfbd0b1e56f7","Type":"ContainerDied","Data":"c203f0d5157e6fead89202f956d0bb570ba7b5e2c90bf2135f2d2a049ffa74cb"}
Sep 14 10:41:38.741671 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.741628    2574 scope.go:117] "RemoveContainer" containerID="5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235"
Sep 14 10:41:38.758975 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.758951    2574 scope.go:117] "RemoveContainer" containerID="5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235"
Sep 14 10:41:38.759373 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:41:38.759349    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235\": container with ID starting with 5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235 not found: ID does not exist" containerID="5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235"
Sep 14 10:41:38.759438 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.759384    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235"} err="failed to get container status \"5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235\": rpc error: code = NotFound desc = could not find container \"5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235\": container with ID starting with 5f0226cfe4072f02cda8a0b30dffb7a1e70a972216472805a4580330b12fb235 not found: ID does not exist"
Sep 14 10:41:38.770669 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.770609    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"]
Sep 14 10:41:38.774435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:38.774412    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-cc7bcd/explicit-model-cc7bcd-kserve-6c9654699c-q62pq"]
Sep 14 10:41:39.611203 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:39.611168    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" path="/var/lib/kubelet/pods/acfa8c82-f718-47e1-87fa-bfbd0b1e56f7/volumes"
Sep 14 10:41:40.959852 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:40.959814    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"]
Sep 14 10:41:40.960342 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:40.960105    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7" podUID="a45ebadf-17bc-4abc-aa76-c291b5dab3a8" containerName="payload-processing" containerID="cri-o://7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f" gracePeriod=30
Sep 14 10:41:41.148961 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.148923    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"]
Sep 14 10:41:41.152946 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.152908    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-34925ca5-cplx2"]
Sep 14 10:41:41.251568 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.251230    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:41:41.329649 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.329606    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhsnp\" (UniqueName: \"kubernetes.io/projected/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-kube-api-access-lhsnp\") pod \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\" (UID: \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\") "
Sep 14 10:41:41.329842 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.329660    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-plugins-config-volume\") pod \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\" (UID: \"a45ebadf-17bc-4abc-aa76-c291b5dab3a8\") "
Sep 14 10:41:41.330111 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.330086    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a45ebadf-17bc-4abc-aa76-c291b5dab3a8" (UID: "a45ebadf-17bc-4abc-aa76-c291b5dab3a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:41:41.332187 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.332162    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-kube-api-access-lhsnp" (OuterVolumeSpecName: "kube-api-access-lhsnp") pod "a45ebadf-17bc-4abc-aa76-c291b5dab3a8" (UID: "a45ebadf-17bc-4abc-aa76-c291b5dab3a8"). InnerVolumeSpecName "kube-api-access-lhsnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:41:41.431110 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.431076    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhsnp\" (UniqueName: \"kubernetes.io/projected/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-kube-api-access-lhsnp\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:41.431110 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.431105    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a45ebadf-17bc-4abc-aa76-c291b5dab3a8-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:41:41.611148 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.611064    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8f64b3b-4e6c-4342-aa2e-daf530c69f89" path="/var/lib/kubelet/pods/e8f64b3b-4e6c-4342-aa2e-daf530c69f89/volumes"
Sep 14 10:41:41.762406 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.762368    2574 generic.go:356] "Generic (PLEG): container finished" podID="a45ebadf-17bc-4abc-aa76-c291b5dab3a8" containerID="7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f" exitCode=0
Sep 14 10:41:41.762576 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.762422    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"
Sep 14 10:41:41.762576 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.762451    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7" event={"ID":"a45ebadf-17bc-4abc-aa76-c291b5dab3a8","Type":"ContainerDied","Data":"7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f"}
Sep 14 10:41:41.762576 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.762530    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7" event={"ID":"a45ebadf-17bc-4abc-aa76-c291b5dab3a8","Type":"ContainerDied","Data":"579d6da50f711ab15483af557952e157f0513a4e328a8b780979048a17b18066"}
Sep 14 10:41:41.762576 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.762552    2574 scope.go:117] "RemoveContainer" containerID="7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f"
Sep 14 10:41:41.772752 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.772726    2574 scope.go:117] "RemoveContainer" containerID="7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f"
Sep 14 10:41:41.773148 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:41:41.773120    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f\": container with ID starting with 7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f not found: ID does not exist" containerID="7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f"
Sep 14 10:41:41.773238 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.773160    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f"} err="failed to get container status \"7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f\": rpc error: code = NotFound desc = could not find container \"7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f\": container with ID starting with 7b0ea4327ebf85923201d67345ddceb663209c5b776e3ab6f2c4aee1be8cb70f not found: ID does not exist"
Sep 14 10:41:41.781085 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.781057    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"]
Sep 14 10:41:41.786082 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:41.786048    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-34925ca5-5fcffdc7b9-6php7"]
Sep 14 10:41:43.613693 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:43.613660    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a45ebadf-17bc-4abc-aa76-c291b5dab3a8" path="/var/lib/kubelet/pods/a45ebadf-17bc-4abc-aa76-c291b5dab3a8/volumes"
Sep 14 10:41:44.679546 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:44.679506    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:44.680064 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:44.679581    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:44.692738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:44.692711    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:41:44.794881 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:41:44.794850    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:42:29.967438 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.967346    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"]
Sep 14 10:42:29.967907 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.967834    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a45ebadf-17bc-4abc-aa76-c291b5dab3a8" containerName="payload-processing"
Sep 14 10:42:29.967907 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.967846    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a45ebadf-17bc-4abc-aa76-c291b5dab3a8" containerName="payload-processing"
Sep 14 10:42:29.967907 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.967856    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" containerName="main"
Sep 14 10:42:29.967907 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.967861    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" containerName="main"
Sep 14 10:42:29.968065 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.967968    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfa8c82-f718-47e1-87fa-bfbd0b1e56f7" containerName="main"
Sep 14 10:42:29.968065 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.967983    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a45ebadf-17bc-4abc-aa76-c291b5dab3a8" containerName="payload-processing"
Sep 14 10:42:29.971043 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.971026    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"
Sep 14 10:42:29.974358 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.974335    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:42:29.979597 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:29.979569    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"]
Sep 14 10:42:30.143095 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:30.143053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f789e10b-812a-470b-9b05-d363ba8641c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d36f67-g272v\" (UID: \"f789e10b-812a-470b-9b05-d363ba8641c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"
Sep 14 10:42:30.244367 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:30.244265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f789e10b-812a-470b-9b05-d363ba8641c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d36f67-g272v\" (UID: \"f789e10b-812a-470b-9b05-d363ba8641c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"
Sep 14 10:42:30.244912 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:30.244889    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f789e10b-812a-470b-9b05-d363ba8641c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d36f67-g272v\" (UID: \"f789e10b-812a-470b-9b05-d363ba8641c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"
Sep 14 10:42:30.283048 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:30.283007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"
Sep 14 10:42:30.564449 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:30.564420    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"]
Sep 14 10:42:30.567366 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:42:30.567336    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf789e10b_812a_470b_9b05_d363ba8641c6.slice/crio-53901dc5c35c6290bf3ad948402bc86dc8f6ecbbf065f3c54fd742f689dbe3f1 WatchSource:0}: Error finding container 53901dc5c35c6290bf3ad948402bc86dc8f6ecbbf065f3c54fd742f689dbe3f1: Status 404 returned error can't find the container with id 53901dc5c35c6290bf3ad948402bc86dc8f6ecbbf065f3c54fd742f689dbe3f1
Sep 14 10:42:31.075893 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:31.075764    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v" event={"ID":"f789e10b-812a-470b-9b05-d363ba8641c6","Type":"ContainerStarted","Data":"8c8aff3ddeb9d6162c71c65a5104dfba8fa18b501f211f8fcf3cff892916fbba"}
Sep 14 10:42:31.075893 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:31.075825    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v" event={"ID":"f789e10b-812a-470b-9b05-d363ba8641c6","Type":"ContainerStarted","Data":"53901dc5c35c6290bf3ad948402bc86dc8f6ecbbf065f3c54fd742f689dbe3f1"}
Sep 14 10:42:31.097985 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:31.097931    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v" podStartSLOduration=2.097913628 podStartE2EDuration="2.097913628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:42:31.097612135 +0000 UTC m=+1073.982681266" watchObservedRunningTime="2026-09-14 10:42:31.097913628 +0000 UTC m=+1073.982982735"
Sep 14 10:42:32.083195 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:32.083159    2574 generic.go:356] "Generic (PLEG): container finished" podID="f789e10b-812a-470b-9b05-d363ba8641c6" containerID="8c8aff3ddeb9d6162c71c65a5104dfba8fa18b501f211f8fcf3cff892916fbba" exitCode=0
Sep 14 10:42:32.083662 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:32.083254    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v" event={"ID":"f789e10b-812a-470b-9b05-d363ba8641c6","Type":"ContainerDied","Data":"8c8aff3ddeb9d6162c71c65a5104dfba8fa18b501f211f8fcf3cff892916fbba"}
Sep 14 10:42:33.250351 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:33.250314    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"
Sep 14 10:42:33.275802 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:33.275767    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f789e10b-812a-470b-9b05-d363ba8641c6-maas-api-service-ca\") pod \"f789e10b-812a-470b-9b05-d363ba8641c6\" (UID: \"f789e10b-812a-470b-9b05-d363ba8641c6\") "
Sep 14 10:42:33.276235 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:33.276209    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f789e10b-812a-470b-9b05-d363ba8641c6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f789e10b-812a-470b-9b05-d363ba8641c6" (UID: "f789e10b-812a-470b-9b05-d363ba8641c6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:42:33.377382 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:33.377296    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f789e10b-812a-470b-9b05-d363ba8641c6-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:34.096622 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:34.096593    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"
Sep 14 10:42:34.096887 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:34.096601    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v" event={"ID":"f789e10b-812a-470b-9b05-d363ba8641c6","Type":"ContainerDied","Data":"53901dc5c35c6290bf3ad948402bc86dc8f6ecbbf065f3c54fd742f689dbe3f1"}
Sep 14 10:42:34.097025 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:34.096921    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53901dc5c35c6290bf3ad948402bc86dc8f6ecbbf065f3c54fd742f689dbe3f1"
Sep 14 10:42:41.495855 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.495813    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"]
Sep 14 10:42:41.496367 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.496039    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl" podUID="24809952-00d0-41f2-bb37-9ffee84d4419" containerName="payload-processing" containerID="cri-o://f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189" gracePeriod=30
Sep 14 10:42:41.513665 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.513625    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"]
Sep 14 10:42:41.513915 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.513889    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m" podUID="8123b320-7109-452a-b5ed-71aaa7af247a" containerName="payload-pre-processing" containerID="cri-o://12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841" gracePeriod=30
Sep 14 10:42:41.591530 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.591494    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl" podUID="24809952-00d0-41f2-bb37-9ffee84d4419" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.57:9004: connect: connection refused"
Sep 14 10:42:41.591670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.591494    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m" podUID="8123b320-7109-452a-b5ed-71aaa7af247a" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.56:9004: connect: connection refused"
Sep 14 10:42:41.733748 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.733690    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"]
Sep 14 10:42:41.738212 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.737639    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d36f67-g272v"]
Sep 14 10:42:41.852041 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.852012    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:42:41.855095 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.855072    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:42:41.972916 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.972855    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p87kc\" (UniqueName: \"kubernetes.io/projected/8123b320-7109-452a-b5ed-71aaa7af247a-kube-api-access-p87kc\") pod \"8123b320-7109-452a-b5ed-71aaa7af247a\" (UID: \"8123b320-7109-452a-b5ed-71aaa7af247a\") "
Sep 14 10:42:41.972916 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.972919    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24809952-00d0-41f2-bb37-9ffee84d4419-plugins-config-volume\") pod \"24809952-00d0-41f2-bb37-9ffee84d4419\" (UID: \"24809952-00d0-41f2-bb37-9ffee84d4419\") "
Sep 14 10:42:41.973184 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.972985    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m86d6\" (UniqueName: \"kubernetes.io/projected/24809952-00d0-41f2-bb37-9ffee84d4419-kube-api-access-m86d6\") pod \"24809952-00d0-41f2-bb37-9ffee84d4419\" (UID: \"24809952-00d0-41f2-bb37-9ffee84d4419\") "
Sep 14 10:42:41.973184 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.973024    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8123b320-7109-452a-b5ed-71aaa7af247a-plugins-config-volume\") pod \"8123b320-7109-452a-b5ed-71aaa7af247a\" (UID: \"8123b320-7109-452a-b5ed-71aaa7af247a\") "
Sep 14 10:42:41.973396 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.973373    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24809952-00d0-41f2-bb37-9ffee84d4419-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24809952-00d0-41f2-bb37-9ffee84d4419" (UID: "24809952-00d0-41f2-bb37-9ffee84d4419"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:42:41.973452 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.973430    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8123b320-7109-452a-b5ed-71aaa7af247a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8123b320-7109-452a-b5ed-71aaa7af247a" (UID: "8123b320-7109-452a-b5ed-71aaa7af247a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:42:41.975263 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.975241    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24809952-00d0-41f2-bb37-9ffee84d4419-kube-api-access-m86d6" (OuterVolumeSpecName: "kube-api-access-m86d6") pod "24809952-00d0-41f2-bb37-9ffee84d4419" (UID: "24809952-00d0-41f2-bb37-9ffee84d4419"). InnerVolumeSpecName "kube-api-access-m86d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:42:41.975338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:41.975260    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8123b320-7109-452a-b5ed-71aaa7af247a-kube-api-access-p87kc" (OuterVolumeSpecName: "kube-api-access-p87kc") pod "8123b320-7109-452a-b5ed-71aaa7af247a" (UID: "8123b320-7109-452a-b5ed-71aaa7af247a"). InnerVolumeSpecName "kube-api-access-p87kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:42:42.074307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.074225    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8123b320-7109-452a-b5ed-71aaa7af247a-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:42.074307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.074251    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p87kc\" (UniqueName: \"kubernetes.io/projected/8123b320-7109-452a-b5ed-71aaa7af247a-kube-api-access-p87kc\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:42.074307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.074262    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24809952-00d0-41f2-bb37-9ffee84d4419-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:42.074307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.074271    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m86d6\" (UniqueName: \"kubernetes.io/projected/24809952-00d0-41f2-bb37-9ffee84d4419-kube-api-access-m86d6\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:42.152216 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.152175    2574 generic.go:356] "Generic (PLEG): container finished" podID="8123b320-7109-452a-b5ed-71aaa7af247a" containerID="12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841" exitCode=0
Sep 14 10:42:42.152445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.152225    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"
Sep 14 10:42:42.152445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.152259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m" event={"ID":"8123b320-7109-452a-b5ed-71aaa7af247a","Type":"ContainerDied","Data":"12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841"}
Sep 14 10:42:42.152445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.152316    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m" event={"ID":"8123b320-7109-452a-b5ed-71aaa7af247a","Type":"ContainerDied","Data":"574c3758a119305e79198e6fdf83456b886c006182451f6c3d7b5c074f6e7150"}
Sep 14 10:42:42.152445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.152342    2574 scope.go:117] "RemoveContainer" containerID="12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841"
Sep 14 10:42:42.153856 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.153833    2574 generic.go:356] "Generic (PLEG): container finished" podID="24809952-00d0-41f2-bb37-9ffee84d4419" containerID="f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189" exitCode=0
Sep 14 10:42:42.154181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.153896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl" event={"ID":"24809952-00d0-41f2-bb37-9ffee84d4419","Type":"ContainerDied","Data":"f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189"}
Sep 14 10:42:42.154181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.153902    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"
Sep 14 10:42:42.154181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.153932    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl" event={"ID":"24809952-00d0-41f2-bb37-9ffee84d4419","Type":"ContainerDied","Data":"64b386a9d785ad245601954ecfdd683e45ebc5c16ca64451c73720483dad8a58"}
Sep 14 10:42:42.166436 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.166416    2574 scope.go:117] "RemoveContainer" containerID="12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841"
Sep 14 10:42:42.166806 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:42:42.166783    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841\": container with ID starting with 12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841 not found: ID does not exist" containerID="12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841"
Sep 14 10:42:42.166944 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.166816    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841"} err="failed to get container status \"12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841\": rpc error: code = NotFound desc = could not find container \"12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841\": container with ID starting with 12b4ddd02542277f00b9056450e6bc913353598c65574feb547b8c8fa63f8841 not found: ID does not exist"
Sep 14 10:42:42.166944 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.166834    2574 scope.go:117] "RemoveContainer" containerID="f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189"
Sep 14 10:42:42.176127 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.176106    2574 scope.go:117] "RemoveContainer" containerID="f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189"
Sep 14 10:42:42.176419 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:42:42.176399    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189\": container with ID starting with f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189 not found: ID does not exist" containerID="f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189"
Sep 14 10:42:42.176496 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.176429    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189"} err="failed to get container status \"f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189\": rpc error: code = NotFound desc = could not find container \"f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189\": container with ID starting with f5bf0ffeb5a9270c229737bbae920dfedffe871a6053da9d33a626d695405189 not found: ID does not exist"
Sep 14 10:42:42.183582 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.183551    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"]
Sep 14 10:42:42.186337 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.186308    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d36f67-57d968c98b-mdc6m"]
Sep 14 10:42:42.194995 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.194971    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"]
Sep 14 10:42:42.198257 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:42.198233    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d36f67-58cc6b6469-8nvzl"]
Sep 14 10:42:43.556830 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.556797    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"]
Sep 14 10:42:43.557284 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.557272    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f789e10b-812a-470b-9b05-d363ba8641c6" containerName="revoke-keys"
Sep 14 10:42:43.557335 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.557286    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f789e10b-812a-470b-9b05-d363ba8641c6" containerName="revoke-keys"
Sep 14 10:42:43.557335 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.557301    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24809952-00d0-41f2-bb37-9ffee84d4419" containerName="payload-processing"
Sep 14 10:42:43.557335 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.557306    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="24809952-00d0-41f2-bb37-9ffee84d4419" containerName="payload-processing"
Sep 14 10:42:43.557335 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.557314    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8123b320-7109-452a-b5ed-71aaa7af247a" containerName="payload-pre-processing"
Sep 14 10:42:43.557335 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.557320    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8123b320-7109-452a-b5ed-71aaa7af247a" containerName="payload-pre-processing"
Sep 14 10:42:43.557484 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.557393    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="24809952-00d0-41f2-bb37-9ffee84d4419" containerName="payload-processing"
Sep 14 10:42:43.557484 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.557406    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8123b320-7109-452a-b5ed-71aaa7af247a" containerName="payload-pre-processing"
Sep 14 10:42:43.557484 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.557412    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f789e10b-812a-470b-9b05-d363ba8641c6" containerName="revoke-keys"
Sep 14 10:42:43.562323 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.562296    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:43.565235 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.565201    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-558928-dockercfg-wthn4\""
Sep 14 10:42:43.565391 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.565251    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-558928\""
Sep 14 10:42:43.572486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.572463    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"]
Sep 14 10:42:43.620896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.617446    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24809952-00d0-41f2-bb37-9ffee84d4419" path="/var/lib/kubelet/pods/24809952-00d0-41f2-bb37-9ffee84d4419/volumes"
Sep 14 10:42:43.620896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.618036    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8123b320-7109-452a-b5ed-71aaa7af247a" path="/var/lib/kubelet/pods/8123b320-7109-452a-b5ed-71aaa7af247a/volumes"
Sep 14 10:42:43.620896 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.618463    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f789e10b-812a-470b-9b05-d363ba8641c6" path="/var/lib/kubelet/pods/f789e10b-812a-470b-9b05-d363ba8641c6/volumes"
Sep 14 10:42:43.647293 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.647256    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"]
Sep 14 10:42:43.651143 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.651124    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:43.663149 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.663122    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"]
Sep 14 10:42:43.690739 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.690678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cqlz\" (UniqueName: \"kubernetes.io/projected/5d45d113-0aa0-4332-8c07-83cc3f686c82-kube-api-access-9cqlz\") pod \"payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf\" (UID: \"5d45d113-0aa0-4332-8c07-83cc3f686c82\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:43.691012 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.690834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3553a914-f1c6-4a6c-8203-a78fea993367-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8\" (UID: \"3553a914-f1c6-4a6c-8203-a78fea993367\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:43.691012 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.690882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d45d113-0aa0-4332-8c07-83cc3f686c82-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf\" (UID: \"5d45d113-0aa0-4332-8c07-83cc3f686c82\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:43.691012 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.690926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsnc7\" (UniqueName: \"kubernetes.io/projected/3553a914-f1c6-4a6c-8203-a78fea993367-kube-api-access-tsnc7\") pod \"payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8\" (UID: \"3553a914-f1c6-4a6c-8203-a78fea993367\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:43.791506 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.791473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cqlz\" (UniqueName: \"kubernetes.io/projected/5d45d113-0aa0-4332-8c07-83cc3f686c82-kube-api-access-9cqlz\") pod \"payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf\" (UID: \"5d45d113-0aa0-4332-8c07-83cc3f686c82\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:43.791785 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.791561    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3553a914-f1c6-4a6c-8203-a78fea993367-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8\" (UID: \"3553a914-f1c6-4a6c-8203-a78fea993367\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:43.791785 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.791580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d45d113-0aa0-4332-8c07-83cc3f686c82-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf\" (UID: \"5d45d113-0aa0-4332-8c07-83cc3f686c82\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:43.791785 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.791606    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsnc7\" (UniqueName: \"kubernetes.io/projected/3553a914-f1c6-4a6c-8203-a78fea993367-kube-api-access-tsnc7\") pod \"payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8\" (UID: \"3553a914-f1c6-4a6c-8203-a78fea993367\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:43.792283 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.792263    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3553a914-f1c6-4a6c-8203-a78fea993367-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8\" (UID: \"3553a914-f1c6-4a6c-8203-a78fea993367\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:43.792325 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.792290    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d45d113-0aa0-4332-8c07-83cc3f686c82-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf\" (UID: \"5d45d113-0aa0-4332-8c07-83cc3f686c82\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:43.803956 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.803924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsnc7\" (UniqueName: \"kubernetes.io/projected/3553a914-f1c6-4a6c-8203-a78fea993367-kube-api-access-tsnc7\") pod \"payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8\" (UID: \"3553a914-f1c6-4a6c-8203-a78fea993367\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:43.808573 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.808494    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cqlz\" (UniqueName: \"kubernetes.io/projected/5d45d113-0aa0-4332-8c07-83cc3f686c82-kube-api-access-9cqlz\") pod \"payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf\" (UID: \"5d45d113-0aa0-4332-8c07-83cc3f686c82\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:43.874998 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.874963    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:43.964036 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:43.963796    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:44.155562 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:44.155535    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"]
Sep 14 10:42:44.156945 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:42:44.156919    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d45d113_0aa0_4332_8c07_83cc3f686c82.slice/crio-244978ca5ab6fdecccd5e0de201b034b1d4ca21f9b312b1657031c1f51a31252 WatchSource:0}: Error finding container 244978ca5ab6fdecccd5e0de201b034b1d4ca21f9b312b1657031c1f51a31252: Status 404 returned error can't find the container with id 244978ca5ab6fdecccd5e0de201b034b1d4ca21f9b312b1657031c1f51a31252
Sep 14 10:42:44.169598 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:44.169564    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf" event={"ID":"5d45d113-0aa0-4332-8c07-83cc3f686c82","Type":"ContainerStarted","Data":"244978ca5ab6fdecccd5e0de201b034b1d4ca21f9b312b1657031c1f51a31252"}
Sep 14 10:42:44.248986 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:44.248952    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"]
Sep 14 10:42:44.252679 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:42:44.252649    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3553a914_f1c6_4a6c_8203_a78fea993367.slice/crio-255529cbcb3bfd7864e3f24abee8ecf2580b30d2a4f3630f5f3afe8305ecfb38 WatchSource:0}: Error finding container 255529cbcb3bfd7864e3f24abee8ecf2580b30d2a4f3630f5f3afe8305ecfb38: Status 404 returned error can't find the container with id 255529cbcb3bfd7864e3f24abee8ecf2580b30d2a4f3630f5f3afe8305ecfb38
Sep 14 10:42:45.178716 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:45.178684    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8" event={"ID":"3553a914-f1c6-4a6c-8203-a78fea993367","Type":"ContainerStarted","Data":"568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93"}
Sep 14 10:42:45.179242 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:45.178738    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8" event={"ID":"3553a914-f1c6-4a6c-8203-a78fea993367","Type":"ContainerStarted","Data":"255529cbcb3bfd7864e3f24abee8ecf2580b30d2a4f3630f5f3afe8305ecfb38"}
Sep 14 10:42:45.179242 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:45.178766    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:45.180444 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:45.180416    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf" event={"ID":"5d45d113-0aa0-4332-8c07-83cc3f686c82","Type":"ContainerStarted","Data":"aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236"}
Sep 14 10:42:45.180575 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:45.180474    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:45.200602 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:45.200535    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8" podStartSLOduration=2.200513726 podStartE2EDuration="2.200513726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:42:45.198982681 +0000 UTC m=+1088.084051791" watchObservedRunningTime="2026-09-14 10:42:45.200513726 +0000 UTC m=+1088.085582836"
Sep 14 10:42:45.219962 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:45.219901    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf" podStartSLOduration=2.21986412 podStartE2EDuration="2.21986412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:42:45.216496908 +0000 UTC m=+1088.101566030" watchObservedRunningTime="2026-09-14 10:42:45.21986412 +0000 UTC m=+1088.104933230"
Sep 14 10:42:49.081125 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.081091    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"]
Sep 14 10:42:49.081668 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.081367    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy" containerID="cri-o://4fe8bce0b1e8122dc1838b1e2f0a8f429120612545a1aedb4e1be4025b90d5d4" gracePeriod=30
Sep 14 10:42:49.427052 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.427014    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"]
Sep 14 10:42:49.430938 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.430917    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"
Sep 14 10:42:49.433632 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.433603    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:42:49.435601 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.435574    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"]
Sep 14 10:42:49.561409 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.561368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304a54fa-d97c-40e2-afcd-a484a70c4a51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4\" (UID: \"304a54fa-d97c-40e2-afcd-a484a70c4a51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"
Sep 14 10:42:49.662827 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.662785    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304a54fa-d97c-40e2-afcd-a484a70c4a51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4\" (UID: \"304a54fa-d97c-40e2-afcd-a484a70c4a51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"
Sep 14 10:42:49.663456 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.663435    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304a54fa-d97c-40e2-afcd-a484a70c4a51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4\" (UID: \"304a54fa-d97c-40e2-afcd-a484a70c4a51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"
Sep 14 10:42:49.745632 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:49.745537    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"
Sep 14 10:42:50.028498 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:50.028470    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"]
Sep 14 10:42:50.030929 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:42:50.030898    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304a54fa_d97c_40e2_afcd_a484a70c4a51.slice/crio-b1d225e8f9320c228e9a57d8f178d25739bdbeb785cec9172e4fff33f634f7f2 WatchSource:0}: Error finding container b1d225e8f9320c228e9a57d8f178d25739bdbeb785cec9172e4fff33f634f7f2: Status 404 returned error can't find the container with id b1d225e8f9320c228e9a57d8f178d25739bdbeb785cec9172e4fff33f634f7f2
Sep 14 10:42:50.216510 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:50.216477    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4" event={"ID":"304a54fa-d97c-40e2-afcd-a484a70c4a51","Type":"ContainerStarted","Data":"b1d225e8f9320c228e9a57d8f178d25739bdbeb785cec9172e4fff33f634f7f2"}
Sep 14 10:42:50.947748 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:50.947705    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"]
Sep 14 10:42:50.952522 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:50.952497    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:50.955346 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:50.955325    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1910e9\"/\"e2e-conflict-b-588c9108-kserve-self-signed-certs\""
Sep 14 10:42:50.956656 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:50.956630    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1910e9\"/\"kube-root-ca.crt\""
Sep 14 10:42:50.956839 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:50.956668    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1910e9\"/\"default-dockercfg-gcbgd\""
Sep 14 10:42:50.956969 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:50.956950    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1910e9\"/\"openshift-service-ca.crt\""
Sep 14 10:42:50.962959 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:50.962927    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"]
Sep 14 10:42:51.079655 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.079620    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-home\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.079655 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.079658    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tls-certs\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.079914 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.079700    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-dshm\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.079914 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.079745    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29qd9\" (UniqueName: \"kubernetes.io/projected/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-kube-api-access-29qd9\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.079914 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.079783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tmp-dir\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.079914 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.079818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-model-cache\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.181055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.180974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-home\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.181055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.181011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tls-certs\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.181268 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.181063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-dshm\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.181268 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.181103    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29qd9\" (UniqueName: \"kubernetes.io/projected/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-kube-api-access-29qd9\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.181268 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.181162    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tmp-dir\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.181268 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.181216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-model-cache\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.181490 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.181407    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-home\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.181582 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.181555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tmp-dir\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.181644 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.181572    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-model-cache\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.183601 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.183581    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-dshm\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.183760 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.183744    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tls-certs\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.189796 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.189768    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29qd9\" (UniqueName: \"kubernetes.io/projected/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-kube-api-access-29qd9\") pod \"e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") " pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.223959 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.223927    2574 generic.go:356] "Generic (PLEG): container finished" podID="304a54fa-d97c-40e2-afcd-a484a70c4a51" containerID="a68e26eec26aae321c30b53133598513e87b2564a34b14b6d37aeebae130b51d" exitCode=0
Sep 14 10:42:51.224333 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.224032    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4" event={"ID":"304a54fa-d97c-40e2-afcd-a484a70c4a51","Type":"ContainerDied","Data":"a68e26eec26aae321c30b53133598513e87b2564a34b14b6d37aeebae130b51d"}
Sep 14 10:42:51.269830 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.269799    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:42:51.548746 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:51.548717    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"]
Sep 14 10:42:51.550648 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:42:51.550619    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc657c2b3_ef5e_46ee_89f0_b5facd03ffc5.slice/crio-2e38a37ec5c36a54f130154fe5ff2281aa477268edeb3c382f162aad66b2030a WatchSource:0}: Error finding container 2e38a37ec5c36a54f130154fe5ff2281aa477268edeb3c382f162aad66b2030a: Status 404 returned error can't find the container with id 2e38a37ec5c36a54f130154fe5ff2281aa477268edeb3c382f162aad66b2030a
Sep 14 10:42:52.232257 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:52.232204    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk" event={"ID":"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5","Type":"ContainerStarted","Data":"3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94"}
Sep 14 10:42:52.232762 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:52.232272    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk" event={"ID":"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5","Type":"ContainerStarted","Data":"2e38a37ec5c36a54f130154fe5ff2281aa477268edeb3c382f162aad66b2030a"}
Sep 14 10:42:52.394233 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:52.394207    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"
Sep 14 10:42:52.411266 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:52.411204    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk" podStartSLOduration=2.4111815180000002 podStartE2EDuration="2.411181518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:42:52.254731821 +0000 UTC m=+1095.139800932" watchObservedRunningTime="2026-09-14 10:42:52.411181518 +0000 UTC m=+1095.296250628"
Sep 14 10:42:52.497746 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:52.497659    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304a54fa-d97c-40e2-afcd-a484a70c4a51-maas-api-service-ca\") pod \"304a54fa-d97c-40e2-afcd-a484a70c4a51\" (UID: \"304a54fa-d97c-40e2-afcd-a484a70c4a51\") "
Sep 14 10:42:52.498122 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:52.498093    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304a54fa-d97c-40e2-afcd-a484a70c4a51-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "304a54fa-d97c-40e2-afcd-a484a70c4a51" (UID: "304a54fa-d97c-40e2-afcd-a484a70c4a51"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:42:52.599364 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:52.599322    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304a54fa-d97c-40e2-afcd-a484a70c4a51-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:53.239924 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:53.239887    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"
Sep 14 10:42:53.239924 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:53.239906    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4" event={"ID":"304a54fa-d97c-40e2-afcd-a484a70c4a51","Type":"ContainerDied","Data":"b1d225e8f9320c228e9a57d8f178d25739bdbeb785cec9172e4fff33f634f7f2"}
Sep 14 10:42:53.240419 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:53.239953    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1d225e8f9320c228e9a57d8f178d25739bdbeb785cec9172e4fff33f634f7f2"
Sep 14 10:42:54.250619 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.250582    2574 generic.go:356] "Generic (PLEG): container finished" podID="85ca311d-639a-4f2a-adad-43c369ca829b" containerID="4fe8bce0b1e8122dc1838b1e2f0a8f429120612545a1aedb4e1be4025b90d5d4" exitCode=0
Sep 14 10:42:54.251009 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.250647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" event={"ID":"85ca311d-639a-4f2a-adad-43c369ca829b","Type":"ContainerDied","Data":"4fe8bce0b1e8122dc1838b1e2f0a8f429120612545a1aedb4e1be4025b90d5d4"}
Sep 14 10:42:54.251009 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.250711    2574 scope.go:117] "RemoveContainer" containerID="794382e526e4023349b3682b8649927909edc2c0989c3ef635a6f1974fdb2e61"
Sep 14 10:42:54.379603 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.379577    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:42:54.520922 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.520862    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-data\") pod \"85ca311d-639a-4f2a-adad-43c369ca829b\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") "
Sep 14 10:42:54.521100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.520940    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ca311d-639a-4f2a-adad-43c369ca829b-istio-podinfo\") pod \"85ca311d-639a-4f2a-adad-43c369ca829b\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") "
Sep 14 10:42:54.521100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.520968    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-credential-socket\") pod \"85ca311d-639a-4f2a-adad-43c369ca829b\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") "
Sep 14 10:42:54.521100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521028    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ca311d-639a-4f2a-adad-43c369ca829b-istiod-ca-cert\") pod \"85ca311d-639a-4f2a-adad-43c369ca829b\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") "
Sep 14 10:42:54.521100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521062    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-istio-token\") pod \"85ca311d-639a-4f2a-adad-43c369ca829b\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") "
Sep 14 10:42:54.521310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521104    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdxht\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-kube-api-access-kdxht\") pod \"85ca311d-639a-4f2a-adad-43c369ca829b\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") "
Sep 14 10:42:54.521310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521156    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-certs\") pod \"85ca311d-639a-4f2a-adad-43c369ca829b\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") "
Sep 14 10:42:54.521310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521199    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-socket\") pod \"85ca311d-639a-4f2a-adad-43c369ca829b\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") "
Sep 14 10:42:54.521310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521294    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-envoy\") pod \"85ca311d-639a-4f2a-adad-43c369ca829b\" (UID: \"85ca311d-639a-4f2a-adad-43c369ca829b\") "
Sep 14 10:42:54.521310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521302    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-data" (OuterVolumeSpecName: "istio-data") pod "85ca311d-639a-4f2a-adad-43c369ca829b" (UID: "85ca311d-639a-4f2a-adad-43c369ca829b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:42:54.521565 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521329    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85ca311d-639a-4f2a-adad-43c369ca829b" (UID: "85ca311d-639a-4f2a-adad-43c369ca829b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:42:54.521565 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521479    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85ca311d-639a-4f2a-adad-43c369ca829b" (UID: "85ca311d-639a-4f2a-adad-43c369ca829b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:42:54.521565 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85ca311d-639a-4f2a-adad-43c369ca829b" (UID: "85ca311d-639a-4f2a-adad-43c369ca829b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:42:54.521565 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521536    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85ca311d-639a-4f2a-adad-43c369ca829b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85ca311d-639a-4f2a-adad-43c369ca829b" (UID: "85ca311d-639a-4f2a-adad-43c369ca829b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:42:54.521761 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521744    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-credential-socket\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.521815 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521764    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ca311d-639a-4f2a-adad-43c369ca829b-istiod-ca-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.521815 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521779    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.521815 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521792    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-workload-socket\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.521815 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.521805    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-data\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.523706 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.523678    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-istio-token" (OuterVolumeSpecName: "istio-token") pod "85ca311d-639a-4f2a-adad-43c369ca829b" (UID: "85ca311d-639a-4f2a-adad-43c369ca829b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:42:54.523882 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.523846    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-kube-api-access-kdxht" (OuterVolumeSpecName: "kube-api-access-kdxht") pod "85ca311d-639a-4f2a-adad-43c369ca829b" (UID: "85ca311d-639a-4f2a-adad-43c369ca829b"). InnerVolumeSpecName "kube-api-access-kdxht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:42:54.523949 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.523910    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85ca311d-639a-4f2a-adad-43c369ca829b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85ca311d-639a-4f2a-adad-43c369ca829b" (UID: "85ca311d-639a-4f2a-adad-43c369ca829b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:42:54.524093 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.524066    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85ca311d-639a-4f2a-adad-43c369ca829b" (UID: "85ca311d-639a-4f2a-adad-43c369ca829b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:42:54.623470 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.623369    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ca311d-639a-4f2a-adad-43c369ca829b-istio-podinfo\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.623470 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.623416    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-istio-token\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.623470 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.623431    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdxht\" (UniqueName: \"kubernetes.io/projected/85ca311d-639a-4f2a-adad-43c369ca829b-kube-api-access-kdxht\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:54.623470 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:54.623444    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ca311d-639a-4f2a-adad-43c369ca829b-istio-envoy\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:42:55.259267 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:55.259235    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"
Sep 14 10:42:55.259712 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:55.259233    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj" event={"ID":"85ca311d-639a-4f2a-adad-43c369ca829b","Type":"ContainerDied","Data":"dc97e6b57792e33df61bac6b115fe84e72d11e2e96d6caa68f938315e14a3cfe"}
Sep 14 10:42:55.259712 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:55.259357    2574 scope.go:117] "RemoveContainer" containerID="4fe8bce0b1e8122dc1838b1e2f0a8f429120612545a1aedb4e1be4025b90d5d4"
Sep 14 10:42:55.285854 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:55.285822    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"]
Sep 14 10:42:55.289400 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:55.289371    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d36f67-openshift-default-66569bd74b-pfmlj"]
Sep 14 10:42:55.613350 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:55.613261    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" path="/var/lib/kubelet/pods/85ca311d-639a-4f2a-adad-43c369ca829b/volumes"
Sep 14 10:42:56.188456 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:56.188430    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:42:56.188643 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:56.188619    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:42:59.685968 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.685928    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7726-81b6ab"]
Sep 14 10:42:59.686676 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.686651    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy"
Sep 14 10:42:59.686787 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.686680    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy"
Sep 14 10:42:59.686787 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.686695    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304a54fa-d97c-40e2-afcd-a484a70c4a51" containerName="revoke-keys"
Sep 14 10:42:59.686787 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.686704    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="304a54fa-d97c-40e2-afcd-a484a70c4a51" containerName="revoke-keys"
Sep 14 10:42:59.686787 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.686718    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy"
Sep 14 10:42:59.686787 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.686727    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy"
Sep 14 10:42:59.687100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.686907    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy"
Sep 14 10:42:59.687100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.686921    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ca311d-639a-4f2a-adad-43c369ca829b" containerName="istio-proxy"
Sep 14 10:42:59.687100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.686931    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="304a54fa-d97c-40e2-afcd-a484a70c4a51" containerName="revoke-keys"
Sep 14 10:42:59.692142 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.692111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-81b6ab"
Sep 14 10:42:59.694293 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.694268    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7726-81b6ab"]
Sep 14 10:42:59.695320 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.695268    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pp8dj\""
Sep 14 10:42:59.778171 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.778139    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf429\" (UniqueName: \"kubernetes.io/projected/38017af0-0893-435b-b47f-921dce87e267-kube-api-access-vf429\") pod \"test-curl-7726-81b6ab\" (UID: \"38017af0-0893-435b-b47f-921dce87e267\") " pod="opendatahub/test-curl-7726-81b6ab"
Sep 14 10:42:59.825799 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.825761    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"]
Sep 14 10:42:59.828443 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.828413    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e9cc98-fq8f4"]
Sep 14 10:42:59.879319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.879280    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf429\" (UniqueName: \"kubernetes.io/projected/38017af0-0893-435b-b47f-921dce87e267-kube-api-access-vf429\") pod \"test-curl-7726-81b6ab\" (UID: \"38017af0-0893-435b-b47f-921dce87e267\") " pod="opendatahub/test-curl-7726-81b6ab"
Sep 14 10:42:59.888377 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:42:59.888347    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf429\" (UniqueName: \"kubernetes.io/projected/38017af0-0893-435b-b47f-921dce87e267-kube-api-access-vf429\") pod \"test-curl-7726-81b6ab\" (UID: \"38017af0-0893-435b-b47f-921dce87e267\") " pod="opendatahub/test-curl-7726-81b6ab"
Sep 14 10:43:00.006145 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:00.006046    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-81b6ab"
Sep 14 10:43:00.286005 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:00.285978    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7726-81b6ab"]
Sep 14 10:43:00.287690 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:43:00.287665    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38017af0_0893_435b_b47f_921dce87e267.slice/crio-a71fc876b65c69c31df3564be47635d171b49eb717fee7e8143331d0fe618442 WatchSource:0}: Error finding container a71fc876b65c69c31df3564be47635d171b49eb717fee7e8143331d0fe618442: Status 404 returned error can't find the container with id a71fc876b65c69c31df3564be47635d171b49eb717fee7e8143331d0fe618442
Sep 14 10:43:00.289678 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:00.289661    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:43:00.296921 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:00.296854    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7726-81b6ab" event={"ID":"38017af0-0893-435b-b47f-921dce87e267","Type":"ContainerStarted","Data":"a71fc876b65c69c31df3564be47635d171b49eb717fee7e8143331d0fe618442"}
Sep 14 10:43:01.270554 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:01.270457    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:43:01.270554 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:01.270507    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:43:01.284737 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:01.284708    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:43:01.307730 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:01.307693    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7726-81b6ab" event={"ID":"38017af0-0893-435b-b47f-921dce87e267","Type":"ContainerStarted","Data":"d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5"}
Sep 14 10:43:01.319378 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:01.319352    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:43:01.325197 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:01.325153    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7726-81b6ab" podStartSLOduration=1.685544514 podStartE2EDuration="2.325138842s" totalImagesPullingTime="639.594328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:01.322472804 +0000 UTC m=+1104.207541911" watchObservedRunningTime="2026-09-14 10:43:01.325138842 +0000 UTC m=+1104.210207977"
Sep 14 10:43:01.610294 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:01.610204    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="304a54fa-d97c-40e2-afcd-a484a70c4a51" path="/var/lib/kubelet/pods/304a54fa-d97c-40e2-afcd-a484a70c4a51/volumes"
Sep 14 10:43:01.952041 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:01.952004    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7726-81b6ab"]
Sep 14 10:43:01.954728 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:01.954697    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7726-81b6ab"]
Sep 14 10:43:02.077405 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.077370    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7726-820c01"]
Sep 14 10:43:02.077849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.077835    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38017af0-0893-435b-b47f-921dce87e267" containerName="test-curl-7726-81b6ab"
Sep 14 10:43:02.077849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.077849    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="38017af0-0893-435b-b47f-921dce87e267" containerName="test-curl-7726-81b6ab"
Sep 14 10:43:02.077981 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.077934    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="38017af0-0893-435b-b47f-921dce87e267" containerName="test-curl-7726-81b6ab"
Sep 14 10:43:02.081456 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.081431    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-820c01"
Sep 14 10:43:02.090825 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.090797    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7726-820c01"]
Sep 14 10:43:02.099012 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.098932    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbbc9\" (UniqueName: \"kubernetes.io/projected/884a9d7a-5a16-4c4b-ac93-49840a1911b6-kube-api-access-hbbc9\") pod \"test-curl-7726-820c01\" (UID: \"884a9d7a-5a16-4c4b-ac93-49840a1911b6\") " pod="opendatahub/test-curl-7726-820c01"
Sep 14 10:43:02.200076 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.200036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbbc9\" (UniqueName: \"kubernetes.io/projected/884a9d7a-5a16-4c4b-ac93-49840a1911b6-kube-api-access-hbbc9\") pod \"test-curl-7726-820c01\" (UID: \"884a9d7a-5a16-4c4b-ac93-49840a1911b6\") " pod="opendatahub/test-curl-7726-820c01"
Sep 14 10:43:02.209989 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.209902    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbbc9\" (UniqueName: \"kubernetes.io/projected/884a9d7a-5a16-4c4b-ac93-49840a1911b6-kube-api-access-hbbc9\") pod \"test-curl-7726-820c01\" (UID: \"884a9d7a-5a16-4c4b-ac93-49840a1911b6\") " pod="opendatahub/test-curl-7726-820c01"
Sep 14 10:43:02.313912 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:02.313888    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7726-81b6ab" container="test-curl-7726-81b6ab"
Sep 14 10:43:02.392048 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.392009    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-820c01"
Sep 14 10:43:02.680079 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:02.680026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7726-820c01"]
Sep 14 10:43:03.321426 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:03.321389    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7726-820c01" event={"ID":"884a9d7a-5a16-4c4b-ac93-49840a1911b6","Type":"ContainerStarted","Data":"a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e"}
Sep 14 10:43:03.321944 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:03.321438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7726-820c01" event={"ID":"884a9d7a-5a16-4c4b-ac93-49840a1911b6","Type":"ContainerStarted","Data":"ca33c72174cb682a63c81fdaef808ac3a3cc6529b681393cb80006113ad5d197"}
Sep 14 10:43:03.321944 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:03.321549    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7726-81b6ab" podUID="38017af0-0893-435b-b47f-921dce87e267" containerName="test-curl-7726-81b6ab" containerID="cri-o://d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5" gracePeriod=2
Sep 14 10:43:03.341120 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:03.341077    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7726-81b6ab\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="38017af0-0893-435b-b47f-921dce87e267" pod="opendatahub/test-curl-7726-81b6ab"
Sep 14 10:43:03.341596 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:03.341556    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7726-820c01" podStartSLOduration=1.341541885 podStartE2EDuration="1.341541885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:03.338801475 +0000 UTC m=+1106.223870584" watchObservedRunningTime="2026-09-14 10:43:03.341541885 +0000 UTC m=+1106.226610992"
Sep 14 10:43:03.961608 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:03.961574    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7726-820c01"]
Sep 14 10:43:03.966279 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:03.966250    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7726-820c01"]
Sep 14 10:43:04.089957 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.089856    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7726-e8ef00"]
Sep 14 10:43:04.090422 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.090403    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884a9d7a-5a16-4c4b-ac93-49840a1911b6" containerName="test-curl-7726-820c01"
Sep 14 10:43:04.090522 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.090425    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="884a9d7a-5a16-4c4b-ac93-49840a1911b6" containerName="test-curl-7726-820c01"
Sep 14 10:43:04.090583 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.090553    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="884a9d7a-5a16-4c4b-ac93-49840a1911b6" containerName="test-curl-7726-820c01"
Sep 14 10:43:04.093774 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.093750    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:04.097303 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.097274    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7726-e8ef00"]
Sep 14 10:43:04.120442 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.120411    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbjnx\" (UniqueName: \"kubernetes.io/projected/a59b8077-cd22-404a-9d84-6e67a05bdf54-kube-api-access-kbjnx\") pod \"test-curl-7726-e8ef00\" (UID: \"a59b8077-cd22-404a-9d84-6e67a05bdf54\") " pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:04.221387 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.221352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbjnx\" (UniqueName: \"kubernetes.io/projected/a59b8077-cd22-404a-9d84-6e67a05bdf54-kube-api-access-kbjnx\") pod \"test-curl-7726-e8ef00\" (UID: \"a59b8077-cd22-404a-9d84-6e67a05bdf54\") " pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:04.234708 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.234672    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbjnx\" (UniqueName: \"kubernetes.io/projected/a59b8077-cd22-404a-9d84-6e67a05bdf54-kube-api-access-kbjnx\") pod \"test-curl-7726-e8ef00\" (UID: \"a59b8077-cd22-404a-9d84-6e67a05bdf54\") " pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:04.327953 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:04.327923    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7726-820c01" container="test-curl-7726-820c01"
Sep 14 10:43:04.405470 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.405415    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:04.678428 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:04.678403    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7726-e8ef00"]
Sep 14 10:43:04.679711 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:43:04.679670    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda59b8077_cd22_404a_9d84_6e67a05bdf54.slice/crio-d5b4e3cd4d20b32885a719420009044e6b84f6b3080ed7a7e0f35c00eb2887a7 WatchSource:0}: Error finding container d5b4e3cd4d20b32885a719420009044e6b84f6b3080ed7a7e0f35c00eb2887a7: Status 404 returned error can't find the container with id d5b4e3cd4d20b32885a719420009044e6b84f6b3080ed7a7e0f35c00eb2887a7
Sep 14 10:43:05.336332 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.336296    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7726-e8ef00" event={"ID":"a59b8077-cd22-404a-9d84-6e67a05bdf54","Type":"ContainerStarted","Data":"dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1"}
Sep 14 10:43:05.336726 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.336343    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7726-e8ef00" event={"ID":"a59b8077-cd22-404a-9d84-6e67a05bdf54","Type":"ContainerStarted","Data":"d5b4e3cd4d20b32885a719420009044e6b84f6b3080ed7a7e0f35c00eb2887a7"}
Sep 14 10:43:05.336726 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.336597    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7726-820c01" podUID="884a9d7a-5a16-4c4b-ac93-49840a1911b6" containerName="test-curl-7726-820c01" containerID="cri-o://a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e" gracePeriod=2
Sep 14 10:43:05.353502 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.353435    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7726-e8ef00" podStartSLOduration=1.353418132 podStartE2EDuration="1.353418132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:05.352078061 +0000 UTC m=+1108.237147170" watchObservedRunningTime="2026-09-14 10:43:05.353418132 +0000 UTC m=+1108.238487239"
Sep 14 10:43:05.354482 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:05.354451    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7726-820c01\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="884a9d7a-5a16-4c4b-ac93-49840a1911b6" pod="opendatahub/test-curl-7726-820c01"
Sep 14 10:43:05.521249 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.521227    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-81b6ab"
Sep 14 10:43:05.524058 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:05.524032    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7726-820c01\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="884a9d7a-5a16-4c4b-ac93-49840a1911b6" pod="opendatahub/test-curl-7726-820c01"
Sep 14 10:43:05.533577 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.533550    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf429\" (UniqueName: \"kubernetes.io/projected/38017af0-0893-435b-b47f-921dce87e267-kube-api-access-vf429\") pod \"38017af0-0893-435b-b47f-921dce87e267\" (UID: \"38017af0-0893-435b-b47f-921dce87e267\") "
Sep 14 10:43:05.535757 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.535731    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38017af0-0893-435b-b47f-921dce87e267-kube-api-access-vf429" (OuterVolumeSpecName: "kube-api-access-vf429") pod "38017af0-0893-435b-b47f-921dce87e267" (UID: "38017af0-0893-435b-b47f-921dce87e267"). InnerVolumeSpecName "kube-api-access-vf429". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:43:05.618942 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.613182    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38017af0-0893-435b-b47f-921dce87e267" path="/var/lib/kubelet/pods/38017af0-0893-435b-b47f-921dce87e267/volumes"
Sep 14 10:43:05.635226 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.635174    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf429\" (UniqueName: \"kubernetes.io/projected/38017af0-0893-435b-b47f-921dce87e267-kube-api-access-vf429\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:05.955363 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.955327    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7726-e8ef00"]
Sep 14 10:43:05.957917 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:05.957885    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7726-e8ef00"]
Sep 14 10:43:06.075685 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.075646    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7726-2a30b7"]
Sep 14 10:43:06.076129 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.076116    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59b8077-cd22-404a-9d84-6e67a05bdf54" containerName="test-curl-7726-e8ef00"
Sep 14 10:43:06.076195 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.076131    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59b8077-cd22-404a-9d84-6e67a05bdf54" containerName="test-curl-7726-e8ef00"
Sep 14 10:43:06.076232 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.076202    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59b8077-cd22-404a-9d84-6e67a05bdf54" containerName="test-curl-7726-e8ef00"
Sep 14 10:43:06.079507 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.079487    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-2a30b7"
Sep 14 10:43:06.086022 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.085990    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7726-2a30b7"]
Sep 14 10:43:06.140130 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.140087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjcd9\" (UniqueName: \"kubernetes.io/projected/31a2a1c3-2fbe-4f23-8929-94e373541596-kube-api-access-sjcd9\") pod \"test-curl-7726-2a30b7\" (UID: \"31a2a1c3-2fbe-4f23-8929-94e373541596\") " pod="opendatahub/test-curl-7726-2a30b7"
Sep 14 10:43:06.241258 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.241170    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjcd9\" (UniqueName: \"kubernetes.io/projected/31a2a1c3-2fbe-4f23-8929-94e373541596-kube-api-access-sjcd9\") pod \"test-curl-7726-2a30b7\" (UID: \"31a2a1c3-2fbe-4f23-8929-94e373541596\") " pod="opendatahub/test-curl-7726-2a30b7"
Sep 14 10:43:06.249889 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.249853    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjcd9\" (UniqueName: \"kubernetes.io/projected/31a2a1c3-2fbe-4f23-8929-94e373541596-kube-api-access-sjcd9\") pod \"test-curl-7726-2a30b7\" (UID: \"31a2a1c3-2fbe-4f23-8929-94e373541596\") " pod="opendatahub/test-curl-7726-2a30b7"
Sep 14 10:43:06.344974 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.344938    2574 generic.go:356] "Generic (PLEG): container finished" podID="38017af0-0893-435b-b47f-921dce87e267" containerID="d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5" exitCode=137
Sep 14 10:43:06.345425 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.344997    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-81b6ab"
Sep 14 10:43:06.345425 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.345006    2574 scope.go:117] "RemoveContainer" containerID="d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5"
Sep 14 10:43:06.345425 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:06.345368    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7726-e8ef00" container="test-curl-7726-e8ef00"
Sep 14 10:43:06.354491 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.354467    2574 scope.go:117] "RemoveContainer" containerID="d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5"
Sep 14 10:43:06.354819 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:06.354799    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5\": container with ID starting with d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5 not found: ID does not exist" containerID="d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5"
Sep 14 10:43:06.354940 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.354830    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5"} err="failed to get container status \"d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5\": rpc error: code = NotFound desc = could not find container \"d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5\": container with ID starting with d1bf4a7ab7ad583354871bc744e266ab6946ba2871d51cba55c338f3bae085a5 not found: ID does not exist"
Sep 14 10:43:06.392054 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.392018    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-2a30b7"
Sep 14 10:43:06.620661 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.620569    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"]
Sep 14 10:43:06.620907 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.620863    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy" containerID="cri-o://f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501" gracePeriod=30
Sep 14 10:43:06.671659 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:06.671634    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7726-2a30b7"]
Sep 14 10:43:06.673918 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:43:06.673884    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31a2a1c3_2fbe_4f23_8929_94e373541596.slice/crio-9f6e35d607958363f49503230c7d447a9595166b882ad33a888d29429c4e8f3c WatchSource:0}: Error finding container 9f6e35d607958363f49503230c7d447a9595166b882ad33a888d29429c4e8f3c: Status 404 returned error can't find the container with id 9f6e35d607958363f49503230c7d447a9595166b882ad33a888d29429c4e8f3c
Sep 14 10:43:07.356112 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:07.356082    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7726-2a30b7" event={"ID":"31a2a1c3-2fbe-4f23-8929-94e373541596","Type":"ContainerStarted","Data":"61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc"}
Sep 14 10:43:07.356436 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:07.356128    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7726-2a30b7" event={"ID":"31a2a1c3-2fbe-4f23-8929-94e373541596","Type":"ContainerStarted","Data":"9f6e35d607958363f49503230c7d447a9595166b882ad33a888d29429c4e8f3c"}
Sep 14 10:43:07.356436 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:07.356240    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7726-e8ef00" podUID="a59b8077-cd22-404a-9d84-6e67a05bdf54" containerName="test-curl-7726-e8ef00" containerID="cri-o://dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1" gracePeriod=2
Sep 14 10:43:07.374611 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:07.374564    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7726-e8ef00\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="a59b8077-cd22-404a-9d84-6e67a05bdf54" pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:07.375394 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:07.375350    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7726-2a30b7" podStartSLOduration=1.375334313 podStartE2EDuration="1.375334313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:07.372172951 +0000 UTC m=+1110.257242059" watchObservedRunningTime="2026-09-14 10:43:07.375334313 +0000 UTC m=+1110.260403422"
Sep 14 10:43:07.533371 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:07.533345    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-820c01"
Sep 14 10:43:07.535758 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:07.535727    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7726-e8ef00\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="a59b8077-cd22-404a-9d84-6e67a05bdf54" pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:07.556849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:07.556806    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbbc9\" (UniqueName: \"kubernetes.io/projected/884a9d7a-5a16-4c4b-ac93-49840a1911b6-kube-api-access-hbbc9\") pod \"884a9d7a-5a16-4c4b-ac93-49840a1911b6\" (UID: \"884a9d7a-5a16-4c4b-ac93-49840a1911b6\") "
Sep 14 10:43:07.561598 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:07.561543    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884a9d7a-5a16-4c4b-ac93-49840a1911b6-kube-api-access-hbbc9" (OuterVolumeSpecName: "kube-api-access-hbbc9") pod "884a9d7a-5a16-4c4b-ac93-49840a1911b6" (UID: "884a9d7a-5a16-4c4b-ac93-49840a1911b6"). InnerVolumeSpecName "kube-api-access-hbbc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:43:07.608810 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:07.608718    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7726-e8ef00\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="a59b8077-cd22-404a-9d84-6e67a05bdf54" pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:07.610851 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:07.610823    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="884a9d7a-5a16-4c4b-ac93-49840a1911b6" path="/var/lib/kubelet/pods/884a9d7a-5a16-4c4b-ac93-49840a1911b6/volumes"
Sep 14 10:43:07.658000 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:07.657966    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbbc9\" (UniqueName: \"kubernetes.io/projected/884a9d7a-5a16-4c4b-ac93-49840a1911b6-kube-api-access-hbbc9\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:08.012158 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:08.012112    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7726-2a30b7"]
Sep 14 10:43:08.019321 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:08.019289    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7726-2a30b7"]
Sep 14 10:43:08.364134 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:08.364033    2574 generic.go:356] "Generic (PLEG): container finished" podID="884a9d7a-5a16-4c4b-ac93-49840a1911b6" containerID="a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e" exitCode=137
Sep 14 10:43:08.364134 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:08.364084    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-820c01"
Sep 14 10:43:08.364636 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:08.364157    2574 scope.go:117] "RemoveContainer" containerID="a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e"
Sep 14 10:43:08.364636 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:08.364497    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7726-2a30b7" container="test-curl-7726-2a30b7"
Sep 14 10:43:08.377401 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:08.377375    2574 scope.go:117] "RemoveContainer" containerID="a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e"
Sep 14 10:43:08.377766 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:08.377743    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e\": container with ID starting with a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e not found: ID does not exist" containerID="a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e"
Sep 14 10:43:08.377903 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:08.377775    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e"} err="failed to get container status \"a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e\": rpc error: code = NotFound desc = could not find container \"a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e\": container with ID starting with a91e59c19b8e80aaafc776fa51135beb32e39896c459b7605d4f73e1f3370c2e not found: ID does not exist"
Sep 14 10:43:09.371571 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:09.371532    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7726-2a30b7" podUID="31a2a1c3-2fbe-4f23-8929-94e373541596" containerName="test-curl-7726-2a30b7" containerID="cri-o://61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc" gracePeriod=2
Sep 14 10:43:09.373981 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:09.373955    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7726-2a30b7\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="31a2a1c3-2fbe-4f23-8929-94e373541596" pod="opendatahub/test-curl-7726-2a30b7"
Sep 14 10:43:09.520815 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:09.520789    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:09.523157 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:09.523124    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7726-2a30b7\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="31a2a1c3-2fbe-4f23-8929-94e373541596" pod="opendatahub/test-curl-7726-2a30b7"
Sep 14 10:43:09.578616 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:09.578585    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbjnx\" (UniqueName: \"kubernetes.io/projected/a59b8077-cd22-404a-9d84-6e67a05bdf54-kube-api-access-kbjnx\") pod \"a59b8077-cd22-404a-9d84-6e67a05bdf54\" (UID: \"a59b8077-cd22-404a-9d84-6e67a05bdf54\") "
Sep 14 10:43:09.581018 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:09.580987    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59b8077-cd22-404a-9d84-6e67a05bdf54-kube-api-access-kbjnx" (OuterVolumeSpecName: "kube-api-access-kbjnx") pod "a59b8077-cd22-404a-9d84-6e67a05bdf54" (UID: "a59b8077-cd22-404a-9d84-6e67a05bdf54"). InnerVolumeSpecName "kube-api-access-kbjnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:43:09.612578 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:09.612500    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a59b8077-cd22-404a-9d84-6e67a05bdf54" path="/var/lib/kubelet/pods/a59b8077-cd22-404a-9d84-6e67a05bdf54/volumes"
Sep 14 10:43:09.680171 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:09.680138    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbjnx\" (UniqueName: \"kubernetes.io/projected/a59b8077-cd22-404a-9d84-6e67a05bdf54-kube-api-access-kbjnx\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:10.379925 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:10.379885    2574 generic.go:356] "Generic (PLEG): container finished" podID="a59b8077-cd22-404a-9d84-6e67a05bdf54" containerID="dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1" exitCode=137
Sep 14 10:43:10.380379 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:10.379962    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-e8ef00"
Sep 14 10:43:10.380379 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:10.379982    2574 scope.go:117] "RemoveContainer" containerID="dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1"
Sep 14 10:43:10.390306 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:10.390238    2574 scope.go:117] "RemoveContainer" containerID="dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1"
Sep 14 10:43:10.390698 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:10.390677    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1\": container with ID starting with dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1 not found: ID does not exist" containerID="dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1"
Sep 14 10:43:10.390783 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:10.390706    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1"} err="failed to get container status \"dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1\": rpc error: code = NotFound desc = could not find container \"dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1\": container with ID starting with dbdf582541cda4d34be051ff2084a8f89cfd821e533c34f8b821bfa82999dad1 not found: ID does not exist"
Sep 14 10:43:11.427995 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:11.427931    2574 patch_prober.go:28] interesting pod/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:43:11.428458 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:11.428005    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:43:11.563326 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:11.563301    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-2a30b7"
Sep 14 10:43:11.600816 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:11.600788    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjcd9\" (UniqueName: \"kubernetes.io/projected/31a2a1c3-2fbe-4f23-8929-94e373541596-kube-api-access-sjcd9\") pod \"31a2a1c3-2fbe-4f23-8929-94e373541596\" (UID: \"31a2a1c3-2fbe-4f23-8929-94e373541596\") "
Sep 14 10:43:11.607958 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:11.604117    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31a2a1c3-2fbe-4f23-8929-94e373541596-kube-api-access-sjcd9" (OuterVolumeSpecName: "kube-api-access-sjcd9") pod "31a2a1c3-2fbe-4f23-8929-94e373541596" (UID: "31a2a1c3-2fbe-4f23-8929-94e373541596"). InnerVolumeSpecName "kube-api-access-sjcd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:43:11.613609 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:11.613578    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31a2a1c3-2fbe-4f23-8929-94e373541596" path="/var/lib/kubelet/pods/31a2a1c3-2fbe-4f23-8929-94e373541596/volumes"
Sep 14 10:43:11.702720 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:11.702687    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjcd9\" (UniqueName: \"kubernetes.io/projected/31a2a1c3-2fbe-4f23-8929-94e373541596-kube-api-access-sjcd9\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:11.879648 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:11.879625    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:43:12.007304 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007267    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-envoy\") pod \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") "
Sep 14 10:43:12.007504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007325    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-data\") pod \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") "
Sep 14 10:43:12.007504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007354    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-certs\") pod \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") "
Sep 14 10:43:12.007504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007395    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-podinfo\") pod \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") "
Sep 14 10:43:12.007504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007462    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fgrp\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-kube-api-access-7fgrp\") pod \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") "
Sep 14 10:43:12.007504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007487    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-token\") pod \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") "
Sep 14 10:43:12.007764 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007547    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istiod-ca-cert\") pod \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") "
Sep 14 10:43:12.007764 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007619    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-credential-socket\") pod \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") "
Sep 14 10:43:12.007764 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007626    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "9139bc5f-b0c6-453f-bc05-27d5caffd2c1" (UID: "9139bc5f-b0c6-453f-bc05-27d5caffd2c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:43:12.007764 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007692    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-socket\") pod \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\" (UID: \"9139bc5f-b0c6-453f-bc05-27d5caffd2c1\") "
Sep 14 10:43:12.007946 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.007904    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9139bc5f-b0c6-453f-bc05-27d5caffd2c1" (UID: "9139bc5f-b0c6-453f-bc05-27d5caffd2c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:43:12.008145 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.008125    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9139bc5f-b0c6-453f-bc05-27d5caffd2c1" (UID: "9139bc5f-b0c6-453f-bc05-27d5caffd2c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:43:12.008205 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.008190    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-credential-socket\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:12.008239 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.008212    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-data\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:12.008656 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.008624    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9139bc5f-b0c6-453f-bc05-27d5caffd2c1" (UID: "9139bc5f-b0c6-453f-bc05-27d5caffd2c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:43:12.009003 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.008635    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9139bc5f-b0c6-453f-bc05-27d5caffd2c1" (UID: "9139bc5f-b0c6-453f-bc05-27d5caffd2c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:43:12.010516 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.010482    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-kube-api-access-7fgrp" (OuterVolumeSpecName: "kube-api-access-7fgrp") pod "9139bc5f-b0c6-453f-bc05-27d5caffd2c1" (UID: "9139bc5f-b0c6-453f-bc05-27d5caffd2c1"). InnerVolumeSpecName "kube-api-access-7fgrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:43:12.010657 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.010640    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "9139bc5f-b0c6-453f-bc05-27d5caffd2c1" (UID: "9139bc5f-b0c6-453f-bc05-27d5caffd2c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:43:12.010935 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.010901    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9139bc5f-b0c6-453f-bc05-27d5caffd2c1" (UID: "9139bc5f-b0c6-453f-bc05-27d5caffd2c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:43:12.011252 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.011230    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9139bc5f-b0c6-453f-bc05-27d5caffd2c1" (UID: "9139bc5f-b0c6-453f-bc05-27d5caffd2c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:43:12.109354 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.109319    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-socket\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:12.109354 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.109350    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-envoy\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:12.109571 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.109364    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-workload-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:12.109571 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.109375    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-podinfo\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:12.109571 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.109386    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fgrp\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-kube-api-access-7fgrp\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:12.109571 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.109399    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istio-token\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:12.109571 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.109409    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9139bc5f-b0c6-453f-bc05-27d5caffd2c1-istiod-ca-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:43:12.396816 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.396786    2574 generic.go:356] "Generic (PLEG): container finished" podID="31a2a1c3-2fbe-4f23-8929-94e373541596" containerID="61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc" exitCode=137
Sep 14 10:43:12.397012 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.396846    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7726-2a30b7"
Sep 14 10:43:12.397012 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.396947    2574 scope.go:117] "RemoveContainer" containerID="61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc"
Sep 14 10:43:12.399159 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.399134    2574 generic.go:356] "Generic (PLEG): container finished" podID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerID="f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501" exitCode=0
Sep 14 10:43:12.399280 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.399252    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"
Sep 14 10:43:12.399338 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.399279    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" event={"ID":"9139bc5f-b0c6-453f-bc05-27d5caffd2c1","Type":"ContainerDied","Data":"f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501"}
Sep 14 10:43:12.399415 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.399336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57" event={"ID":"9139bc5f-b0c6-453f-bc05-27d5caffd2c1","Type":"ContainerDied","Data":"c2ac64a0a71b26525dc0de340dbccc17df3ac67c11e3773022f0c09409c29ebd"}
Sep 14 10:43:12.411473 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.411417    2574 scope.go:117] "RemoveContainer" containerID="61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc"
Sep 14 10:43:12.411803 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:12.411775    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc\": container with ID starting with 61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc not found: ID does not exist" containerID="61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc"
Sep 14 10:43:12.411920 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.411809    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc"} err="failed to get container status \"61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc\": rpc error: code = NotFound desc = could not find container \"61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc\": container with ID starting with 61aff45a88e2333cbee1a4570a7549481e8cd713389a0b7d41fd7c8f78cb44bc not found: ID does not exist"
Sep 14 10:43:12.411920 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.411834    2574 scope.go:117] "RemoveContainer" containerID="f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501"
Sep 14 10:43:12.421072 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.421052    2574 scope.go:117] "RemoveContainer" containerID="ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13"
Sep 14 10:43:12.424743 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.424717    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"]
Sep 14 10:43:12.430502 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.430473    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e9cc98-openshift-default-84976fb6d6-ptq57"]
Sep 14 10:43:12.433133 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.433115    2574 scope.go:117] "RemoveContainer" containerID="f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501"
Sep 14 10:43:12.433455 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:12.433437    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501\": container with ID starting with f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501 not found: ID does not exist" containerID="f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501"
Sep 14 10:43:12.433529 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.433463    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501"} err="failed to get container status \"f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501\": rpc error: code = NotFound desc = could not find container \"f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501\": container with ID starting with f82e337950722c9e712ec024404070f6bda9f83db1ec94a1a792a68d35817501 not found: ID does not exist"
Sep 14 10:43:12.433529 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.433482    2574 scope.go:117] "RemoveContainer" containerID="ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13"
Sep 14 10:43:12.433777 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:43:12.433752    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13\": container with ID starting with ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13 not found: ID does not exist" containerID="ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13"
Sep 14 10:43:12.433815 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:12.433790    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13"} err="failed to get container status \"ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13\": rpc error: code = NotFound desc = could not find container \"ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13\": container with ID starting with ea355ae478bee8088238896889dfc3aad0dc70f5f53d1a49849178c4b804fc13 not found: ID does not exist"
Sep 14 10:43:13.611970 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:13.611933    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" path="/var/lib/kubelet/pods/9139bc5f-b0c6-453f-bc05-27d5caffd2c1/volumes"
Sep 14 10:43:14.551511 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.551478    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"]
Sep 14 10:43:14.551963 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.551950    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy"
Sep 14 10:43:14.552011 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.551965    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy"
Sep 14 10:43:14.552011 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.551983    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a2a1c3-2fbe-4f23-8929-94e373541596" containerName="test-curl-7726-2a30b7"
Sep 14 10:43:14.552011 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.551989    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a2a1c3-2fbe-4f23-8929-94e373541596" containerName="test-curl-7726-2a30b7"
Sep 14 10:43:14.552103 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.552080    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="31a2a1c3-2fbe-4f23-8929-94e373541596" containerName="test-curl-7726-2a30b7"
Sep 14 10:43:14.552103 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.552092    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy"
Sep 14 10:43:14.552103 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.552097    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy"
Sep 14 10:43:14.556936 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.556918    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:14.559864 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.559835    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-1cbcd0\""
Sep 14 10:43:14.560009 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.559973    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-1cbcd0-dockercfg-wdnmj\""
Sep 14 10:43:14.566497 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.566473    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"]
Sep 14 10:43:14.636068 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.636033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23930b48-e0a9-4cc0-a4e2-688b641cea7d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6\" (UID: \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:14.636584 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.636103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgrl2\" (UniqueName: \"kubernetes.io/projected/23930b48-e0a9-4cc0-a4e2-688b641cea7d-kube-api-access-qgrl2\") pod \"payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6\" (UID: \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:14.737337 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.737308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23930b48-e0a9-4cc0-a4e2-688b641cea7d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6\" (UID: \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:14.737497 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.737375    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgrl2\" (UniqueName: \"kubernetes.io/projected/23930b48-e0a9-4cc0-a4e2-688b641cea7d-kube-api-access-qgrl2\") pod \"payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6\" (UID: \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:14.738028 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.738008    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23930b48-e0a9-4cc0-a4e2-688b641cea7d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6\" (UID: \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:14.746024 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.745999    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgrl2\" (UniqueName: \"kubernetes.io/projected/23930b48-e0a9-4cc0-a4e2-688b641cea7d-kube-api-access-qgrl2\") pod \"payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6\" (UID: \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:14.868948 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:14.868841    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:15.166597 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.166573    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"]
Sep 14 10:43:15.168073 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:43:15.168050    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23930b48_e0a9_4cc0_a4e2_688b641cea7d.slice/crio-05be97562d7dfd61c357a7e1d26ea9ecc1dbb1a68645c1513755150f9e15e1f6 WatchSource:0}: Error finding container 05be97562d7dfd61c357a7e1d26ea9ecc1dbb1a68645c1513755150f9e15e1f6: Status 404 returned error can't find the container with id 05be97562d7dfd61c357a7e1d26ea9ecc1dbb1a68645c1513755150f9e15e1f6
Sep 14 10:43:15.426406 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.426313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6" event={"ID":"23930b48-e0a9-4cc0-a4e2-688b641cea7d","Type":"ContainerStarted","Data":"3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520"}
Sep 14 10:43:15.426406 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.426384    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6" event={"ID":"23930b48-e0a9-4cc0-a4e2-688b641cea7d","Type":"ContainerStarted","Data":"05be97562d7dfd61c357a7e1d26ea9ecc1dbb1a68645c1513755150f9e15e1f6"}
Sep 14 10:43:15.426622 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.426427    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:15.596478 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.596417    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6" podStartSLOduration=1.596396231 podStartE2EDuration="1.596396231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:15.452813733 +0000 UTC m=+1118.337882841" watchObservedRunningTime="2026-09-14 10:43:15.596396231 +0000 UTC m=+1118.481465530"
Sep 14 10:43:15.597265 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.597242    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"]
Sep 14 10:43:15.597765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.597749    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy"
Sep 14 10:43:15.597847 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.597769    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9139bc5f-b0c6-453f-bc05-27d5caffd2c1" containerName="istio-proxy"
Sep 14 10:43:15.601178 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.601156    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:15.604016 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.603992    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5bbd7765\""
Sep 14 10:43:15.604112 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.604050    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5bbd7765-dockercfg-r7rvt\""
Sep 14 10:43:15.614945 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.614916    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"]
Sep 14 10:43:15.646500 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.646457    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62151f5f-faf5-45b6-92ea-f52559b5b444-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q\" (UID: \"62151f5f-faf5-45b6-92ea-f52559b5b444\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:15.646500 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.646517    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mfhg\" (UniqueName: \"kubernetes.io/projected/62151f5f-faf5-45b6-92ea-f52559b5b444-kube-api-access-5mfhg\") pod \"payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q\" (UID: \"62151f5f-faf5-45b6-92ea-f52559b5b444\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:15.748156 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.748071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62151f5f-faf5-45b6-92ea-f52559b5b444-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q\" (UID: \"62151f5f-faf5-45b6-92ea-f52559b5b444\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:15.748156 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.748110    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mfhg\" (UniqueName: \"kubernetes.io/projected/62151f5f-faf5-45b6-92ea-f52559b5b444-kube-api-access-5mfhg\") pod \"payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q\" (UID: \"62151f5f-faf5-45b6-92ea-f52559b5b444\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:15.748964 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.748940    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62151f5f-faf5-45b6-92ea-f52559b5b444-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q\" (UID: \"62151f5f-faf5-45b6-92ea-f52559b5b444\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:15.757177 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.757152    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mfhg\" (UniqueName: \"kubernetes.io/projected/62151f5f-faf5-45b6-92ea-f52559b5b444-kube-api-access-5mfhg\") pod \"payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q\" (UID: \"62151f5f-faf5-45b6-92ea-f52559b5b444\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:15.916778 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:15.916732    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:16.203238 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:16.203205    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"]
Sep 14 10:43:16.205516 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:43:16.205433    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62151f5f_faf5_45b6_92ea_f52559b5b444.slice/crio-4cd37b34d5a41d5f215c84fde772d471ff932785cb573e0910a1f2a3d290732f WatchSource:0}: Error finding container 4cd37b34d5a41d5f215c84fde772d471ff932785cb573e0910a1f2a3d290732f: Status 404 returned error can't find the container with id 4cd37b34d5a41d5f215c84fde772d471ff932785cb573e0910a1f2a3d290732f
Sep 14 10:43:16.436658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:16.436606    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q" event={"ID":"62151f5f-faf5-45b6-92ea-f52559b5b444","Type":"ContainerStarted","Data":"88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b"}
Sep 14 10:43:16.436810 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:16.436673    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q" event={"ID":"62151f5f-faf5-45b6-92ea-f52559b5b444","Type":"ContainerStarted","Data":"4cd37b34d5a41d5f215c84fde772d471ff932785cb573e0910a1f2a3d290732f"}
Sep 14 10:43:16.437033 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:16.437017    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:16.454262 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:16.454177    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q" podStartSLOduration=1.454161538 podStartE2EDuration="1.454161538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:16.453249131 +0000 UTC m=+1119.338318252" watchObservedRunningTime="2026-09-14 10:43:16.454161538 +0000 UTC m=+1119.339230645"
Sep 14 10:43:26.438843 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:26.438805    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:43:27.446426 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:27.446395    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:43:47.388088 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.388047    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"]
Sep 14 10:43:47.394051 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.394023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:43:47.397421 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.397397    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-7bdcda\""
Sep 14 10:43:47.397712 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.397696    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-7bdcda-dockercfg-zc6hf\""
Sep 14 10:43:47.410406 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.410378    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"]
Sep 14 10:43:47.494474 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.494430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nclm9\" (UniqueName: \"kubernetes.io/projected/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-kube-api-access-nclm9\") pod \"payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w\" (UID: \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:43:47.494740 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.494549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w\" (UID: \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:43:47.595673 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.595629    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nclm9\" (UniqueName: \"kubernetes.io/projected/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-kube-api-access-nclm9\") pod \"payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w\" (UID: \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:43:47.595850 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.595695    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w\" (UID: \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:43:47.596397 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.596379    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w\" (UID: \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:43:47.605817 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.605784    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nclm9\" (UniqueName: \"kubernetes.io/projected/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-kube-api-access-nclm9\") pod \"payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w\" (UID: \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:43:47.710796 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.710758    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:43:47.990627 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:47.990484    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"]
Sep 14 10:43:47.994776 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:43:47.994745    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324e53cc_32b2_46f1_b7f6_9fbbf85cbd0f.slice/crio-7b54831277132a84ccc67eee31738c4a4b4763acddd9f86695fb63351527e7f8 WatchSource:0}: Error finding container 7b54831277132a84ccc67eee31738c4a4b4763acddd9f86695fb63351527e7f8: Status 404 returned error can't find the container with id 7b54831277132a84ccc67eee31738c4a4b4763acddd9f86695fb63351527e7f8
Sep 14 10:43:48.650311 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:48.650274    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w" event={"ID":"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f","Type":"ContainerStarted","Data":"af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe"}
Sep 14 10:43:48.650983 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:48.650963    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:43:48.651122 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:48.651103    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w" event={"ID":"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f","Type":"ContainerStarted","Data":"7b54831277132a84ccc67eee31738c4a4b4763acddd9f86695fb63351527e7f8"}
Sep 14 10:43:48.673722 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:43:48.673671    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w" podStartSLOduration=1.673656109 podStartE2EDuration="1.673656109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:43:48.671746132 +0000 UTC m=+1151.556815241" watchObservedRunningTime="2026-09-14 10:43:48.673656109 +0000 UTC m=+1151.558725220"
Sep 14 10:44:00.665358 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:00.665271    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:44:28.672035 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.671993    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"]
Sep 14 10:44:28.676523 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.676498    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.679662 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.679636    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-85d3ec\"/\"distinct-2-w0-85d3ec-kserve-self-signed-certs\""
Sep 14 10:44:28.688543 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.688521    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"]
Sep 14 10:44:28.711674 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.711640    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tmp-dir\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.711863 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.711722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-dshm\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.711863 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.711757    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrqgp\" (UniqueName: \"kubernetes.io/projected/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-kube-api-access-wrqgp\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.711863 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.711798    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-model-cache\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.711863 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.711819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tls-certs\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.712108 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.711959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-home\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.812772 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.812738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tmp-dir\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.812994 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.812809    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-dshm\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.812994 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.812860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrqgp\" (UniqueName: \"kubernetes.io/projected/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-kube-api-access-wrqgp\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.812994 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.812966    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-model-cache\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.813155 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.812995    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tls-certs\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.813155 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.813040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-home\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.813282 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.813259    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tmp-dir\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.813354 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.813335    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-model-cache\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.813419 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.813354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-home\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.815401 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.815364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-dshm\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.815650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.815632    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tls-certs\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.825429 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.825388    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrqgp\" (UniqueName: \"kubernetes.io/projected/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-kube-api-access-wrqgp\") pod \"distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") " pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:28.986465 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:28.986367    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:29.274206 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:29.274182    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"]
Sep 14 10:44:29.276207 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:44:29.276179    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcd83e09_c3f5_4c04_85cf_ab1fcdf69201.slice/crio-8a2079651800ee929b8cdb09790e01b4e1423a28f7c7252aad71a927def7c4a0 WatchSource:0}: Error finding container 8a2079651800ee929b8cdb09790e01b4e1423a28f7c7252aad71a927def7c4a0: Status 404 returned error can't find the container with id 8a2079651800ee929b8cdb09790e01b4e1423a28f7c7252aad71a927def7c4a0
Sep 14 10:44:29.907765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:29.907728    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5" event={"ID":"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201","Type":"ContainerStarted","Data":"e9080ae81eb533295fc90f29b2e4846a45da36f6d02f3351d45c5e88d36d7716"}
Sep 14 10:44:29.908244 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:29.907781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5" event={"ID":"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201","Type":"ContainerStarted","Data":"8a2079651800ee929b8cdb09790e01b4e1423a28f7c7252aad71a927def7c4a0"}
Sep 14 10:44:29.930353 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:29.930293    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5" podStartSLOduration=1.930274909 podStartE2EDuration="1.930274909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:44:29.927801004 +0000 UTC m=+1192.812870115" watchObservedRunningTime="2026-09-14 10:44:29.930274909 +0000 UTC m=+1192.815344016"
Sep 14 10:44:37.812940 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:37.812903    2574 scope.go:117] "RemoveContainer" containerID="d13e0063a6aee6a7aa2165e79ebaaeaf056d64575b3a7319472549c544c912e5"
Sep 14 10:44:37.823056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:37.823029    2574 scope.go:117] "RemoveContainer" containerID="e97923fc224ab61d4f8f86777438968fde6a7f09b75e134171174776ad252f3e"
Sep 14 10:44:38.177575 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:38.177549    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:44:38.185189 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:38.185166    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:44:38.987442 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:38.987343    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:38.987902 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:38.987468    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:39.000638 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:39.000611    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:44:39.981889 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:44:39.981842    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:45:00.162488 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.162454    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst"]
Sep 14 10:45:00.167941 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.167920    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z"]
Sep 14 10:45:00.168060 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.168040    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst"
Sep 14 10:45:00.171684 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.171664    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r"]
Sep 14 10:45:00.171813 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.171788    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z"
Sep 14 10:45:00.172292 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.172277    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:45:00.175514 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.175177    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc"]
Sep 14 10:45:00.175514 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.175267    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r"
Sep 14 10:45:00.179277 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.179257    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc"
Sep 14 10:45:00.183125 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.183100    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc"]
Sep 14 10:45:00.183316 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.183224    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst"
Sep 14 10:45:00.192483 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.192449    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r"]
Sep 14 10:45:00.194067 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.193250    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z"
Sep 14 10:45:00.196600 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.196481    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst"]
Sep 14 10:45:00.200566 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.200231    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z"]
Sep 14 10:45:00.204092 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.204069    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6"]
Sep 14 10:45:00.209750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.209692    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6"
Sep 14 10:45:00.227301 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.227243    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6"]
Sep 14 10:45:00.256683 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.256474    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r"
Sep 14 10:45:00.267035 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.267007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc"
Sep 14 10:45:00.315961 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.315728    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6"
Sep 14 10:45:00.483948 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.483922    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst"]
Sep 14 10:45:00.485644 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:45:00.485613    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffbc340_fbad_4111_b496_7f1e09074748.slice/crio-71b3967494b4b9da4db46a68e5b8ad8e5960d6bbde91ad3863c52399407f5b0b WatchSource:0}: Error finding container 71b3967494b4b9da4db46a68e5b8ad8e5960d6bbde91ad3863c52399407f5b0b: Status 404 returned error can't find the container with id 71b3967494b4b9da4db46a68e5b8ad8e5960d6bbde91ad3863c52399407f5b0b
Sep 14 10:45:00.513274 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.513249    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z"]
Sep 14 10:45:00.529228 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:45:00.529191    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84fec2e_be48_4f8a_845a_8cab52a47ebb.slice/crio-9e92567313f70a8df7469dfdb7c7734101714892d961186eb2c35203503f8503 WatchSource:0}: Error finding container 9e92567313f70a8df7469dfdb7c7734101714892d961186eb2c35203503f8503: Status 404 returned error can't find the container with id 9e92567313f70a8df7469dfdb7c7734101714892d961186eb2c35203503f8503
Sep 14 10:45:00.578722 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.578691    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r"]
Sep 14 10:45:00.580142 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:45:00.580108    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d848497_1d75_40ee_a265_e4349e4cbcb1.slice/crio-230ef1a7e6d89d265d5b25017bdde2343fe2b464d7073c2fb8d7e72cad6317fd WatchSource:0}: Error finding container 230ef1a7e6d89d265d5b25017bdde2343fe2b464d7073c2fb8d7e72cad6317fd: Status 404 returned error can't find the container with id 230ef1a7e6d89d265d5b25017bdde2343fe2b464d7073c2fb8d7e72cad6317fd
Sep 14 10:45:00.594324 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.594298    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc"]
Sep 14 10:45:00.595335 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:45:00.595308    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f8361e_a21b_497c_9347_f6a3e7871530.slice/crio-a30de7af0c8ca18b9ad22a107a29f482d0aa025f10dbbe5edac3def855cd7a2b WatchSource:0}: Error finding container a30de7af0c8ca18b9ad22a107a29f482d0aa025f10dbbe5edac3def855cd7a2b: Status 404 returned error can't find the container with id a30de7af0c8ca18b9ad22a107a29f482d0aa025f10dbbe5edac3def855cd7a2b
Sep 14 10:45:00.619015 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:00.618985    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6"]
Sep 14 10:45:00.629213 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:45:00.629187    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580a8270_27d6_4e6e_a3b8_0b316c8b3ed4.slice/crio-6b2f747b309917f8b0e8834cfe74c92e33f0fc5ed84adafe103e5acb9423feba WatchSource:0}: Error finding container 6b2f747b309917f8b0e8834cfe74c92e33f0fc5ed84adafe103e5acb9423feba: Status 404 returned error can't find the container with id 6b2f747b309917f8b0e8834cfe74c92e33f0fc5ed84adafe103e5acb9423feba
Sep 14 10:45:01.102270 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.102168    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6" event={"ID":"580a8270-27d6-4e6e-a3b8-0b316c8b3ed4","Type":"ContainerStarted","Data":"6b2f747b309917f8b0e8834cfe74c92e33f0fc5ed84adafe103e5acb9423feba"}
Sep 14 10:45:01.104524 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.104492    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst" event={"ID":"7ffbc340-fbad-4111-b496-7f1e09074748","Type":"ContainerStarted","Data":"7026881bbbef24b32853bf8b7004852abb11d426882bd340f0f1eb0206a7ad9e"}
Sep 14 10:45:01.104748 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.104726    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst" event={"ID":"7ffbc340-fbad-4111-b496-7f1e09074748","Type":"ContainerStarted","Data":"71b3967494b4b9da4db46a68e5b8ad8e5960d6bbde91ad3863c52399407f5b0b"}
Sep 14 10:45:01.107108 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.107052    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z" event={"ID":"c84fec2e-be48-4f8a-845a-8cab52a47ebb","Type":"ContainerStarted","Data":"d7d37f3720649abe698df02de022cd59d25a034049e514ead46526c9855f4a57"}
Sep 14 10:45:01.107467 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.107122    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z" event={"ID":"c84fec2e-be48-4f8a-845a-8cab52a47ebb","Type":"ContainerStarted","Data":"9e92567313f70a8df7469dfdb7c7734101714892d961186eb2c35203503f8503"}
Sep 14 10:45:01.108708 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.108677    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r" event={"ID":"3d848497-1d75-40ee-a265-e4349e4cbcb1","Type":"ContainerStarted","Data":"230ef1a7e6d89d265d5b25017bdde2343fe2b464d7073c2fb8d7e72cad6317fd"}
Sep 14 10:45:01.110528 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.110499    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc" event={"ID":"15f8361e-a21b-497c-9347-f6a3e7871530","Type":"ContainerStarted","Data":"8b8cca8f3b828c0c2675c0830c7bdfb075bf63a64725639bae497f23d83c6fe7"}
Sep 14 10:45:01.110650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.110546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc" event={"ID":"15f8361e-a21b-497c-9347-f6a3e7871530","Type":"ContainerStarted","Data":"a30de7af0c8ca18b9ad22a107a29f482d0aa025f10dbbe5edac3def855cd7a2b"}
Sep 14 10:45:01.125626 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.125585    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst" podStartSLOduration=1.125570228 podStartE2EDuration="1.125570228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:45:01.125260714 +0000 UTC m=+1224.010329824" watchObservedRunningTime="2026-09-14 10:45:01.125570228 +0000 UTC m=+1224.010639335"
Sep 14 10:45:01.146462 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.146404    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc" podStartSLOduration=1.146385617 podStartE2EDuration="1.146385617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:45:01.145011554 +0000 UTC m=+1224.030080675" watchObservedRunningTime="2026-09-14 10:45:01.146385617 +0000 UTC m=+1224.031454725"
Sep 14 10:45:01.169958 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:01.169901    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z" podStartSLOduration=1.169884474 podStartE2EDuration="1.169884474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:45:01.168510701 +0000 UTC m=+1224.053579810" watchObservedRunningTime="2026-09-14 10:45:01.169884474 +0000 UTC m=+1224.054953573"
Sep 14 10:45:02.119965 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.119933    2574 generic.go:356] "Generic (PLEG): container finished" podID="3d848497-1d75-40ee-a265-e4349e4cbcb1" containerID="92af9b08559050ad58ec535f78b6739320059031fd5fb019cc234d7ef1006d1e" exitCode=0
Sep 14 10:45:02.120127 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.120026    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r" event={"ID":"3d848497-1d75-40ee-a265-e4349e4cbcb1","Type":"ContainerDied","Data":"92af9b08559050ad58ec535f78b6739320059031fd5fb019cc234d7ef1006d1e"}
Sep 14 10:45:02.121606 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.121580    2574 generic.go:356] "Generic (PLEG): container finished" podID="15f8361e-a21b-497c-9347-f6a3e7871530" containerID="8b8cca8f3b828c0c2675c0830c7bdfb075bf63a64725639bae497f23d83c6fe7" exitCode=0
Sep 14 10:45:02.121728 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.121663    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc" event={"ID":"15f8361e-a21b-497c-9347-f6a3e7871530","Type":"ContainerDied","Data":"8b8cca8f3b828c0c2675c0830c7bdfb075bf63a64725639bae497f23d83c6fe7"}
Sep 14 10:45:02.123407 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.123344    2574 generic.go:356] "Generic (PLEG): container finished" podID="580a8270-27d6-4e6e-a3b8-0b316c8b3ed4" containerID="27bc2fa37303904d009912f44bfd0352222e89dd0de0e1266ae80aac1b70dd1f" exitCode=0
Sep 14 10:45:02.123528 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.123438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6" event={"ID":"580a8270-27d6-4e6e-a3b8-0b316c8b3ed4","Type":"ContainerDied","Data":"27bc2fa37303904d009912f44bfd0352222e89dd0de0e1266ae80aac1b70dd1f"}
Sep 14 10:45:02.124977 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.124955    2574 generic.go:356] "Generic (PLEG): container finished" podID="7ffbc340-fbad-4111-b496-7f1e09074748" containerID="7026881bbbef24b32853bf8b7004852abb11d426882bd340f0f1eb0206a7ad9e" exitCode=0
Sep 14 10:45:02.125055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.125037    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst" event={"ID":"7ffbc340-fbad-4111-b496-7f1e09074748","Type":"ContainerDied","Data":"7026881bbbef24b32853bf8b7004852abb11d426882bd340f0f1eb0206a7ad9e"}
Sep 14 10:45:02.126526 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.126506    2574 generic.go:356] "Generic (PLEG): container finished" podID="c84fec2e-be48-4f8a-845a-8cab52a47ebb" containerID="d7d37f3720649abe698df02de022cd59d25a034049e514ead46526c9855f4a57" exitCode=0
Sep 14 10:45:02.126614 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:02.126533    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z" event={"ID":"c84fec2e-be48-4f8a-845a-8cab52a47ebb","Type":"ContainerDied","Data":"d7d37f3720649abe698df02de022cd59d25a034049e514ead46526c9855f4a57"}
Sep 14 10:45:03.314220 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:03.314190    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc"
Sep 14 10:45:03.364225 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:03.364202    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z"
Sep 14 10:45:03.383175 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:03.383151    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6"
Sep 14 10:45:03.388181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:03.388150    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r"
Sep 14 10:45:03.396991 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:03.396959    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst"
Sep 14 10:45:04.141167 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.141130    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r"
Sep 14 10:45:04.141167 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.141154    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r" event={"ID":"3d848497-1d75-40ee-a265-e4349e4cbcb1","Type":"ContainerDied","Data":"230ef1a7e6d89d265d5b25017bdde2343fe2b464d7073c2fb8d7e72cad6317fd"}
Sep 14 10:45:04.141407 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.141203    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="230ef1a7e6d89d265d5b25017bdde2343fe2b464d7073c2fb8d7e72cad6317fd"
Sep 14 10:45:04.142665 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.142637    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc"
Sep 14 10:45:04.142665 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.142657    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc" event={"ID":"15f8361e-a21b-497c-9347-f6a3e7871530","Type":"ContainerDied","Data":"a30de7af0c8ca18b9ad22a107a29f482d0aa025f10dbbe5edac3def855cd7a2b"}
Sep 14 10:45:04.142852 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.142691    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a30de7af0c8ca18b9ad22a107a29f482d0aa025f10dbbe5edac3def855cd7a2b"
Sep 14 10:45:04.144441 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.144415    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6"
Sep 14 10:45:04.144441 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.144423    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6" event={"ID":"580a8270-27d6-4e6e-a3b8-0b316c8b3ed4","Type":"ContainerDied","Data":"6b2f747b309917f8b0e8834cfe74c92e33f0fc5ed84adafe103e5acb9423feba"}
Sep 14 10:45:04.144622 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.144461    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b2f747b309917f8b0e8834cfe74c92e33f0fc5ed84adafe103e5acb9423feba"
Sep 14 10:45:04.145915 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.145899    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst"
Sep 14 10:45:04.145997 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.145936    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst" event={"ID":"7ffbc340-fbad-4111-b496-7f1e09074748","Type":"ContainerDied","Data":"71b3967494b4b9da4db46a68e5b8ad8e5960d6bbde91ad3863c52399407f5b0b"}
Sep 14 10:45:04.145997 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.145976    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71b3967494b4b9da4db46a68e5b8ad8e5960d6bbde91ad3863c52399407f5b0b"
Sep 14 10:45:04.147529 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.147512    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z"
Sep 14 10:45:04.147529 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.147518    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z" event={"ID":"c84fec2e-be48-4f8a-845a-8cab52a47ebb","Type":"ContainerDied","Data":"9e92567313f70a8df7469dfdb7c7734101714892d961186eb2c35203503f8503"}
Sep 14 10:45:04.147657 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:04.147559    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e92567313f70a8df7469dfdb7c7734101714892d961186eb2c35203503f8503"
Sep 14 10:45:25.444952 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.444913    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"]
Sep 14 10:45:25.445403 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445382    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84fec2e-be48-4f8a-845a-8cab52a47ebb" containerName="cleanup"
Sep 14 10:45:25.445403 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445394    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84fec2e-be48-4f8a-845a-8cab52a47ebb" containerName="cleanup"
Sep 14 10:45:25.445477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445412    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580a8270-27d6-4e6e-a3b8-0b316c8b3ed4" containerName="cleanup"
Sep 14 10:45:25.445477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445418    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="580a8270-27d6-4e6e-a3b8-0b316c8b3ed4" containerName="cleanup"
Sep 14 10:45:25.445477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445429    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d848497-1d75-40ee-a265-e4349e4cbcb1" containerName="cleanup"
Sep 14 10:45:25.445477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445434    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d848497-1d75-40ee-a265-e4349e4cbcb1" containerName="cleanup"
Sep 14 10:45:25.445477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445443    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15f8361e-a21b-497c-9347-f6a3e7871530" containerName="cleanup"
Sep 14 10:45:25.445477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445448    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="15f8361e-a21b-497c-9347-f6a3e7871530" containerName="cleanup"
Sep 14 10:45:25.445477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445455    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ffbc340-fbad-4111-b496-7f1e09074748" containerName="cleanup"
Sep 14 10:45:25.445477 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445460    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ffbc340-fbad-4111-b496-7f1e09074748" containerName="cleanup"
Sep 14 10:45:25.445719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445540    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d848497-1d75-40ee-a265-e4349e4cbcb1" containerName="cleanup"
Sep 14 10:45:25.445719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445549    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ffbc340-fbad-4111-b496-7f1e09074748" containerName="cleanup"
Sep 14 10:45:25.445719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445560    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="15f8361e-a21b-497c-9347-f6a3e7871530" containerName="cleanup"
Sep 14 10:45:25.445719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445566    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="580a8270-27d6-4e6e-a3b8-0b316c8b3ed4" containerName="cleanup"
Sep 14 10:45:25.445719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.445573    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c84fec2e-be48-4f8a-845a-8cab52a47ebb" containerName="cleanup"
Sep 14 10:45:25.448978 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.448954    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"
Sep 14 10:45:25.457362 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.457341    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:45:25.467944 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.467918    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"]
Sep 14 10:45:25.525463 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.525422    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78e879d-7e2d-4028-8594-1b81d5d18ecd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd\" (UID: \"c78e879d-7e2d-4028-8594-1b81d5d18ecd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"
Sep 14 10:45:25.626682 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.626647    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78e879d-7e2d-4028-8594-1b81d5d18ecd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd\" (UID: \"c78e879d-7e2d-4028-8594-1b81d5d18ecd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"
Sep 14 10:45:25.627365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.627347    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78e879d-7e2d-4028-8594-1b81d5d18ecd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd\" (UID: \"c78e879d-7e2d-4028-8594-1b81d5d18ecd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"
Sep 14 10:45:25.760449 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:25.760366    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"
Sep 14 10:45:26.045301 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:26.045275    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"]
Sep 14 10:45:26.047050 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:45:26.047023    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78e879d_7e2d_4028_8594_1b81d5d18ecd.slice/crio-4a61bbca4fd8507374ab1c8a8d07ac4d62a0d67048951ee4772a4f1e4cedaafa WatchSource:0}: Error finding container 4a61bbca4fd8507374ab1c8a8d07ac4d62a0d67048951ee4772a4f1e4cedaafa: Status 404 returned error can't find the container with id 4a61bbca4fd8507374ab1c8a8d07ac4d62a0d67048951ee4772a4f1e4cedaafa
Sep 14 10:45:26.292805 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:26.292770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd" event={"ID":"c78e879d-7e2d-4028-8594-1b81d5d18ecd","Type":"ContainerStarted","Data":"4a61bbca4fd8507374ab1c8a8d07ac4d62a0d67048951ee4772a4f1e4cedaafa"}
Sep 14 10:45:27.300952 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:27.300824    2574 generic.go:356] "Generic (PLEG): container finished" podID="c78e879d-7e2d-4028-8594-1b81d5d18ecd" containerID="626f9b1ef3058f8c4aa8b3025520616316eaa473047de52a53a404fe07eb7c39" exitCode=0
Sep 14 10:45:27.300952 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:27.300903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd" event={"ID":"c78e879d-7e2d-4028-8594-1b81d5d18ecd","Type":"ContainerDied","Data":"626f9b1ef3058f8c4aa8b3025520616316eaa473047de52a53a404fe07eb7c39"}
Sep 14 10:45:28.468011 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:28.467982    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"
Sep 14 10:45:28.558123 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:28.558081    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78e879d-7e2d-4028-8594-1b81d5d18ecd-maas-api-service-ca\") pod \"c78e879d-7e2d-4028-8594-1b81d5d18ecd\" (UID: \"c78e879d-7e2d-4028-8594-1b81d5d18ecd\") "
Sep 14 10:45:28.558449 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:28.558423    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c78e879d-7e2d-4028-8594-1b81d5d18ecd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c78e879d-7e2d-4028-8594-1b81d5d18ecd" (UID: "c78e879d-7e2d-4028-8594-1b81d5d18ecd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:45:28.660074 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:28.660037    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78e879d-7e2d-4028-8594-1b81d5d18ecd-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:29.321677 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:29.321642    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd" event={"ID":"c78e879d-7e2d-4028-8594-1b81d5d18ecd","Type":"ContainerDied","Data":"4a61bbca4fd8507374ab1c8a8d07ac4d62a0d67048951ee4772a4f1e4cedaafa"}
Sep 14 10:45:29.321858 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:29.321700    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a61bbca4fd8507374ab1c8a8d07ac4d62a0d67048951ee4772a4f1e4cedaafa"
Sep 14 10:45:29.321858 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:29.321652    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"
Sep 14 10:45:30.272080 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:30.272040    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"]
Sep 14 10:45:30.306213 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:30.306170    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"]
Sep 14 10:45:37.851135 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:37.851101    2574 scope.go:117] "RemoveContainer" containerID="04b018af5595a68ee7c9960810adf8ab8237c8e1865df2ce2eedee4825bf4f27"
Sep 14 10:45:37.860816 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:37.860792    2574 scope.go:117] "RemoveContainer" containerID="3575b0df1cc4f587bd143947cb68615baeb9f9cb8bcb325321e6cac2b79de0ab"
Sep 14 10:45:41.036667 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:41.036630    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r"]
Sep 14 10:45:41.041511 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:41.041481    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-85d3ec-29823045-xc68r"]
Sep 14 10:45:41.278334 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:41.278301    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"]
Sep 14 10:45:41.283470 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:41.283439    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-85d3ec-qbnzd"]
Sep 14 10:45:41.612766 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:41.612726    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d848497-1d75-40ee-a265-e4349e4cbcb1" path="/var/lib/kubelet/pods/3d848497-1d75-40ee-a265-e4349e4cbcb1/volumes"
Sep 14 10:45:41.613268 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:41.613250    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78e879d-7e2d-4028-8594-1b81d5d18ecd" path="/var/lib/kubelet/pods/c78e879d-7e2d-4028-8594-1b81d5d18ecd/volumes"
Sep 14 10:45:45.292173 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.292117    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5" podUID="fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" containerName="main" containerID="cri-o://e9080ae81eb533295fc90f29b2e4846a45da36f6d02f3351d45c5e88d36d7716" gracePeriod=45
Sep 14 10:45:45.327244 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.327202    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9" podUID="a89353f7-9719-4196-82e8-2446d9cba144" containerName="main" containerID="cri-o://76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94" gracePeriod=45
Sep 14 10:45:45.430173 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.430141    2574 generic.go:356] "Generic (PLEG): container finished" podID="fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" containerID="e9080ae81eb533295fc90f29b2e4846a45da36f6d02f3351d45c5e88d36d7716" exitCode=0
Sep 14 10:45:45.430365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.430215    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5" event={"ID":"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201","Type":"ContainerDied","Data":"e9080ae81eb533295fc90f29b2e4846a45da36f6d02f3351d45c5e88d36d7716"}
Sep 14 10:45:45.630229 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.630200    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:45:45.634037 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.634014    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:45:45.742574 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742543    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-model-cache\") pod \"a89353f7-9719-4196-82e8-2446d9cba144\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") "
Sep 14 10:45:45.742574 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742578    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-model-cache\") pod \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") "
Sep 14 10:45:45.742840 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742603    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a89353f7-9719-4196-82e8-2446d9cba144-tls-certs\") pod \"a89353f7-9719-4196-82e8-2446d9cba144\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") "
Sep 14 10:45:45.742840 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742648    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tls-certs\") pod \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") "
Sep 14 10:45:45.742840 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742676    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-dshm\") pod \"a89353f7-9719-4196-82e8-2446d9cba144\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") "
Sep 14 10:45:45.742840 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742761    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-tmp-dir\") pod \"a89353f7-9719-4196-82e8-2446d9cba144\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") "
Sep 14 10:45:45.742840 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742820    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrqgp\" (UniqueName: \"kubernetes.io/projected/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-kube-api-access-wrqgp\") pod \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") "
Sep 14 10:45:45.743260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742859    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tmp-dir\") pod \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") "
Sep 14 10:45:45.743260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742916    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-home\") pod \"a89353f7-9719-4196-82e8-2446d9cba144\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") "
Sep 14 10:45:45.743260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742949    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-dshm\") pod \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") "
Sep 14 10:45:45.743260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742976    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-home\") pod \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\" (UID: \"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201\") "
Sep 14 10:45:45.743260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.743019    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m9cd\" (UniqueName: \"kubernetes.io/projected/a89353f7-9719-4196-82e8-2446d9cba144-kube-api-access-7m9cd\") pod \"a89353f7-9719-4196-82e8-2446d9cba144\" (UID: \"a89353f7-9719-4196-82e8-2446d9cba144\") "
Sep 14 10:45:45.743260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742814    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-model-cache" (OuterVolumeSpecName: "model-cache") pod "a89353f7-9719-4196-82e8-2446d9cba144" (UID: "a89353f7-9719-4196-82e8-2446d9cba144"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:45.743260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.742844    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-model-cache" (OuterVolumeSpecName: "model-cache") pod "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" (UID: "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:45.743746 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.743686    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-home" (OuterVolumeSpecName: "home") pod "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" (UID: "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:45.743746 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.743702    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-model-cache\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.743746 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.743742    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-model-cache\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.744189 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.743695    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-home" (OuterVolumeSpecName: "home") pod "a89353f7-9719-4196-82e8-2446d9cba144" (UID: "a89353f7-9719-4196-82e8-2446d9cba144"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:45.744189 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.744043    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a89353f7-9719-4196-82e8-2446d9cba144" (UID: "a89353f7-9719-4196-82e8-2446d9cba144"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:45.744312 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.744186    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" (UID: "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:45.745661 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.745632    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-kube-api-access-wrqgp" (OuterVolumeSpecName: "kube-api-access-wrqgp") pod "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" (UID: "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201"). InnerVolumeSpecName "kube-api-access-wrqgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:45:45.745787 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.745720    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" (UID: "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:45:45.745787 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.745735    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-dshm" (OuterVolumeSpecName: "dshm") pod "a89353f7-9719-4196-82e8-2446d9cba144" (UID: "a89353f7-9719-4196-82e8-2446d9cba144"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:45.745937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.745801    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-dshm" (OuterVolumeSpecName: "dshm") pod "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" (UID: "fcd83e09-c3f5-4c04-85cf-ab1fcdf69201"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:45.745937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.745836    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a89353f7-9719-4196-82e8-2446d9cba144-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a89353f7-9719-4196-82e8-2446d9cba144" (UID: "a89353f7-9719-4196-82e8-2446d9cba144"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:45:45.746153 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.746133    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a89353f7-9719-4196-82e8-2446d9cba144-kube-api-access-7m9cd" (OuterVolumeSpecName: "kube-api-access-7m9cd") pod "a89353f7-9719-4196-82e8-2446d9cba144" (UID: "a89353f7-9719-4196-82e8-2446d9cba144"). InnerVolumeSpecName "kube-api-access-7m9cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844743    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-tmp-dir\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844771    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrqgp\" (UniqueName: \"kubernetes.io/projected/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-kube-api-access-wrqgp\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844783    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tmp-dir\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844793    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-home\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844801    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-dshm\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844809    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-home\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844817    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m9cd\" (UniqueName: \"kubernetes.io/projected/a89353f7-9719-4196-82e8-2446d9cba144-kube-api-access-7m9cd\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844825    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a89353f7-9719-4196-82e8-2446d9cba144-tls-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844832    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201-tls-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:45.844829 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:45.844839    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a89353f7-9719-4196-82e8-2446d9cba144-dshm\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:46.437710 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.437673    2574 generic.go:356] "Generic (PLEG): container finished" podID="a89353f7-9719-4196-82e8-2446d9cba144" containerID="76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94" exitCode=0
Sep 14 10:45:46.438217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.437723    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"
Sep 14 10:45:46.438217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.437757    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9" event={"ID":"a89353f7-9719-4196-82e8-2446d9cba144","Type":"ContainerDied","Data":"76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94"}
Sep 14 10:45:46.438217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.437799    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9" event={"ID":"a89353f7-9719-4196-82e8-2446d9cba144","Type":"ContainerDied","Data":"0934c9f2e8c60cb1152a68ca7dc693ef4fd5ccb218d241a7ee3bc1027ea18eeb"}
Sep 14 10:45:46.438217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.437816    2574 scope.go:117] "RemoveContainer" containerID="76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94"
Sep 14 10:45:46.439360 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.439338    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"
Sep 14 10:45:46.439689 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.439356    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5" event={"ID":"fcd83e09-c3f5-4c04-85cf-ab1fcdf69201","Type":"ContainerDied","Data":"8a2079651800ee929b8cdb09790e01b4e1423a28f7c7252aad71a927def7c4a0"}
Sep 14 10:45:46.450242 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.449949    2574 scope.go:117] "RemoveContainer" containerID="76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94"
Sep 14 10:45:46.450636 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:45:46.450603    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94\": container with ID starting with 76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94 not found: ID does not exist" containerID="76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94"
Sep 14 10:45:46.450725 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.450645    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94"} err="failed to get container status \"76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94\": rpc error: code = NotFound desc = could not find container \"76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94\": container with ID starting with 76d5a5a700b6cab7d1d0f324a9fee2768411e3db920fef262cff2de0b4dafb94 not found: ID does not exist"
Sep 14 10:45:46.450725 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.450665    2574 scope.go:117] "RemoveContainer" containerID="e9080ae81eb533295fc90f29b2e4846a45da36f6d02f3351d45c5e88d36d7716"
Sep 14 10:45:46.469706 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.469684    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"]
Sep 14 10:45:46.475255 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.475230    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-w0-85d3ec-kserve-64f8f4b6b9-kh4g9"]
Sep 14 10:45:46.487749 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.487719    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"]
Sep 14 10:45:46.490153 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:46.490129    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-85d3ec/distinct-2-w0-85d3ec-kserve-6dfcb69866-l9wk5"]
Sep 14 10:45:47.611078 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:47.611042    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a89353f7-9719-4196-82e8-2446d9cba144" path="/var/lib/kubelet/pods/a89353f7-9719-4196-82e8-2446d9cba144/volumes"
Sep 14 10:45:47.611761 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:47.611678    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" path="/var/lib/kubelet/pods/fcd83e09-c3f5-4c04-85cf-ab1fcdf69201/volumes"
Sep 14 10:45:47.722743 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:47.722704    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"]
Sep 14 10:45:48.576934 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:48.576865    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"]
Sep 14 10:45:48.577119 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:48.577099    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy" containerID="cri-o://1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85" gracePeriod=30
Sep 14 10:45:53.870211 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:53.870186    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:45:54.031644 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.031589    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf6qk\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-kube-api-access-bf6qk\") pod \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") "
Sep 14 10:45:54.031644 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.031645    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-data\") pod \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") "
Sep 14 10:45:54.031970 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.031679    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-token\") pod \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") "
Sep 14 10:45:54.031970 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.031696    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istiod-ca-cert\") pod \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") "
Sep 14 10:45:54.031970 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.031714    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-certs\") pod \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") "
Sep 14 10:45:54.031970 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.031760    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-envoy\") pod \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") "
Sep 14 10:45:54.031970 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.031860    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-socket\") pod \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") "
Sep 14 10:45:54.031970 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.031943    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-podinfo\") pod \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") "
Sep 14 10:45:54.032261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032025    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-credential-socket\") pod \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\" (UID: \"3f3d8e37-79cc-4a31-9eea-9a930ce9c067\") "
Sep 14 10:45:54.032261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032162    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f3d8e37-79cc-4a31-9eea-9a930ce9c067" (UID: "3f3d8e37-79cc-4a31-9eea-9a930ce9c067"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:54.032261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032174    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f3d8e37-79cc-4a31-9eea-9a930ce9c067" (UID: "3f3d8e37-79cc-4a31-9eea-9a930ce9c067"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:54.032261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032241    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f3d8e37-79cc-4a31-9eea-9a930ce9c067" (UID: "3f3d8e37-79cc-4a31-9eea-9a930ce9c067"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:54.032457 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032256    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f3d8e37-79cc-4a31-9eea-9a930ce9c067" (UID: "3f3d8e37-79cc-4a31-9eea-9a930ce9c067"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:45:54.032457 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032409    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f3d8e37-79cc-4a31-9eea-9a930ce9c067" (UID: "3f3d8e37-79cc-4a31-9eea-9a930ce9c067"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:54.032738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032574    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-data\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:54.032794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032718    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istiod-ca-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:54.032794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032776    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:54.032794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032788    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-workload-socket\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:54.033009 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.032801    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-credential-socket\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:54.034298 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.034272    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f3d8e37-79cc-4a31-9eea-9a930ce9c067" (UID: "3f3d8e37-79cc-4a31-9eea-9a930ce9c067"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:45:54.034432 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.034399    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-kube-api-access-bf6qk" (OuterVolumeSpecName: "kube-api-access-bf6qk") pod "3f3d8e37-79cc-4a31-9eea-9a930ce9c067" (UID: "3f3d8e37-79cc-4a31-9eea-9a930ce9c067"). InnerVolumeSpecName "kube-api-access-bf6qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:45:54.034432 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.034403    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f3d8e37-79cc-4a31-9eea-9a930ce9c067" (UID: "3f3d8e37-79cc-4a31-9eea-9a930ce9c067"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:45:54.034527 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.034439    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f3d8e37-79cc-4a31-9eea-9a930ce9c067" (UID: "3f3d8e37-79cc-4a31-9eea-9a930ce9c067"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:45:54.133633 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.133531    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf6qk\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-kube-api-access-bf6qk\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:54.133633 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.133560    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-token\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:54.133633 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.133571    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-envoy\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:54.133633 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.133579    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3d8e37-79cc-4a31-9eea-9a930ce9c067-istio-podinfo\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:45:54.503566 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.503529    2574 generic.go:356] "Generic (PLEG): container finished" podID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerID="1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85" exitCode=0
Sep 14 10:45:54.503794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.503589    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" event={"ID":"3f3d8e37-79cc-4a31-9eea-9a930ce9c067","Type":"ContainerDied","Data":"1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85"}
Sep 14 10:45:54.503794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.503594    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"
Sep 14 10:45:54.503794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.503642    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq" event={"ID":"3f3d8e37-79cc-4a31-9eea-9a930ce9c067","Type":"ContainerDied","Data":"09dc08c2700cde24ba70d409a49e5dd8487938209cc042f5f1f65307265036c0"}
Sep 14 10:45:54.503794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.503665    2574 scope.go:117] "RemoveContainer" containerID="1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85"
Sep 14 10:45:54.514716 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.514698    2574 scope.go:117] "RemoveContainer" containerID="3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828"
Sep 14 10:45:54.523976 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.523956    2574 scope.go:117] "RemoveContainer" containerID="1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85"
Sep 14 10:45:54.524304 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:45:54.524285    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85\": container with ID starting with 1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85 not found: ID does not exist" containerID="1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85"
Sep 14 10:45:54.524377 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.524318    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85"} err="failed to get container status \"1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85\": rpc error: code = NotFound desc = could not find container \"1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85\": container with ID starting with 1070062ca7525455ab08bd98fb4218be28277888349a879b5cd14d5140846e85 not found: ID does not exist"
Sep 14 10:45:54.524377 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.524345    2574 scope.go:117] "RemoveContainer" containerID="3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828"
Sep 14 10:45:54.524672 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:45:54.524653    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828\": container with ID starting with 3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828 not found: ID does not exist" containerID="3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828"
Sep 14 10:45:54.524712 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.524678    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828"} err="failed to get container status \"3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828\": rpc error: code = NotFound desc = could not find container \"3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828\": container with ID starting with 3eed21046d009be40985f3ed0145b4105f2bfd82ccf2737346969f0e54a7f828 not found: ID does not exist"
Sep 14 10:45:54.529839 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.529815    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"]
Sep 14 10:45:54.542626 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:54.542595    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-85d3ec-openshift-default-6f568cc64d-t6pfq"]
Sep 14 10:45:55.611308 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:45:55.611265    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" path="/var/lib/kubelet/pods/3f3d8e37-79cc-4a31-9eea-9a930ce9c067/volumes"
Sep 14 10:46:02.745364 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:02.745319    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk" podUID="c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" containerName="main" containerID="cri-o://3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94" gracePeriod=45
Sep 14 10:46:02.999912 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:02.999832    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:46:03.019158 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019124    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-dshm\") pod \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") "
Sep 14 10:46:03.019339 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019192    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tmp-dir\") pod \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") "
Sep 14 10:46:03.019339 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019226    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-home\") pod \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") "
Sep 14 10:46:03.019339 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019265    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-model-cache\") pod \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") "
Sep 14 10:46:03.019339 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019289    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tls-certs\") pod \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") "
Sep 14 10:46:03.019567 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019354    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29qd9\" (UniqueName: \"kubernetes.io/projected/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-kube-api-access-29qd9\") pod \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\" (UID: \"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5\") "
Sep 14 10:46:03.019567 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019458    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" (UID: "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:46:03.019567 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019468    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-home" (OuterVolumeSpecName: "home") pod "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" (UID: "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:46:03.019567 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019535    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-model-cache" (OuterVolumeSpecName: "model-cache") pod "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" (UID: "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:46:03.019767 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019747    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tmp-dir\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:46:03.019805 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019772    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-home\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:46:03.019805 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.019784    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-model-cache\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:46:03.022180 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.022057    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" (UID: "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:46:03.022180 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.022138    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-dshm" (OuterVolumeSpecName: "dshm") pod "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" (UID: "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:46:03.022180 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.022160    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-kube-api-access-29qd9" (OuterVolumeSpecName: "kube-api-access-29qd9") pod "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" (UID: "c657c2b3-ef5e-46ee-89f0-b5facd03ffc5"). InnerVolumeSpecName "kube-api-access-29qd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:46:03.120300 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.120263    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-tls-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:46:03.120300 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.120297    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29qd9\" (UniqueName: \"kubernetes.io/projected/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-kube-api-access-29qd9\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:46:03.120300 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.120306    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5-dshm\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:46:03.569333 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.569290    2574 generic.go:356] "Generic (PLEG): container finished" podID="c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" containerID="3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94" exitCode=0
Sep 14 10:46:03.569658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.569357    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"
Sep 14 10:46:03.569658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.569385    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk" event={"ID":"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5","Type":"ContainerDied","Data":"3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94"}
Sep 14 10:46:03.569658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.569443    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk" event={"ID":"c657c2b3-ef5e-46ee-89f0-b5facd03ffc5","Type":"ContainerDied","Data":"2e38a37ec5c36a54f130154fe5ff2281aa477268edeb3c382f162aad66b2030a"}
Sep 14 10:46:03.569658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.569466    2574 scope.go:117] "RemoveContainer" containerID="3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94"
Sep 14 10:46:03.579823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.579801    2574 scope.go:117] "RemoveContainer" containerID="3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94"
Sep 14 10:46:03.580225 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:46:03.580203    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94\": container with ID starting with 3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94 not found: ID does not exist" containerID="3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94"
Sep 14 10:46:03.580288 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.580235    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94"} err="failed to get container status \"3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94\": rpc error: code = NotFound desc = could not find container \"3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94\": container with ID starting with 3e9bc79b1fddd5bb3f02332949fbeeef7824b53e85fdcbb73e4c4a06c4320b94 not found: ID does not exist"
Sep 14 10:46:03.592675 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.592644    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"]
Sep 14 10:46:03.597597 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.597569    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/e2e-conflict-b-588c9108-kserve-69c88d5845-g8szk"]
Sep 14 10:46:03.610631 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:03.610603    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" path="/var/lib/kubelet/pods/c657c2b3-ef5e-46ee-89f0-b5facd03ffc5/volumes"
Sep 14 10:46:30.381352 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381312    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"]
Sep 14 10:46:30.381816 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381803    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy"
Sep 14 10:46:30.381890 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381819    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy"
Sep 14 10:46:30.381890 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381831    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" containerName="main"
Sep 14 10:46:30.381890 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381837    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" containerName="main"
Sep 14 10:46:30.381890 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381845    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a89353f7-9719-4196-82e8-2446d9cba144" containerName="main"
Sep 14 10:46:30.381890 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381850    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a89353f7-9719-4196-82e8-2446d9cba144" containerName="main"
Sep 14 10:46:30.381890 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381861    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" containerName="main"
Sep 14 10:46:30.381890 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381882    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" containerName="main"
Sep 14 10:46:30.381890 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381891    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78e879d-7e2d-4028-8594-1b81d5d18ecd" containerName="revoke-keys"
Sep 14 10:46:30.382141 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381896    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78e879d-7e2d-4028-8594-1b81d5d18ecd" containerName="revoke-keys"
Sep 14 10:46:30.382141 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381969    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c657c2b3-ef5e-46ee-89f0-b5facd03ffc5" containerName="main"
Sep 14 10:46:30.382141 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381979    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a89353f7-9719-4196-82e8-2446d9cba144" containerName="main"
Sep 14 10:46:30.382141 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381985    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd83e09-c3f5-4c04-85cf-ab1fcdf69201" containerName="main"
Sep 14 10:46:30.382141 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381989    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78e879d-7e2d-4028-8594-1b81d5d18ecd" containerName="revoke-keys"
Sep 14 10:46:30.382141 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.381994    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy"
Sep 14 10:46:30.385256 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.385239    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"
Sep 14 10:46:30.388209 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.388186    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:46:30.395236 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.395210    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"]
Sep 14 10:46:30.495078 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.495036    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd0fd68-e89e-4c8a-8c11-111c4b817504-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp\" (UID: \"7fd0fd68-e89e-4c8a-8c11-111c4b817504\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"
Sep 14 10:46:30.595735 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.595693    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd0fd68-e89e-4c8a-8c11-111c4b817504-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp\" (UID: \"7fd0fd68-e89e-4c8a-8c11-111c4b817504\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"
Sep 14 10:46:30.596352 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.596331    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd0fd68-e89e-4c8a-8c11-111c4b817504-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp\" (UID: \"7fd0fd68-e89e-4c8a-8c11-111c4b817504\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"
Sep 14 10:46:30.696760 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.696715    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"
Sep 14 10:46:30.994073 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:46:30.994039    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd0fd68_e89e_4c8a_8c11_111c4b817504.slice/crio-272a12ce054e5823173ab3a9017e88f4d6a9012d953c067c0f22a415dc001f12 WatchSource:0}: Error finding container 272a12ce054e5823173ab3a9017e88f4d6a9012d953c067c0f22a415dc001f12: Status 404 returned error can't find the container with id 272a12ce054e5823173ab3a9017e88f4d6a9012d953c067c0f22a415dc001f12
Sep 14 10:46:30.995330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:30.995303    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"]
Sep 14 10:46:31.751007 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:31.750970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp" event={"ID":"7fd0fd68-e89e-4c8a-8c11-111c4b817504","Type":"ContainerStarted","Data":"eb6b91bd94216bf5ef046fabce059e694ce35b646f870ebe47f0f76aad31f3c3"}
Sep 14 10:46:31.751473 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:31.751026    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp" event={"ID":"7fd0fd68-e89e-4c8a-8c11-111c4b817504","Type":"ContainerStarted","Data":"272a12ce054e5823173ab3a9017e88f4d6a9012d953c067c0f22a415dc001f12"}
Sep 14 10:46:31.774533 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:31.774479    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp" podStartSLOduration=1.774461417 podStartE2EDuration="1.774461417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:46:31.77347588 +0000 UTC m=+1314.658544989" watchObservedRunningTime="2026-09-14 10:46:31.774461417 +0000 UTC m=+1314.659530524"
Sep 14 10:46:32.759403 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:32.759359    2574 generic.go:356] "Generic (PLEG): container finished" podID="7fd0fd68-e89e-4c8a-8c11-111c4b817504" containerID="eb6b91bd94216bf5ef046fabce059e694ce35b646f870ebe47f0f76aad31f3c3" exitCode=0
Sep 14 10:46:32.759821 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:32.759441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp" event={"ID":"7fd0fd68-e89e-4c8a-8c11-111c4b817504","Type":"ContainerDied","Data":"eb6b91bd94216bf5ef046fabce059e694ce35b646f870ebe47f0f76aad31f3c3"}
Sep 14 10:46:33.909700 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:33.909674    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"
Sep 14 10:46:34.034170 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:34.034080    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd0fd68-e89e-4c8a-8c11-111c4b817504-maas-api-service-ca\") pod \"7fd0fd68-e89e-4c8a-8c11-111c4b817504\" (UID: \"7fd0fd68-e89e-4c8a-8c11-111c4b817504\") "
Sep 14 10:46:34.034481 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:34.034451    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fd0fd68-e89e-4c8a-8c11-111c4b817504-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7fd0fd68-e89e-4c8a-8c11-111c4b817504" (UID: "7fd0fd68-e89e-4c8a-8c11-111c4b817504"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:46:34.135585 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:34.135542    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd0fd68-e89e-4c8a-8c11-111c4b817504-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:46:34.772460 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:34.772418    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp" event={"ID":"7fd0fd68-e89e-4c8a-8c11-111c4b817504","Type":"ContainerDied","Data":"272a12ce054e5823173ab3a9017e88f4d6a9012d953c067c0f22a415dc001f12"}
Sep 14 10:46:34.772722 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:34.772480    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"
Sep 14 10:46:34.772722 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:34.772485    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="272a12ce054e5823173ab3a9017e88f4d6a9012d953c067c0f22a415dc001f12"
Sep 14 10:46:36.581925 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.581891    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"]
Sep 14 10:46:36.582434 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.582411    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd0fd68-e89e-4c8a-8c11-111c4b817504" containerName="revoke-keys"
Sep 14 10:46:36.582434 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.582430    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd0fd68-e89e-4c8a-8c11-111c4b817504" containerName="revoke-keys"
Sep 14 10:46:36.582541 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.582466    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy"
Sep 14 10:46:36.582541 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.582471    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy"
Sep 14 10:46:36.582617 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.582574    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd0fd68-e89e-4c8a-8c11-111c4b817504" containerName="revoke-keys"
Sep 14 10:46:36.582617 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.582582    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3d8e37-79cc-4a31-9eea-9a930ce9c067" containerName="istio-proxy"
Sep 14 10:46:36.585715 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.585696    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.591918 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.591895    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1910e9\"/\"openshift-service-ca.crt\""
Sep 14 10:46:36.592206 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.592185    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1910e9\"/\"default-dockercfg-gcbgd\""
Sep 14 10:46:36.592345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.592211    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1910e9\"/\"kube-root-ca.crt\""
Sep 14 10:46:36.592345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.592250    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1910e9\"/\"distinct-w4-1910e9-kserve-self-signed-certs\""
Sep 14 10:46:36.605134 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.605104    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"]
Sep 14 10:46:36.761599 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.761566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-model-cache\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.761785 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.761673    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-tmp-dir\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.761785 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.761719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-home\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.761947 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.761812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/251e569c-bba8-434e-a9b5-c780795ad055-tls-certs\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.761947 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.761895    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-dshm\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.762070 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.761996    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqns9\" (UniqueName: \"kubernetes.io/projected/251e569c-bba8-434e-a9b5-c780795ad055-kube-api-access-mqns9\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.863181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.863092    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-tmp-dir\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.863181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.863134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-home\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.863181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.863169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/251e569c-bba8-434e-a9b5-c780795ad055-tls-certs\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.863481 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.863209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-dshm\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.863481 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.863249    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqns9\" (UniqueName: \"kubernetes.io/projected/251e569c-bba8-434e-a9b5-c780795ad055-kube-api-access-mqns9\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.863481 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.863271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-model-cache\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.863651 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.863566    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-tmp-dir\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.863651 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.863601    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-home\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.863726 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.863654    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-model-cache\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.865590 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.865569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-dshm\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.865838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.865821    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/251e569c-bba8-434e-a9b5-c780795ad055-tls-certs\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.872399 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.872381    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqns9\" (UniqueName: \"kubernetes.io/projected/251e569c-bba8-434e-a9b5-c780795ad055-kube-api-access-mqns9\") pod \"distinct-w4-1910e9-kserve-7b9649d6fd-79s25\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") " pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:36.896188 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:36.896163    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:37.182127 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:37.182094    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"]
Sep 14 10:46:37.184963 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:46:37.184928    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod251e569c_bba8_434e_a9b5_c780795ad055.slice/crio-c8d71b13201b550f99a79c5a1d9c6748d21476686b4af7c20cea007d4901214d WatchSource:0}: Error finding container c8d71b13201b550f99a79c5a1d9c6748d21476686b4af7c20cea007d4901214d: Status 404 returned error can't find the container with id c8d71b13201b550f99a79c5a1d9c6748d21476686b4af7c20cea007d4901214d
Sep 14 10:46:37.794369 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:37.794333    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25" event={"ID":"251e569c-bba8-434e-a9b5-c780795ad055","Type":"ContainerStarted","Data":"872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6"}
Sep 14 10:46:37.794857 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:37.794381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25" event={"ID":"251e569c-bba8-434e-a9b5-c780795ad055","Type":"ContainerStarted","Data":"c8d71b13201b550f99a79c5a1d9c6748d21476686b4af7c20cea007d4901214d"}
Sep 14 10:46:37.815328 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:37.815275    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25" podStartSLOduration=1.815257979 podStartE2EDuration="1.815257979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:46:37.814248572 +0000 UTC m=+1320.699317679" watchObservedRunningTime="2026-09-14 10:46:37.815257979 +0000 UTC m=+1320.700327092"
Sep 14 10:46:46.129502 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.129460    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc"]
Sep 14 10:46:46.133100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.133061    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-5bbd7765-29823045-hzgzc"]
Sep 14 10:46:46.166239 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.166206    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"]
Sep 14 10:46:46.166505 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.166453    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q" podUID="62151f5f-faf5-45b6-92ea-f52559b5b444" containerName="payload-pre-processing" containerID="cri-o://88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b" gracePeriod=30
Sep 14 10:46:46.376693 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.376653    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"]
Sep 14 10:46:46.382422 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.382347    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5bbd7765-hmdgp"]
Sep 14 10:46:46.443782 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.443757    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:46:46.458040 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.458014    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62151f5f-faf5-45b6-92ea-f52559b5b444-plugins-config-volume\") pod \"62151f5f-faf5-45b6-92ea-f52559b5b444\" (UID: \"62151f5f-faf5-45b6-92ea-f52559b5b444\") "
Sep 14 10:46:46.458204 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.458127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mfhg\" (UniqueName: \"kubernetes.io/projected/62151f5f-faf5-45b6-92ea-f52559b5b444-kube-api-access-5mfhg\") pod \"62151f5f-faf5-45b6-92ea-f52559b5b444\" (UID: \"62151f5f-faf5-45b6-92ea-f52559b5b444\") "
Sep 14 10:46:46.458419 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.458384    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62151f5f-faf5-45b6-92ea-f52559b5b444-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62151f5f-faf5-45b6-92ea-f52559b5b444" (UID: "62151f5f-faf5-45b6-92ea-f52559b5b444"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:46:46.460505 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.460480    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62151f5f-faf5-45b6-92ea-f52559b5b444-kube-api-access-5mfhg" (OuterVolumeSpecName: "kube-api-access-5mfhg") pod "62151f5f-faf5-45b6-92ea-f52559b5b444" (UID: "62151f5f-faf5-45b6-92ea-f52559b5b444"). InnerVolumeSpecName "kube-api-access-5mfhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:46:46.559097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.559060    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mfhg\" (UniqueName: \"kubernetes.io/projected/62151f5f-faf5-45b6-92ea-f52559b5b444-kube-api-access-5mfhg\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:46:46.559097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.559091    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62151f5f-faf5-45b6-92ea-f52559b5b444-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:46:46.850594 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.850555    2574 generic.go:356] "Generic (PLEG): container finished" podID="62151f5f-faf5-45b6-92ea-f52559b5b444" containerID="88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b" exitCode=0
Sep 14 10:46:46.850802 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.850608    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"
Sep 14 10:46:46.850802 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.850652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q" event={"ID":"62151f5f-faf5-45b6-92ea-f52559b5b444","Type":"ContainerDied","Data":"88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b"}
Sep 14 10:46:46.850802 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.850706    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q" event={"ID":"62151f5f-faf5-45b6-92ea-f52559b5b444","Type":"ContainerDied","Data":"4cd37b34d5a41d5f215c84fde772d471ff932785cb573e0910a1f2a3d290732f"}
Sep 14 10:46:46.850802 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.850739    2574 scope.go:117] "RemoveContainer" containerID="88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b"
Sep 14 10:46:46.860599 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.860583    2574 scope.go:117] "RemoveContainer" containerID="88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b"
Sep 14 10:46:46.860886 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:46:46.860851    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b\": container with ID starting with 88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b not found: ID does not exist" containerID="88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b"
Sep 14 10:46:46.860960 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.860896    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b"} err="failed to get container status \"88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b\": rpc error: code = NotFound desc = could not find container \"88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b\": container with ID starting with 88d3176463b01de95b8e58389340fe291f985c25242e6b6eb050c94e5a86a48b not found: ID does not exist"
Sep 14 10:46:46.879182 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.879149    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"]
Sep 14 10:46:46.885626 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.885598    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5bbd7765-977855946-fd96q"]
Sep 14 10:46:46.897171 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.897147    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:46.897307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.897206    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:46.911188 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:46.911163    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:46:47.612420 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:47.612385    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15f8361e-a21b-497c-9347-f6a3e7871530" path="/var/lib/kubelet/pods/15f8361e-a21b-497c-9347-f6a3e7871530/volumes"
Sep 14 10:46:47.612821 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:47.612746    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62151f5f-faf5-45b6-92ea-f52559b5b444" path="/var/lib/kubelet/pods/62151f5f-faf5-45b6-92ea-f52559b5b444/volumes"
Sep 14 10:46:47.613055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:47.613042    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fd0fd68-e89e-4c8a-8c11-111c4b817504" path="/var/lib/kubelet/pods/7fd0fd68-e89e-4c8a-8c11-111c4b817504/volumes"
Sep 14 10:46:47.868859 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:46:47.868769    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:47:37.921055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:47:37.921022    2574 scope.go:117] "RemoveContainer" containerID="2686ed18c02fe647a470a87ea77faea791a3f3477240a6c49faaa1fd445016a4"
Sep 14 10:47:37.931980 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:47:37.931959    2574 scope.go:117] "RemoveContainer" containerID="c39756c124b7b551903dc7500f48a4912e6b3b8140c54ba8c8ed30bf86da1707"
Sep 14 10:48:37.963650 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:37.963568    2574 scope.go:117] "RemoveContainer" containerID="8c8aff3ddeb9d6162c71c65a5104dfba8fa18b501f211f8fcf3cff892916fbba"
Sep 14 10:48:42.444937 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.444900    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"]
Sep 14 10:48:42.445405 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.445388    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62151f5f-faf5-45b6-92ea-f52559b5b444" containerName="payload-pre-processing"
Sep 14 10:48:42.445450 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.445407    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62151f5f-faf5-45b6-92ea-f52559b5b444" containerName="payload-pre-processing"
Sep 14 10:48:42.445521 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.445511    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62151f5f-faf5-45b6-92ea-f52559b5b444" containerName="payload-pre-processing"
Sep 14 10:48:42.450217 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.450200    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:48:42.453290 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.453267    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-d220da\""
Sep 14 10:48:42.453436 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.453344    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-d220da-dockercfg-xhbx6\""
Sep 14 10:48:42.462808 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.462782    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"]
Sep 14 10:48:42.480748 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.480709    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"]
Sep 14 10:48:42.484658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.484637    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:42.506031 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.505995    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"]
Sep 14 10:48:42.515451 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.515419    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f25a3bbf-8ea6-402f-b886-632839fd4d49-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn\" (UID: \"f25a3bbf-8ea6-402f-b886-632839fd4d49\") " pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:42.515621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.515479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4d0127-3575-4669-ac7d-607b699bc414-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt\" (UID: \"fb4d0127-3575-4669-ac7d-607b699bc414\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:48:42.515621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.515547    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2qmb\" (UniqueName: \"kubernetes.io/projected/fb4d0127-3575-4669-ac7d-607b699bc414-kube-api-access-k2qmb\") pod \"payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt\" (UID: \"fb4d0127-3575-4669-ac7d-607b699bc414\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:48:42.515621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.515604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m5tv\" (UniqueName: \"kubernetes.io/projected/f25a3bbf-8ea6-402f-b886-632839fd4d49-kube-api-access-9m5tv\") pod \"payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn\" (UID: \"f25a3bbf-8ea6-402f-b886-632839fd4d49\") " pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:42.616193 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.616151    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f25a3bbf-8ea6-402f-b886-632839fd4d49-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn\" (UID: \"f25a3bbf-8ea6-402f-b886-632839fd4d49\") " pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:42.616391 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.616257    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4d0127-3575-4669-ac7d-607b699bc414-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt\" (UID: \"fb4d0127-3575-4669-ac7d-607b699bc414\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:48:42.616391 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.616297    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2qmb\" (UniqueName: \"kubernetes.io/projected/fb4d0127-3575-4669-ac7d-607b699bc414-kube-api-access-k2qmb\") pod \"payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt\" (UID: \"fb4d0127-3575-4669-ac7d-607b699bc414\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:48:42.616391 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.616333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m5tv\" (UniqueName: \"kubernetes.io/projected/f25a3bbf-8ea6-402f-b886-632839fd4d49-kube-api-access-9m5tv\") pod \"payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn\" (UID: \"f25a3bbf-8ea6-402f-b886-632839fd4d49\") " pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:42.617048 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.617027    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f25a3bbf-8ea6-402f-b886-632839fd4d49-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn\" (UID: \"f25a3bbf-8ea6-402f-b886-632839fd4d49\") " pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:42.617222 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.617197    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4d0127-3575-4669-ac7d-607b699bc414-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt\" (UID: \"fb4d0127-3575-4669-ac7d-607b699bc414\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:48:42.627133 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.627088    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m5tv\" (UniqueName: \"kubernetes.io/projected/f25a3bbf-8ea6-402f-b886-632839fd4d49-kube-api-access-9m5tv\") pod \"payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn\" (UID: \"f25a3bbf-8ea6-402f-b886-632839fd4d49\") " pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:42.627298 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.627144    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2qmb\" (UniqueName: \"kubernetes.io/projected/fb4d0127-3575-4669-ac7d-607b699bc414-kube-api-access-k2qmb\") pod \"payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt\" (UID: \"fb4d0127-3575-4669-ac7d-607b699bc414\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:48:42.761447 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.761349    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:48:42.795595 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:42.795566    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:43.046156 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.046129    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"]
Sep 14 10:48:43.047284 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:48:43.047256    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4d0127_3575_4669_ac7d_607b699bc414.slice/crio-ce39394a0788c992c775cc05e010efc41cb22b0ad388781998d927ed5b6b8d9d WatchSource:0}: Error finding container ce39394a0788c992c775cc05e010efc41cb22b0ad388781998d927ed5b6b8d9d: Status 404 returned error can't find the container with id ce39394a0788c992c775cc05e010efc41cb22b0ad388781998d927ed5b6b8d9d
Sep 14 10:48:43.092242 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.092215    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"]
Sep 14 10:48:43.094487 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:48:43.094466    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25a3bbf_8ea6_402f_b886_632839fd4d49.slice/crio-2e66e1f246fd46f4c77b099d05aef516899cda62726b5995f4fe3981c43a93ef WatchSource:0}: Error finding container 2e66e1f246fd46f4c77b099d05aef516899cda62726b5995f4fe3981c43a93ef: Status 404 returned error can't find the container with id 2e66e1f246fd46f4c77b099d05aef516899cda62726b5995f4fe3981c43a93ef
Sep 14 10:48:43.572245 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.572211    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt" event={"ID":"fb4d0127-3575-4669-ac7d-607b699bc414","Type":"ContainerStarted","Data":"1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c"}
Sep 14 10:48:43.572729 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.572301    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt" event={"ID":"fb4d0127-3575-4669-ac7d-607b699bc414","Type":"ContainerStarted","Data":"ce39394a0788c992c775cc05e010efc41cb22b0ad388781998d927ed5b6b8d9d"}
Sep 14 10:48:43.572729 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.572336    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:48:43.574097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.574065    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn" event={"ID":"f25a3bbf-8ea6-402f-b886-632839fd4d49","Type":"ContainerStarted","Data":"d5f263fd9596ceb493b2b3f287d3efdb30c43798f98b02b5cdaa5efe9a31c1f0"}
Sep 14 10:48:43.574247 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.574129    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:43.574247 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.574152    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn" event={"ID":"f25a3bbf-8ea6-402f-b886-632839fd4d49","Type":"ContainerStarted","Data":"2e66e1f246fd46f4c77b099d05aef516899cda62726b5995f4fe3981c43a93ef"}
Sep 14 10:48:43.597209 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.597137    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt" podStartSLOduration=1.597115768 podStartE2EDuration="1.597115768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:48:43.593123012 +0000 UTC m=+1446.478192120" watchObservedRunningTime="2026-09-14 10:48:43.597115768 +0000 UTC m=+1446.482184878"
Sep 14 10:48:43.620091 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:43.620041    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn" podStartSLOduration=1.6200220490000001 podStartE2EDuration="1.620022049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:48:43.618233816 +0000 UTC m=+1446.503302935" watchObservedRunningTime="2026-09-14 10:48:43.620022049 +0000 UTC m=+1446.505091157"
Sep 14 10:48:54.583292 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:54.583261    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:48:54.583944 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:48:54.583335    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:49:18.114139 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.114105    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"]
Sep 14 10:49:18.119056 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.119038    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:18.123295 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.123271    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ea2835\""
Sep 14 10:49:18.123445 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.123300    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ea2835-dockercfg-t8c72\""
Sep 14 10:49:18.139504 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.139481    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"]
Sep 14 10:49:18.276349 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.276320    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6\" (UID: \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:18.276538 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.276364    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpnk9\" (UniqueName: \"kubernetes.io/projected/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-kube-api-access-kpnk9\") pod \"payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6\" (UID: \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:18.377010 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.376926    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6\" (UID: \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:18.377169 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.377015    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnk9\" (UniqueName: \"kubernetes.io/projected/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-kube-api-access-kpnk9\") pod \"payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6\" (UID: \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:18.377649 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.377626    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6\" (UID: \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:18.387765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.387742    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpnk9\" (UniqueName: \"kubernetes.io/projected/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-kube-api-access-kpnk9\") pod \"payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6\" (UID: \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:18.431432 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.431403    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:18.719472 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.719433    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"]
Sep 14 10:49:18.720076 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:49:18.720049    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529fcfb4_74eb_45f0_ad7d_b99cd57cba11.slice/crio-a9dc9c5176292d1c33bfef363c1f5aa0b521da34136d48a1d4987689f562d224 WatchSource:0}: Error finding container a9dc9c5176292d1c33bfef363c1f5aa0b521da34136d48a1d4987689f562d224: Status 404 returned error can't find the container with id a9dc9c5176292d1c33bfef363c1f5aa0b521da34136d48a1d4987689f562d224
Sep 14 10:49:18.788714 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:18.788687    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6" event={"ID":"529fcfb4-74eb-45f0-ad7d-b99cd57cba11","Type":"ContainerStarted","Data":"a9dc9c5176292d1c33bfef363c1f5aa0b521da34136d48a1d4987689f562d224"}
Sep 14 10:49:19.804999 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:19.804960    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6" event={"ID":"529fcfb4-74eb-45f0-ad7d-b99cd57cba11","Type":"ContainerStarted","Data":"fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba"}
Sep 14 10:49:19.805506 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:19.805322    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:19.831548 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:19.831495    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6" podStartSLOduration=1.831479002 podStartE2EDuration="1.831479002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:49:19.829567613 +0000 UTC m=+1482.714636789" watchObservedRunningTime="2026-09-14 10:49:19.831479002 +0000 UTC m=+1482.716548110"
Sep 14 10:49:30.813530 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:30.813499    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:49:37.987836 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:37.987795    2574 scope.go:117] "RemoveContainer" containerID="a68e26eec26aae321c30b53133598513e87b2564a34b14b6d37aeebae130b51d"
Sep 14 10:49:38.217239 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:38.217209    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:49:38.227317 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:38.227288    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:49:44.237996 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.237961    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"]
Sep 14 10:49:44.243367 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.243337    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"
Sep 14 10:49:44.246318 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.246289    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:49:44.252000 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.251494    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"]
Sep 14 10:49:44.351923 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.351844    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f3570a8-15dd-4be6-bd52-ef134d5accbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d220da-5qzgv\" (UID: \"2f3570a8-15dd-4be6-bd52-ef134d5accbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"
Sep 14 10:49:44.453151 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.453109    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f3570a8-15dd-4be6-bd52-ef134d5accbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d220da-5qzgv\" (UID: \"2f3570a8-15dd-4be6-bd52-ef134d5accbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"
Sep 14 10:49:44.453786 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.453766    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f3570a8-15dd-4be6-bd52-ef134d5accbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d220da-5qzgv\" (UID: \"2f3570a8-15dd-4be6-bd52-ef134d5accbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"
Sep 14 10:49:44.557003 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.556919    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"
Sep 14 10:49:44.841452 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.841424    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"]
Sep 14 10:49:44.843174 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:49:44.843144    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3570a8_15dd_4be6_bd52_ef134d5accbb.slice/crio-c77780105b606edefa96544cf85835aa621639168935d17352150485aab5b4b3 WatchSource:0}: Error finding container c77780105b606edefa96544cf85835aa621639168935d17352150485aab5b4b3: Status 404 returned error can't find the container with id c77780105b606edefa96544cf85835aa621639168935d17352150485aab5b4b3
Sep 14 10:49:44.968710 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:44.968676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv" event={"ID":"2f3570a8-15dd-4be6-bd52-ef134d5accbb","Type":"ContainerStarted","Data":"c77780105b606edefa96544cf85835aa621639168935d17352150485aab5b4b3"}
Sep 14 10:49:45.976055 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:45.975963    2574 generic.go:356] "Generic (PLEG): container finished" podID="2f3570a8-15dd-4be6-bd52-ef134d5accbb" containerID="99b7cfaf8e4a6fddba6f069c24a7ee563e47b43e1e37c9165813934e5a8098e3" exitCode=0
Sep 14 10:49:45.976443 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:45.976050    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv" event={"ID":"2f3570a8-15dd-4be6-bd52-ef134d5accbb","Type":"ContainerDied","Data":"99b7cfaf8e4a6fddba6f069c24a7ee563e47b43e1e37c9165813934e5a8098e3"}
Sep 14 10:49:47.133391 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:47.133365    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"
Sep 14 10:49:47.279741 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:47.279654    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f3570a8-15dd-4be6-bd52-ef134d5accbb-maas-api-service-ca\") pod \"2f3570a8-15dd-4be6-bd52-ef134d5accbb\" (UID: \"2f3570a8-15dd-4be6-bd52-ef134d5accbb\") "
Sep 14 10:49:47.280044 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:47.280024    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f3570a8-15dd-4be6-bd52-ef134d5accbb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f3570a8-15dd-4be6-bd52-ef134d5accbb" (UID: "2f3570a8-15dd-4be6-bd52-ef134d5accbb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:49:47.380975 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:47.380941    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f3570a8-15dd-4be6-bd52-ef134d5accbb-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:49:47.989676 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:47.989642    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"
Sep 14 10:49:47.989854 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:47.989674    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv" event={"ID":"2f3570a8-15dd-4be6-bd52-ef134d5accbb","Type":"ContainerDied","Data":"c77780105b606edefa96544cf85835aa621639168935d17352150485aab5b4b3"}
Sep 14 10:49:47.989854 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:47.989753    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c77780105b606edefa96544cf85835aa621639168935d17352150485aab5b4b3"
Sep 14 10:49:59.929054 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:59.928805    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"]
Sep 14 10:49:59.929560 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:59.929218    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn" podUID="f25a3bbf-8ea6-402f-b886-632839fd4d49" containerName="payload-processing" containerID="cri-o://d5f263fd9596ceb493b2b3f287d3efdb30c43798f98b02b5cdaa5efe9a31c1f0" gracePeriod=30
Sep 14 10:49:59.948051 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:49:59.948015    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"]
Sep 14 10:50:00.068069 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.068035    2574 generic.go:356] "Generic (PLEG): container finished" podID="f25a3bbf-8ea6-402f-b886-632839fd4d49" containerID="d5f263fd9596ceb493b2b3f287d3efdb30c43798f98b02b5cdaa5efe9a31c1f0" exitCode=0
Sep 14 10:50:00.068245 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.068106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn" event={"ID":"f25a3bbf-8ea6-402f-b886-632839fd4d49","Type":"ContainerDied","Data":"d5f263fd9596ceb493b2b3f287d3efdb30c43798f98b02b5cdaa5efe9a31c1f0"}
Sep 14 10:50:00.068340 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.068322    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt" podUID="fb4d0127-3575-4669-ac7d-607b699bc414" containerName="payload-pre-processing" containerID="cri-o://1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c" gracePeriod=30
Sep 14 10:50:00.113254 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.113200    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"]
Sep 14 10:50:00.116049 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.116015    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d220da-5qzgv"]
Sep 14 10:50:00.222566 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.222529    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:50:00.318963 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.318924    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f25a3bbf-8ea6-402f-b886-632839fd4d49-plugins-config-volume\") pod \"f25a3bbf-8ea6-402f-b886-632839fd4d49\" (UID: \"f25a3bbf-8ea6-402f-b886-632839fd4d49\") "
Sep 14 10:50:00.319171 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.318999    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m5tv\" (UniqueName: \"kubernetes.io/projected/f25a3bbf-8ea6-402f-b886-632839fd4d49-kube-api-access-9m5tv\") pod \"f25a3bbf-8ea6-402f-b886-632839fd4d49\" (UID: \"f25a3bbf-8ea6-402f-b886-632839fd4d49\") "
Sep 14 10:50:00.319422 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.319385    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f25a3bbf-8ea6-402f-b886-632839fd4d49-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f25a3bbf-8ea6-402f-b886-632839fd4d49" (UID: "f25a3bbf-8ea6-402f-b886-632839fd4d49"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:00.321857 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.321825    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f25a3bbf-8ea6-402f-b886-632839fd4d49-kube-api-access-9m5tv" (OuterVolumeSpecName: "kube-api-access-9m5tv") pod "f25a3bbf-8ea6-402f-b886-632839fd4d49" (UID: "f25a3bbf-8ea6-402f-b886-632839fd4d49"). InnerVolumeSpecName "kube-api-access-9m5tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:00.341254 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.341228    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:50:00.420345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.420306    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2qmb\" (UniqueName: \"kubernetes.io/projected/fb4d0127-3575-4669-ac7d-607b699bc414-kube-api-access-k2qmb\") pod \"fb4d0127-3575-4669-ac7d-607b699bc414\" (UID: \"fb4d0127-3575-4669-ac7d-607b699bc414\") "
Sep 14 10:50:00.420345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.420366    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4d0127-3575-4669-ac7d-607b699bc414-plugins-config-volume\") pod \"fb4d0127-3575-4669-ac7d-607b699bc414\" (UID: \"fb4d0127-3575-4669-ac7d-607b699bc414\") "
Sep 14 10:50:00.420748 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.420729    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f25a3bbf-8ea6-402f-b886-632839fd4d49-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:00.420817 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.420753    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m5tv\" (UniqueName: \"kubernetes.io/projected/f25a3bbf-8ea6-402f-b886-632839fd4d49-kube-api-access-9m5tv\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:00.420895 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.420843    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb4d0127-3575-4669-ac7d-607b699bc414-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fb4d0127-3575-4669-ac7d-607b699bc414" (UID: "fb4d0127-3575-4669-ac7d-607b699bc414"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:00.423280 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.423248    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4d0127-3575-4669-ac7d-607b699bc414-kube-api-access-k2qmb" (OuterVolumeSpecName: "kube-api-access-k2qmb") pod "fb4d0127-3575-4669-ac7d-607b699bc414" (UID: "fb4d0127-3575-4669-ac7d-607b699bc414"). InnerVolumeSpecName "kube-api-access-k2qmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:00.521984 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.521882    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2qmb\" (UniqueName: \"kubernetes.io/projected/fb4d0127-3575-4669-ac7d-607b699bc414-kube-api-access-k2qmb\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:00.521984 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:00.521918    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4d0127-3575-4669-ac7d-607b699bc414-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:01.075223 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.075197    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"
Sep 14 10:50:01.075723 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.075236    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn" event={"ID":"f25a3bbf-8ea6-402f-b886-632839fd4d49","Type":"ContainerDied","Data":"2e66e1f246fd46f4c77b099d05aef516899cda62726b5995f4fe3981c43a93ef"}
Sep 14 10:50:01.075723 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.075306    2574 scope.go:117] "RemoveContainer" containerID="d5f263fd9596ceb493b2b3f287d3efdb30c43798f98b02b5cdaa5efe9a31c1f0"
Sep 14 10:50:01.077150 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.077124    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"
Sep 14 10:50:01.077251 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.077146    2574 generic.go:356] "Generic (PLEG): container finished" podID="fb4d0127-3575-4669-ac7d-607b699bc414" containerID="1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c" exitCode=0
Sep 14 10:50:01.077251 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.077175    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt" event={"ID":"fb4d0127-3575-4669-ac7d-607b699bc414","Type":"ContainerDied","Data":"1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c"}
Sep 14 10:50:01.077251 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.077220    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt" event={"ID":"fb4d0127-3575-4669-ac7d-607b699bc414","Type":"ContainerDied","Data":"ce39394a0788c992c775cc05e010efc41cb22b0ad388781998d927ed5b6b8d9d"}
Sep 14 10:50:01.085987 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.085970    2574 scope.go:117] "RemoveContainer" containerID="1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c"
Sep 14 10:50:01.096617 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.096598    2574 scope.go:117] "RemoveContainer" containerID="1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c"
Sep 14 10:50:01.096957 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:50:01.096931    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c\": container with ID starting with 1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c not found: ID does not exist" containerID="1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c"
Sep 14 10:50:01.097011 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.096970    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c"} err="failed to get container status \"1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c\": rpc error: code = NotFound desc = could not find container \"1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c\": container with ID starting with 1bdd4f419e08d81ed2438d3af004925fc6cc5d1fe996876e05978ed1e66f1c9c not found: ID does not exist"
Sep 14 10:50:01.102639 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.102607    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"]
Sep 14 10:50:01.112365 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.112334    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d220da-b9bb86c45-59pzn"]
Sep 14 10:50:01.124622 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.124593    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"]
Sep 14 10:50:01.130019 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.129994    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d220da-6d95b5c654-sq8bt"]
Sep 14 10:50:01.611648 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.611615    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3570a8-15dd-4be6-bd52-ef134d5accbb" path="/var/lib/kubelet/pods/2f3570a8-15dd-4be6-bd52-ef134d5accbb/volumes"
Sep 14 10:50:01.612235 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.612212    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f25a3bbf-8ea6-402f-b886-632839fd4d49" path="/var/lib/kubelet/pods/f25a3bbf-8ea6-402f-b886-632839fd4d49/volumes"
Sep 14 10:50:01.612717 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:01.612698    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb4d0127-3575-4669-ac7d-607b699bc414" path="/var/lib/kubelet/pods/fb4d0127-3575-4669-ac7d-607b699bc414/volumes"
Sep 14 10:50:04.757271 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757236    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"]
Sep 14 10:50:04.757759 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757738    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4d0127-3575-4669-ac7d-607b699bc414" containerName="payload-pre-processing"
Sep 14 10:50:04.757838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757764    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4d0127-3575-4669-ac7d-607b699bc414" containerName="payload-pre-processing"
Sep 14 10:50:04.757838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757776    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3570a8-15dd-4be6-bd52-ef134d5accbb" containerName="revoke-keys"
Sep 14 10:50:04.757838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757785    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3570a8-15dd-4be6-bd52-ef134d5accbb" containerName="revoke-keys"
Sep 14 10:50:04.757838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757799    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f25a3bbf-8ea6-402f-b886-632839fd4d49" containerName="payload-processing"
Sep 14 10:50:04.757838 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757805    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f25a3bbf-8ea6-402f-b886-632839fd4d49" containerName="payload-processing"
Sep 14 10:50:04.758119 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757930    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb4d0127-3575-4669-ac7d-607b699bc414" containerName="payload-pre-processing"
Sep 14 10:50:04.758119 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757946    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f25a3bbf-8ea6-402f-b886-632839fd4d49" containerName="payload-processing"
Sep 14 10:50:04.758119 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.757958    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3570a8-15dd-4be6-bd52-ef134d5accbb" containerName="revoke-keys"
Sep 14 10:50:04.767590 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.767543    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"
Sep 14 10:50:04.771521 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.771408    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:50:04.772263 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.772234    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"]
Sep 14 10:50:04.867611 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.867572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e71a8365-52a6-4596-9801-2ffb6c5e999a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz\" (UID: \"e71a8365-52a6-4596-9801-2ffb6c5e999a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"
Sep 14 10:50:04.968742 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.968698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e71a8365-52a6-4596-9801-2ffb6c5e999a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz\" (UID: \"e71a8365-52a6-4596-9801-2ffb6c5e999a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"
Sep 14 10:50:04.969337 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:04.969319    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e71a8365-52a6-4596-9801-2ffb6c5e999a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz\" (UID: \"e71a8365-52a6-4596-9801-2ffb6c5e999a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"
Sep 14 10:50:05.082840 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:05.082734    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"
Sep 14 10:50:05.367768 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:05.367738    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"]
Sep 14 10:50:05.369435 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:50:05.369408    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71a8365_52a6_4596_9801_2ffb6c5e999a.slice/crio-d6dfaacb5dcf95218d17cf8c9f26b7f6e597e11998bdf86f1f330135b4d4da1e WatchSource:0}: Error finding container d6dfaacb5dcf95218d17cf8c9f26b7f6e597e11998bdf86f1f330135b4d4da1e: Status 404 returned error can't find the container with id d6dfaacb5dcf95218d17cf8c9f26b7f6e597e11998bdf86f1f330135b4d4da1e
Sep 14 10:50:06.116407 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:06.116321    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz" event={"ID":"e71a8365-52a6-4596-9801-2ffb6c5e999a","Type":"ContainerStarted","Data":"6c15ff5f8f96a9d4f75cd89d93e29ea89344183fb31ac31e59d0fd7c8dd83641"}
Sep 14 10:50:06.116407 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:06.116374    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz" event={"ID":"e71a8365-52a6-4596-9801-2ffb6c5e999a","Type":"ContainerStarted","Data":"d6dfaacb5dcf95218d17cf8c9f26b7f6e597e11998bdf86f1f330135b4d4da1e"}
Sep 14 10:50:06.135216 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:06.135165    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz" podStartSLOduration=2.135148 podStartE2EDuration="2.135148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:06.133117497 +0000 UTC m=+1529.018186606" watchObservedRunningTime="2026-09-14 10:50:06.135148 +0000 UTC m=+1529.020217108"
Sep 14 10:50:07.124921 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:07.124854    2574 generic.go:356] "Generic (PLEG): container finished" podID="e71a8365-52a6-4596-9801-2ffb6c5e999a" containerID="6c15ff5f8f96a9d4f75cd89d93e29ea89344183fb31ac31e59d0fd7c8dd83641" exitCode=0
Sep 14 10:50:07.125362 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:07.124943    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz" event={"ID":"e71a8365-52a6-4596-9801-2ffb6c5e999a","Type":"ContainerDied","Data":"6c15ff5f8f96a9d4f75cd89d93e29ea89344183fb31ac31e59d0fd7c8dd83641"}
Sep 14 10:50:07.727580 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:07.727548    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"]
Sep 14 10:50:07.731171 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:07.731152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"
Sep 14 10:50:07.755269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:07.755236    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"]
Sep 14 10:50:07.798856 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:07.798821    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eba4af-1c80-4d41-aae0-d25239bc726b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv\" (UID: \"a8eba4af-1c80-4d41-aae0-d25239bc726b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"
Sep 14 10:50:07.900345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:07.900313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eba4af-1c80-4d41-aae0-d25239bc726b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv\" (UID: \"a8eba4af-1c80-4d41-aae0-d25239bc726b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"
Sep 14 10:50:07.900971 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:07.900947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eba4af-1c80-4d41-aae0-d25239bc726b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv\" (UID: \"a8eba4af-1c80-4d41-aae0-d25239bc726b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"
Sep 14 10:50:08.041524 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:08.041436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"
Sep 14 10:50:08.274687 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:08.274659    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"
Sep 14 10:50:08.313690 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:08.313590    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e71a8365-52a6-4596-9801-2ffb6c5e999a-maas-api-service-ca\") pod \"e71a8365-52a6-4596-9801-2ffb6c5e999a\" (UID: \"e71a8365-52a6-4596-9801-2ffb6c5e999a\") "
Sep 14 10:50:08.313978 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:08.313955    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e71a8365-52a6-4596-9801-2ffb6c5e999a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e71a8365-52a6-4596-9801-2ffb6c5e999a" (UID: "e71a8365-52a6-4596-9801-2ffb6c5e999a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:08.314076 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:08.314057    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e71a8365-52a6-4596-9801-2ffb6c5e999a-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:08.361692 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:08.361664    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"]
Sep 14 10:50:08.362602 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:50:08.362579    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8eba4af_1c80_4d41_aae0_d25239bc726b.slice/crio-edd94ac4892e6201a5aea2eea1d5fcfaf5f7078edcf7e78893ec0d1b1e21f8db WatchSource:0}: Error finding container edd94ac4892e6201a5aea2eea1d5fcfaf5f7078edcf7e78893ec0d1b1e21f8db: Status 404 returned error can't find the container with id edd94ac4892e6201a5aea2eea1d5fcfaf5f7078edcf7e78893ec0d1b1e21f8db
Sep 14 10:50:09.140479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:09.140443    2574 generic.go:356] "Generic (PLEG): container finished" podID="a8eba4af-1c80-4d41-aae0-d25239bc726b" containerID="056d16fd7e6c4a1b320b67e3874d3728f60275774ded7811b2a1c48b93a38d9f" exitCode=0
Sep 14 10:50:09.140680 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:09.140586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv" event={"ID":"a8eba4af-1c80-4d41-aae0-d25239bc726b","Type":"ContainerDied","Data":"056d16fd7e6c4a1b320b67e3874d3728f60275774ded7811b2a1c48b93a38d9f"}
Sep 14 10:50:09.140680 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:09.140644    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv" event={"ID":"a8eba4af-1c80-4d41-aae0-d25239bc726b","Type":"ContainerStarted","Data":"edd94ac4892e6201a5aea2eea1d5fcfaf5f7078edcf7e78893ec0d1b1e21f8db"}
Sep 14 10:50:09.142417 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:09.142390    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz" event={"ID":"e71a8365-52a6-4596-9801-2ffb6c5e999a","Type":"ContainerDied","Data":"d6dfaacb5dcf95218d17cf8c9f26b7f6e597e11998bdf86f1f330135b4d4da1e"}
Sep 14 10:50:09.142549 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:09.142439    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6dfaacb5dcf95218d17cf8c9f26b7f6e597e11998bdf86f1f330135b4d4da1e"
Sep 14 10:50:09.142549 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:09.142440    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"
Sep 14 10:50:09.556161 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:09.556117    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"]
Sep 14 10:50:10.300389 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:10.300360    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"
Sep 14 10:50:10.436304 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:10.436210    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eba4af-1c80-4d41-aae0-d25239bc726b-maas-api-service-ca\") pod \"a8eba4af-1c80-4d41-aae0-d25239bc726b\" (UID: \"a8eba4af-1c80-4d41-aae0-d25239bc726b\") "
Sep 14 10:50:10.436608 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:10.436584    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8eba4af-1c80-4d41-aae0-d25239bc726b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a8eba4af-1c80-4d41-aae0-d25239bc726b" (UID: "a8eba4af-1c80-4d41-aae0-d25239bc726b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:10.537670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:10.537631    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eba4af-1c80-4d41-aae0-d25239bc726b-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:11.157387 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.157351    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"
Sep 14 10:50:11.157387 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.157359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv" event={"ID":"a8eba4af-1c80-4d41-aae0-d25239bc726b","Type":"ContainerDied","Data":"edd94ac4892e6201a5aea2eea1d5fcfaf5f7078edcf7e78893ec0d1b1e21f8db"}
Sep 14 10:50:11.157923 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.157419    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edd94ac4892e6201a5aea2eea1d5fcfaf5f7078edcf7e78893ec0d1b1e21f8db"
Sep 14 10:50:11.983935 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.983887    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7729-5809a2"]
Sep 14 10:50:11.984390 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.984373    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71a8365-52a6-4596-9801-2ffb6c5e999a" containerName="revoke-keys"
Sep 14 10:50:11.984390 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.984390    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71a8365-52a6-4596-9801-2ffb6c5e999a" containerName="revoke-keys"
Sep 14 10:50:11.984525 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.984408    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8eba4af-1c80-4d41-aae0-d25239bc726b" containerName="revoke-keys"
Sep 14 10:50:11.984525 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.984414    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8eba4af-1c80-4d41-aae0-d25239bc726b" containerName="revoke-keys"
Sep 14 10:50:11.984525 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.984505    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e71a8365-52a6-4596-9801-2ffb6c5e999a" containerName="revoke-keys"
Sep 14 10:50:11.984525 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.984512    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8eba4af-1c80-4d41-aae0-d25239bc726b" containerName="revoke-keys"
Sep 14 10:50:11.987750 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.987733    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-5809a2"
Sep 14 10:50:11.991647 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.991630    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pp8dj\""
Sep 14 10:50:11.998758 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:11.998733    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7729-5809a2"]
Sep 14 10:50:12.053000 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:12.052956    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n59q9\" (UniqueName: \"kubernetes.io/projected/1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400-kube-api-access-n59q9\") pod \"test-curl-7729-5809a2\" (UID: \"1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400\") " pod="opendatahub/test-curl-7729-5809a2"
Sep 14 10:50:12.153740 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:12.153703    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n59q9\" (UniqueName: \"kubernetes.io/projected/1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400-kube-api-access-n59q9\") pod \"test-curl-7729-5809a2\" (UID: \"1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400\") " pod="opendatahub/test-curl-7729-5809a2"
Sep 14 10:50:12.162996 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:12.162960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n59q9\" (UniqueName: \"kubernetes.io/projected/1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400-kube-api-access-n59q9\") pod \"test-curl-7729-5809a2\" (UID: \"1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400\") " pod="opendatahub/test-curl-7729-5809a2"
Sep 14 10:50:12.298476 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:12.298374    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-5809a2"
Sep 14 10:50:12.590801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:12.590775    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7729-5809a2"]
Sep 14 10:50:12.592824 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:50:12.592797    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b2ed7a8_a4d8_4dd3_ba59_12f295b2c400.slice/crio-bd657ca2e48f30f2ef0ee574804ef3807f09f6047a8c913cdd8e647aa8e993a5 WatchSource:0}: Error finding container bd657ca2e48f30f2ef0ee574804ef3807f09f6047a8c913cdd8e647aa8e993a5: Status 404 returned error can't find the container with id bd657ca2e48f30f2ef0ee574804ef3807f09f6047a8c913cdd8e647aa8e993a5
Sep 14 10:50:13.172225 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:13.172192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7729-5809a2" event={"ID":"1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400","Type":"ContainerStarted","Data":"139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24"}
Sep 14 10:50:13.172638 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:13.172240    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7729-5809a2" event={"ID":"1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400","Type":"ContainerStarted","Data":"bd657ca2e48f30f2ef0ee574804ef3807f09f6047a8c913cdd8e647aa8e993a5"}
Sep 14 10:50:13.201187 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:13.201132    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7729-5809a2" podStartSLOduration=2.201114468 podStartE2EDuration="2.201114468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:13.19111066 +0000 UTC m=+1536.076179765" watchObservedRunningTime="2026-09-14 10:50:13.201114468 +0000 UTC m=+1536.086183576"
Sep 14 10:50:13.843607 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:13.843570    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7729-5809a2"]
Sep 14 10:50:13.846199 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:13.846172    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7729-5809a2"]
Sep 14 10:50:14.178521 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:50:14.178491    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7729-5809a2" container="test-curl-7729-5809a2"
Sep 14 10:50:15.185215 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:15.185164    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7729-5809a2" podUID="1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400" containerName="test-curl-7729-5809a2" containerID="cri-o://139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24" gracePeriod=2
Sep 14 10:50:15.188121 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:50:15.188084    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7729-5809a2\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400" pod="opendatahub/test-curl-7729-5809a2"
Sep 14 10:50:17.393920 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:17.393891    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-5809a2"
Sep 14 10:50:17.510478 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:17.510391    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n59q9\" (UniqueName: \"kubernetes.io/projected/1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400-kube-api-access-n59q9\") pod \"1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400\" (UID: \"1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400\") "
Sep 14 10:50:17.512767 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:17.512742    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400-kube-api-access-n59q9" (OuterVolumeSpecName: "kube-api-access-n59q9") pod "1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400" (UID: "1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400"). InnerVolumeSpecName "kube-api-access-n59q9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:17.611312 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:17.611277    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400" path="/var/lib/kubelet/pods/1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400/volumes"
Sep 14 10:50:17.611527 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:17.611441    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n59q9\" (UniqueName: \"kubernetes.io/projected/1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400-kube-api-access-n59q9\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:18.206499 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:18.206459    2574 generic.go:356] "Generic (PLEG): container finished" podID="1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400" containerID="139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24" exitCode=137
Sep 14 10:50:18.206499 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:18.206500    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-5809a2"
Sep 14 10:50:18.206737 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:18.206591    2574 scope.go:117] "RemoveContainer" containerID="139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24"
Sep 14 10:50:18.219792 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:18.219765    2574 scope.go:117] "RemoveContainer" containerID="139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24"
Sep 14 10:50:18.220210 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:50:18.220188    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24\": container with ID starting with 139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24 not found: ID does not exist" containerID="139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24"
Sep 14 10:50:18.220317 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:18.220226    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24"} err="failed to get container status \"139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24\": rpc error: code = NotFound desc = could not find container \"139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24\": container with ID starting with 139bb289af2e422f778c0b16fccc94f717f54e1a312aadcecf8c223fed247d24 not found: ID does not exist"
Sep 14 10:50:21.295335 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:21.295296    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"]
Sep 14 10:50:21.299749 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:21.299718    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-1910e9-bgldz"]
Sep 14 10:50:21.613613 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:21.613515    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e71a8365-52a6-4596-9801-2ffb6c5e999a" path="/var/lib/kubelet/pods/e71a8365-52a6-4596-9801-2ffb6c5e999a/volumes"
Sep 14 10:50:24.577020 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.576954    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25" podUID="251e569c-bba8-434e-a9b5-c780795ad055" containerName="main" containerID="cri-o://872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6" gracePeriod=45
Sep 14 10:50:24.850163 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.850139    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:50:24.986931 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.986893    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-home\") pod \"251e569c-bba8-434e-a9b5-c780795ad055\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") "
Sep 14 10:50:24.987117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.986963    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-tmp-dir\") pod \"251e569c-bba8-434e-a9b5-c780795ad055\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") "
Sep 14 10:50:24.987117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987040    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-dshm\") pod \"251e569c-bba8-434e-a9b5-c780795ad055\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") "
Sep 14 10:50:24.987117 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987098    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqns9\" (UniqueName: \"kubernetes.io/projected/251e569c-bba8-434e-a9b5-c780795ad055-kube-api-access-mqns9\") pod \"251e569c-bba8-434e-a9b5-c780795ad055\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") "
Sep 14 10:50:24.987289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987179    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-model-cache\") pod \"251e569c-bba8-434e-a9b5-c780795ad055\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") "
Sep 14 10:50:24.987289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987203    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/251e569c-bba8-434e-a9b5-c780795ad055-tls-certs\") pod \"251e569c-bba8-434e-a9b5-c780795ad055\" (UID: \"251e569c-bba8-434e-a9b5-c780795ad055\") "
Sep 14 10:50:24.987289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987235    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-home" (OuterVolumeSpecName: "home") pod "251e569c-bba8-434e-a9b5-c780795ad055" (UID: "251e569c-bba8-434e-a9b5-c780795ad055"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:24.987438 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987299    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "251e569c-bba8-434e-a9b5-c780795ad055" (UID: "251e569c-bba8-434e-a9b5-c780795ad055"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:24.987494 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987474    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-model-cache" (OuterVolumeSpecName: "model-cache") pod "251e569c-bba8-434e-a9b5-c780795ad055" (UID: "251e569c-bba8-434e-a9b5-c780795ad055"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:24.987774 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987749    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-tmp-dir\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:24.987897 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987796    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-model-cache\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:24.987897 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.987885    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-home\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:24.989510 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.989483    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-dshm" (OuterVolumeSpecName: "dshm") pod "251e569c-bba8-434e-a9b5-c780795ad055" (UID: "251e569c-bba8-434e-a9b5-c780795ad055"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:50:24.989670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.989570    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/251e569c-bba8-434e-a9b5-c780795ad055-kube-api-access-mqns9" (OuterVolumeSpecName: "kube-api-access-mqns9") pod "251e569c-bba8-434e-a9b5-c780795ad055" (UID: "251e569c-bba8-434e-a9b5-c780795ad055"). InnerVolumeSpecName "kube-api-access-mqns9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:24.989670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:24.989660    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/251e569c-bba8-434e-a9b5-c780795ad055-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "251e569c-bba8-434e-a9b5-c780795ad055" (UID: "251e569c-bba8-434e-a9b5-c780795ad055"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:50:25.089459 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.089367    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/251e569c-bba8-434e-a9b5-c780795ad055-dshm\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:25.089459 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.089401    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqns9\" (UniqueName: \"kubernetes.io/projected/251e569c-bba8-434e-a9b5-c780795ad055-kube-api-access-mqns9\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:25.089459 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.089412    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/251e569c-bba8-434e-a9b5-c780795ad055-tls-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:25.251434 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.251394    2574 generic.go:356] "Generic (PLEG): container finished" podID="251e569c-bba8-434e-a9b5-c780795ad055" containerID="872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6" exitCode=0
Sep 14 10:50:25.251434 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.251437    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"
Sep 14 10:50:25.251658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.251445    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25" event={"ID":"251e569c-bba8-434e-a9b5-c780795ad055","Type":"ContainerDied","Data":"872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6"}
Sep 14 10:50:25.251658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.251487    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25" event={"ID":"251e569c-bba8-434e-a9b5-c780795ad055","Type":"ContainerDied","Data":"c8d71b13201b550f99a79c5a1d9c6748d21476686b4af7c20cea007d4901214d"}
Sep 14 10:50:25.251658 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.251507    2574 scope.go:117] "RemoveContainer" containerID="872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6"
Sep 14 10:50:25.261679 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.261658    2574 scope.go:117] "RemoveContainer" containerID="872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6"
Sep 14 10:50:25.262008 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:50:25.261988    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6\": container with ID starting with 872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6 not found: ID does not exist" containerID="872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6"
Sep 14 10:50:25.262087 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.262019    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6"} err="failed to get container status \"872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6\": rpc error: code = NotFound desc = could not find container \"872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6\": container with ID starting with 872a7182e13978994d5d17d7264ea578a0c1f2c22000956e6aabd49c75d56dd6 not found: ID does not exist"
Sep 14 10:50:25.276926 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.276894    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"]
Sep 14 10:50:25.279256 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.279236    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-1910e9/distinct-w4-1910e9-kserve-7b9649d6fd-79s25"]
Sep 14 10:50:25.612314 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.612276    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="251e569c-bba8-434e-a9b5-c780795ad055" path="/var/lib/kubelet/pods/251e569c-bba8-434e-a9b5-c780795ad055/volumes"
Sep 14 10:50:25.949348 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.949314    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"]
Sep 14 10:50:25.949589 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:25.949561    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6" podUID="529fcfb4-74eb-45f0-ad7d-b99cd57cba11" containerName="payload-pre-processing" containerID="cri-o://fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba" gracePeriod=30
Sep 14 10:50:26.199444 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.199361    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"]
Sep 14 10:50:26.208292 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.208238    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ea2835-7k7xv"]
Sep 14 10:50:26.225191 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.225166    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:50:26.259954 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.259908    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6" event={"ID":"529fcfb4-74eb-45f0-ad7d-b99cd57cba11","Type":"ContainerDied","Data":"fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba"}
Sep 14 10:50:26.260120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.259926    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"
Sep 14 10:50:26.260120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.259994    2574 scope.go:117] "RemoveContainer" containerID="fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba"
Sep 14 10:50:26.260120 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.259857    2574 generic.go:356] "Generic (PLEG): container finished" podID="529fcfb4-74eb-45f0-ad7d-b99cd57cba11" containerID="fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba" exitCode=0
Sep 14 10:50:26.260256 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.260154    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6" event={"ID":"529fcfb4-74eb-45f0-ad7d-b99cd57cba11","Type":"ContainerDied","Data":"a9dc9c5176292d1c33bfef363c1f5aa0b521da34136d48a1d4987689f562d224"}
Sep 14 10:50:26.271714 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.271676    2574 scope.go:117] "RemoveContainer" containerID="fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba"
Sep 14 10:50:26.272122 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:50:26.272094    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba\": container with ID starting with fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba not found: ID does not exist" containerID="fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba"
Sep 14 10:50:26.272230 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.272128    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba"} err="failed to get container status \"fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba\": rpc error: code = NotFound desc = could not find container \"fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba\": container with ID starting with fb5bf19e220871a6812703274c2b9cf412b3adfa774a4295e46bde87911314ba not found: ID does not exist"
Sep 14 10:50:26.402621 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.402583    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpnk9\" (UniqueName: \"kubernetes.io/projected/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-kube-api-access-kpnk9\") pod \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\" (UID: \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\") "
Sep 14 10:50:26.402930 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.402683    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-plugins-config-volume\") pod \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\" (UID: \"529fcfb4-74eb-45f0-ad7d-b99cd57cba11\") "
Sep 14 10:50:26.403611 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.403582    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "529fcfb4-74eb-45f0-ad7d-b99cd57cba11" (UID: "529fcfb4-74eb-45f0-ad7d-b99cd57cba11"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:26.406600 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.406556    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-kube-api-access-kpnk9" (OuterVolumeSpecName: "kube-api-access-kpnk9") pod "529fcfb4-74eb-45f0-ad7d-b99cd57cba11" (UID: "529fcfb4-74eb-45f0-ad7d-b99cd57cba11"). InnerVolumeSpecName "kube-api-access-kpnk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:50:26.504597 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.504509    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpnk9\" (UniqueName: \"kubernetes.io/projected/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-kube-api-access-kpnk9\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:26.504823 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.504791    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/529fcfb4-74eb-45f0-ad7d-b99cd57cba11-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:26.585806 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.585771    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"]
Sep 14 10:50:26.593179 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:26.593148    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ea2835-7c65d87654-v4zs6"]
Sep 14 10:50:27.611097 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:27.611064    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="529fcfb4-74eb-45f0-ad7d-b99cd57cba11" path="/var/lib/kubelet/pods/529fcfb4-74eb-45f0-ad7d-b99cd57cba11/volumes"
Sep 14 10:50:27.611503 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:27.611486    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8eba4af-1c80-4d41-aae0-d25239bc726b" path="/var/lib/kubelet/pods/a8eba4af-1c80-4d41-aae0-d25239bc726b/volumes"
Sep 14 10:50:33.947244 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.947199    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"]
Sep 14 10:50:33.947971 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.947948    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400" containerName="test-curl-7729-5809a2"
Sep 14 10:50:33.948025 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.947975    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400" containerName="test-curl-7729-5809a2"
Sep 14 10:50:33.948025 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.948001    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="529fcfb4-74eb-45f0-ad7d-b99cd57cba11" containerName="payload-pre-processing"
Sep 14 10:50:33.948025 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.948009    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="529fcfb4-74eb-45f0-ad7d-b99cd57cba11" containerName="payload-pre-processing"
Sep 14 10:50:33.948124 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.948029    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="251e569c-bba8-434e-a9b5-c780795ad055" containerName="main"
Sep 14 10:50:33.948124 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.948036    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="251e569c-bba8-434e-a9b5-c780795ad055" containerName="main"
Sep 14 10:50:33.948188 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.948147    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="251e569c-bba8-434e-a9b5-c780795ad055" containerName="main"
Sep 14 10:50:33.948188 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.948160    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="529fcfb4-74eb-45f0-ad7d-b99cd57cba11" containerName="payload-pre-processing"
Sep 14 10:50:33.948188 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.948170    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2ed7a8-a4d8-4dd3-ba59-12f295b2c400" containerName="test-curl-7729-5809a2"
Sep 14 10:50:33.952913 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.952885    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"
Sep 14 10:50:33.957585 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.957558    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:50:33.959492 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.959468    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"]
Sep 14 10:50:33.981557 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:33.981523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba702745-b537-4704-be68-da80012cbbad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq\" (UID: \"ba702745-b537-4704-be68-da80012cbbad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"
Sep 14 10:50:34.082053 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:34.082019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba702745-b537-4704-be68-da80012cbbad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq\" (UID: \"ba702745-b537-4704-be68-da80012cbbad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"
Sep 14 10:50:34.082666 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:34.082646    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba702745-b537-4704-be68-da80012cbbad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq\" (UID: \"ba702745-b537-4704-be68-da80012cbbad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"
Sep 14 10:50:34.265512 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:34.265422    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"
Sep 14 10:50:34.546819 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:34.546795    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"]
Sep 14 10:50:34.549089 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:50:34.549056    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba702745_b537_4704_be68_da80012cbbad.slice/crio-f47c3c9aec23feda009fd7888b5580a7f966bdf855deaa6c0bc3a4e71b642283 WatchSource:0}: Error finding container f47c3c9aec23feda009fd7888b5580a7f966bdf855deaa6c0bc3a4e71b642283: Status 404 returned error can't find the container with id f47c3c9aec23feda009fd7888b5580a7f966bdf855deaa6c0bc3a4e71b642283
Sep 14 10:50:35.324531 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:35.324492    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq" event={"ID":"ba702745-b537-4704-be68-da80012cbbad","Type":"ContainerStarted","Data":"05fb589fc3182686ca1cfffd5b7823864e44c798138169901639a50de344ef73"}
Sep 14 10:50:35.324995 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:35.324551    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq" event={"ID":"ba702745-b537-4704-be68-da80012cbbad","Type":"ContainerStarted","Data":"f47c3c9aec23feda009fd7888b5580a7f966bdf855deaa6c0bc3a4e71b642283"}
Sep 14 10:50:35.346161 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:35.346109    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq" podStartSLOduration=2.3460907 podStartE2EDuration="2.3460907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:50:35.343706892 +0000 UTC m=+1558.228776000" watchObservedRunningTime="2026-09-14 10:50:35.3460907 +0000 UTC m=+1558.231159807"
Sep 14 10:50:36.333486 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:36.333454    2574 generic.go:356] "Generic (PLEG): container finished" podID="ba702745-b537-4704-be68-da80012cbbad" containerID="05fb589fc3182686ca1cfffd5b7823864e44c798138169901639a50de344ef73" exitCode=0
Sep 14 10:50:36.333898 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:36.333573    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq" event={"ID":"ba702745-b537-4704-be68-da80012cbbad","Type":"ContainerDied","Data":"05fb589fc3182686ca1cfffd5b7823864e44c798138169901639a50de344ef73"}
Sep 14 10:50:37.511193 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:37.511163    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"
Sep 14 10:50:37.611589 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:37.611487    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba702745-b537-4704-be68-da80012cbbad-maas-api-service-ca\") pod \"ba702745-b537-4704-be68-da80012cbbad\" (UID: \"ba702745-b537-4704-be68-da80012cbbad\") "
Sep 14 10:50:37.612051 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:37.612017    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba702745-b537-4704-be68-da80012cbbad-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba702745-b537-4704-be68-da80012cbbad" (UID: "ba702745-b537-4704-be68-da80012cbbad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:37.712973 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:37.712936    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba702745-b537-4704-be68-da80012cbbad-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:38.347426 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:38.347334    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"
Sep 14 10:50:38.347426 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:38.347372    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq" event={"ID":"ba702745-b537-4704-be68-da80012cbbad","Type":"ContainerDied","Data":"f47c3c9aec23feda009fd7888b5580a7f966bdf855deaa6c0bc3a4e71b642283"}
Sep 14 10:50:38.347620 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:38.347459    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f47c3c9aec23feda009fd7888b5580a7f966bdf855deaa6c0bc3a4e71b642283"
Sep 14 10:50:44.469635 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:44.469596    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst"]
Sep 14 10:50:44.472653 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:44.472625    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-3503d7-29823045-86wst"]
Sep 14 10:50:44.706138 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:44.705994    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"]
Sep 14 10:50:44.712738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:44.712700    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3503d7-qt6qq"]
Sep 14 10:50:45.610635 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:45.610606    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ffbc340-fbad-4111-b496-7f1e09074748" path="/var/lib/kubelet/pods/7ffbc340-fbad-4111-b496-7f1e09074748/volumes"
Sep 14 10:50:45.611048 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:45.610964    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba702745-b537-4704-be68-da80012cbbad" path="/var/lib/kubelet/pods/ba702745-b537-4704-be68-da80012cbbad/volumes"
Sep 14 10:50:51.847064 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:51.847033    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"]
Sep 14 10:50:51.847558 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:51.847542    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba702745-b537-4704-be68-da80012cbbad" containerName="revoke-keys"
Sep 14 10:50:51.847612 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:51.847560    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba702745-b537-4704-be68-da80012cbbad" containerName="revoke-keys"
Sep 14 10:50:51.847652 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:51.847639    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba702745-b537-4704-be68-da80012cbbad" containerName="revoke-keys"
Sep 14 10:50:51.852783 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:51.852765    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"
Sep 14 10:50:51.855994 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:51.855973    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:50:51.868762 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:51.868731    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"]
Sep 14 10:50:51.956419 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:51.956364    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7f864a-60a7-4d91-83f1-f238210875a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8\" (UID: \"fc7f864a-60a7-4d91-83f1-f238210875a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"
Sep 14 10:50:52.057556 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:52.057520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7f864a-60a7-4d91-83f1-f238210875a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8\" (UID: \"fc7f864a-60a7-4d91-83f1-f238210875a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"
Sep 14 10:50:52.058171 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:52.058153    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7f864a-60a7-4d91-83f1-f238210875a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8\" (UID: \"fc7f864a-60a7-4d91-83f1-f238210875a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"
Sep 14 10:50:52.164248 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:52.164205    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"
Sep 14 10:50:52.456961 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:52.456930    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"]
Sep 14 10:50:52.457501 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:50:52.457473    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc7f864a_60a7_4d91_83f1_f238210875a4.slice/crio-014a78562b008b531c53cd35adde2510d1d69caf0dba4b612e10e0c6a399184f WatchSource:0}: Error finding container 014a78562b008b531c53cd35adde2510d1d69caf0dba4b612e10e0c6a399184f: Status 404 returned error can't find the container with id 014a78562b008b531c53cd35adde2510d1d69caf0dba4b612e10e0c6a399184f
Sep 14 10:50:53.446008 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:53.445973    2574 generic.go:356] "Generic (PLEG): container finished" podID="fc7f864a-60a7-4d91-83f1-f238210875a4" containerID="c8680c46e42383f175953af052d3f375a2afccaee18a619d5c8d87731a1db1a9" exitCode=0
Sep 14 10:50:53.446522 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:53.446043    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8" event={"ID":"fc7f864a-60a7-4d91-83f1-f238210875a4","Type":"ContainerDied","Data":"c8680c46e42383f175953af052d3f375a2afccaee18a619d5c8d87731a1db1a9"}
Sep 14 10:50:53.446522 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:53.446116    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8" event={"ID":"fc7f864a-60a7-4d91-83f1-f238210875a4","Type":"ContainerStarted","Data":"014a78562b008b531c53cd35adde2510d1d69caf0dba4b612e10e0c6a399184f"}
Sep 14 10:50:54.600986 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:54.600961    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"
Sep 14 10:50:54.683313 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:54.683273    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7f864a-60a7-4d91-83f1-f238210875a4-maas-api-service-ca\") pod \"fc7f864a-60a7-4d91-83f1-f238210875a4\" (UID: \"fc7f864a-60a7-4d91-83f1-f238210875a4\") "
Sep 14 10:50:54.683666 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:54.683643    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc7f864a-60a7-4d91-83f1-f238210875a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fc7f864a-60a7-4d91-83f1-f238210875a4" (UID: "fc7f864a-60a7-4d91-83f1-f238210875a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:50:54.784910 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:54.784793    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7f864a-60a7-4d91-83f1-f238210875a4-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:50:55.459778 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:55.459747    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"
Sep 14 10:50:55.460000 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:55.459781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8" event={"ID":"fc7f864a-60a7-4d91-83f1-f238210875a4","Type":"ContainerDied","Data":"014a78562b008b531c53cd35adde2510d1d69caf0dba4b612e10e0c6a399184f"}
Sep 14 10:50:55.460000 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:50:55.459890    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="014a78562b008b531c53cd35adde2510d1d69caf0dba4b612e10e0c6a399184f"
Sep 14 10:51:02.430701 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.430632    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"]
Sep 14 10:51:02.431513 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.430929    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8" podUID="3553a914-f1c6-4a6c-8203-a78fea993367" containerName="payload-processing" containerID="cri-o://568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93" gracePeriod=30
Sep 14 10:51:02.445347 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.445316    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"]
Sep 14 10:51:02.445562 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.445536    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf" podUID="5d45d113-0aa0-4332-8c07-83cc3f686c82" containerName="payload-pre-processing" containerID="cri-o://aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236" gracePeriod=30
Sep 14 10:51:02.651221 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.651182    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"]
Sep 14 10:51:02.654607 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.654574    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-558928-9llg8"]
Sep 14 10:51:02.711765 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.711737    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:51:02.745843 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.745574    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:51:02.866436 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.866404    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d45d113-0aa0-4332-8c07-83cc3f686c82-plugins-config-volume\") pod \"5d45d113-0aa0-4332-8c07-83cc3f686c82\" (UID: \"5d45d113-0aa0-4332-8c07-83cc3f686c82\") "
Sep 14 10:51:02.866631 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.866466    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsnc7\" (UniqueName: \"kubernetes.io/projected/3553a914-f1c6-4a6c-8203-a78fea993367-kube-api-access-tsnc7\") pod \"3553a914-f1c6-4a6c-8203-a78fea993367\" (UID: \"3553a914-f1c6-4a6c-8203-a78fea993367\") "
Sep 14 10:51:02.866631 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.866510    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3553a914-f1c6-4a6c-8203-a78fea993367-plugins-config-volume\") pod \"3553a914-f1c6-4a6c-8203-a78fea993367\" (UID: \"3553a914-f1c6-4a6c-8203-a78fea993367\") "
Sep 14 10:51:02.866631 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.866549    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cqlz\" (UniqueName: \"kubernetes.io/projected/5d45d113-0aa0-4332-8c07-83cc3f686c82-kube-api-access-9cqlz\") pod \"5d45d113-0aa0-4332-8c07-83cc3f686c82\" (UID: \"5d45d113-0aa0-4332-8c07-83cc3f686c82\") "
Sep 14 10:51:02.866939 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.866857    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3553a914-f1c6-4a6c-8203-a78fea993367-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3553a914-f1c6-4a6c-8203-a78fea993367" (UID: "3553a914-f1c6-4a6c-8203-a78fea993367"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:51:02.866939 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.866922    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d45d113-0aa0-4332-8c07-83cc3f686c82-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d45d113-0aa0-4332-8c07-83cc3f686c82" (UID: "5d45d113-0aa0-4332-8c07-83cc3f686c82"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:51:02.868826 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.868804    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3553a914-f1c6-4a6c-8203-a78fea993367-kube-api-access-tsnc7" (OuterVolumeSpecName: "kube-api-access-tsnc7") pod "3553a914-f1c6-4a6c-8203-a78fea993367" (UID: "3553a914-f1c6-4a6c-8203-a78fea993367"). InnerVolumeSpecName "kube-api-access-tsnc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:51:02.868915 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.868835    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d45d113-0aa0-4332-8c07-83cc3f686c82-kube-api-access-9cqlz" (OuterVolumeSpecName: "kube-api-access-9cqlz") pod "5d45d113-0aa0-4332-8c07-83cc3f686c82" (UID: "5d45d113-0aa0-4332-8c07-83cc3f686c82"). InnerVolumeSpecName "kube-api-access-9cqlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:51:02.968307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.968214    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d45d113-0aa0-4332-8c07-83cc3f686c82-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:51:02.968307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.968245    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsnc7\" (UniqueName: \"kubernetes.io/projected/3553a914-f1c6-4a6c-8203-a78fea993367-kube-api-access-tsnc7\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:51:02.968307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.968255    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3553a914-f1c6-4a6c-8203-a78fea993367-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:51:02.968307 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:02.968266    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cqlz\" (UniqueName: \"kubernetes.io/projected/5d45d113-0aa0-4332-8c07-83cc3f686c82-kube-api-access-9cqlz\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:51:03.515990 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.515947    2574 generic.go:356] "Generic (PLEG): container finished" podID="3553a914-f1c6-4a6c-8203-a78fea993367" containerID="568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93" exitCode=0
Sep 14 10:51:03.516451 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.516001    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"
Sep 14 10:51:03.516451 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.516040    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8" event={"ID":"3553a914-f1c6-4a6c-8203-a78fea993367","Type":"ContainerDied","Data":"568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93"}
Sep 14 10:51:03.516451 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.516101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8" event={"ID":"3553a914-f1c6-4a6c-8203-a78fea993367","Type":"ContainerDied","Data":"255529cbcb3bfd7864e3f24abee8ecf2580b30d2a4f3630f5f3afe8305ecfb38"}
Sep 14 10:51:03.516451 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.516139    2574 scope.go:117] "RemoveContainer" containerID="568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93"
Sep 14 10:51:03.517562 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.517499    2574 generic.go:356] "Generic (PLEG): container finished" podID="5d45d113-0aa0-4332-8c07-83cc3f686c82" containerID="aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236" exitCode=0
Sep 14 10:51:03.517562 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.517541    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"
Sep 14 10:51:03.517654 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.517584    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf" event={"ID":"5d45d113-0aa0-4332-8c07-83cc3f686c82","Type":"ContainerDied","Data":"aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236"}
Sep 14 10:51:03.517654 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.517627    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf" event={"ID":"5d45d113-0aa0-4332-8c07-83cc3f686c82","Type":"ContainerDied","Data":"244978ca5ab6fdecccd5e0de201b034b1d4ca21f9b312b1657031c1f51a31252"}
Sep 14 10:51:03.527586 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.527562    2574 scope.go:117] "RemoveContainer" containerID="568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93"
Sep 14 10:51:03.528009 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:51:03.527982    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93\": container with ID starting with 568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93 not found: ID does not exist" containerID="568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93"
Sep 14 10:51:03.528083 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.528018    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93"} err="failed to get container status \"568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93\": rpc error: code = NotFound desc = could not find container \"568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93\": container with ID starting with 568303a1fe091f15b36afc659a09f4310cb9b487f520a2397333101b22a16d93 not found: ID does not exist"
Sep 14 10:51:03.528083 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.528046    2574 scope.go:117] "RemoveContainer" containerID="aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236"
Sep 14 10:51:03.537767 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.537747    2574 scope.go:117] "RemoveContainer" containerID="aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236"
Sep 14 10:51:03.538124 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:51:03.538099    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236\": container with ID starting with aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236 not found: ID does not exist" containerID="aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236"
Sep 14 10:51:03.538192 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.538135    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236"} err="failed to get container status \"aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236\": rpc error: code = NotFound desc = could not find container \"aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236\": container with ID starting with aace974748ba283c685fccf3a8baee68127390b95d87bcbd92aeb918a711f236 not found: ID does not exist"
Sep 14 10:51:03.547820 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.547777    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"]
Sep 14 10:51:03.552912 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.552880    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-558928-58b676c498-pz8hf"]
Sep 14 10:51:03.565958 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.565926    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"]
Sep 14 10:51:03.568067 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.568046    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-558928-5644fb48f-jflh8"]
Sep 14 10:51:03.610946 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.610911    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3553a914-f1c6-4a6c-8203-a78fea993367" path="/var/lib/kubelet/pods/3553a914-f1c6-4a6c-8203-a78fea993367/volumes"
Sep 14 10:51:03.611383 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.611365    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d45d113-0aa0-4332-8c07-83cc3f686c82" path="/var/lib/kubelet/pods/5d45d113-0aa0-4332-8c07-83cc3f686c82/volumes"
Sep 14 10:51:03.611762 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:03.611745    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc7f864a-60a7-4d91-83f1-f238210875a4" path="/var/lib/kubelet/pods/fc7f864a-60a7-4d91-83f1-f238210875a4/volumes"
Sep 14 10:51:38.053413 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:38.053334    2574 scope.go:117] "RemoveContainer" containerID="92af9b08559050ad58ec535f78b6739320059031fd5fb019cc234d7ef1006d1e"
Sep 14 10:51:38.062956 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:38.062862    2574 scope.go:117] "RemoveContainer" containerID="7026881bbbef24b32853bf8b7004852abb11d426882bd340f0f1eb0206a7ad9e"
Sep 14 10:51:38.071705 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:38.071687    2574 scope.go:117] "RemoveContainer" containerID="8b8cca8f3b828c0c2675c0830c7bdfb075bf63a64725639bae497f23d83c6fe7"
Sep 14 10:51:38.080067 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:38.080041    2574 scope.go:117] "RemoveContainer" containerID="626f9b1ef3058f8c4aa8b3025520616316eaa473047de52a53a404fe07eb7c39"
Sep 14 10:51:52.450630 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.450592    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7729-a73214"]
Sep 14 10:51:52.451179 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.451069    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc7f864a-60a7-4d91-83f1-f238210875a4" containerName="revoke-keys"
Sep 14 10:51:52.451179 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.451084    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc7f864a-60a7-4d91-83f1-f238210875a4" containerName="revoke-keys"
Sep 14 10:51:52.451179 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.451096    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3553a914-f1c6-4a6c-8203-a78fea993367" containerName="payload-processing"
Sep 14 10:51:52.451179 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.451102    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3553a914-f1c6-4a6c-8203-a78fea993367" containerName="payload-processing"
Sep 14 10:51:52.451179 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.451127    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d45d113-0aa0-4332-8c07-83cc3f686c82" containerName="payload-pre-processing"
Sep 14 10:51:52.451179 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.451133    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d45d113-0aa0-4332-8c07-83cc3f686c82" containerName="payload-pre-processing"
Sep 14 10:51:52.451380 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.451198    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc7f864a-60a7-4d91-83f1-f238210875a4" containerName="revoke-keys"
Sep 14 10:51:52.451380 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.451207    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d45d113-0aa0-4332-8c07-83cc3f686c82" containerName="payload-pre-processing"
Sep 14 10:51:52.451380 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.451214    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3553a914-f1c6-4a6c-8203-a78fea993367" containerName="payload-processing"
Sep 14 10:51:52.456352 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.456329    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-a73214"
Sep 14 10:51:52.458939 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.458852    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7729-a73214"]
Sep 14 10:51:52.459398 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.459379    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pp8dj\""
Sep 14 10:51:52.550177 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.550137    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c65lk\" (UniqueName: \"kubernetes.io/projected/006e93cb-c75a-4745-b77d-4b335afae9dc-kube-api-access-c65lk\") pod \"test-curl-7729-a73214\" (UID: \"006e93cb-c75a-4745-b77d-4b335afae9dc\") " pod="opendatahub/test-curl-7729-a73214"
Sep 14 10:51:52.650670 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.650621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c65lk\" (UniqueName: \"kubernetes.io/projected/006e93cb-c75a-4745-b77d-4b335afae9dc-kube-api-access-c65lk\") pod \"test-curl-7729-a73214\" (UID: \"006e93cb-c75a-4745-b77d-4b335afae9dc\") " pod="opendatahub/test-curl-7729-a73214"
Sep 14 10:51:52.663948 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.663923    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c65lk\" (UniqueName: \"kubernetes.io/projected/006e93cb-c75a-4745-b77d-4b335afae9dc-kube-api-access-c65lk\") pod \"test-curl-7729-a73214\" (UID: \"006e93cb-c75a-4745-b77d-4b335afae9dc\") " pod="opendatahub/test-curl-7729-a73214"
Sep 14 10:51:52.767999 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:52.767904    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-a73214"
Sep 14 10:51:53.050029 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:53.049998    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7729-a73214"]
Sep 14 10:51:53.052147 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:51:53.052124    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod006e93cb_c75a_4745_b77d_4b335afae9dc.slice/crio-0346dd39fb91d6862088c7cf6f79346676c343749f1df655b421a879058b4e72 WatchSource:0}: Error finding container 0346dd39fb91d6862088c7cf6f79346676c343749f1df655b421a879058b4e72: Status 404 returned error can't find the container with id 0346dd39fb91d6862088c7cf6f79346676c343749f1df655b421a879058b4e72
Sep 14 10:51:53.824736 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:53.824701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7729-a73214" event={"ID":"006e93cb-c75a-4745-b77d-4b335afae9dc","Type":"ContainerStarted","Data":"7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3"}
Sep 14 10:51:53.825184 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:53.824746    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7729-a73214" event={"ID":"006e93cb-c75a-4745-b77d-4b335afae9dc","Type":"ContainerStarted","Data":"0346dd39fb91d6862088c7cf6f79346676c343749f1df655b421a879058b4e72"}
Sep 14 10:51:53.847210 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:53.847154    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7729-a73214" podStartSLOduration=1.847137017 podStartE2EDuration="1.847137017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:51:53.845197765 +0000 UTC m=+1636.730266873" watchObservedRunningTime="2026-09-14 10:51:53.847137017 +0000 UTC m=+1636.732206125"
Sep 14 10:51:54.447306 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.447268    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7729-a73214"]
Sep 14 10:51:54.451280 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.451247    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7729-a73214"]
Sep 14 10:51:54.583759 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.583663    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7729-ad7b59"]
Sep 14 10:51:54.584150 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.584132    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006e93cb-c75a-4745-b77d-4b335afae9dc" containerName="test-curl-7729-a73214"
Sep 14 10:51:54.584150 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.584147    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="006e93cb-c75a-4745-b77d-4b335afae9dc" containerName="test-curl-7729-a73214"
Sep 14 10:51:54.584334 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.584220    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="006e93cb-c75a-4745-b77d-4b335afae9dc" containerName="test-curl-7729-a73214"
Sep 14 10:51:54.587383 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.587367    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-ad7b59"
Sep 14 10:51:54.597572 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.597543    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7729-ad7b59"]
Sep 14 10:51:54.669358 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.669315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6qlw\" (UniqueName: \"kubernetes.io/projected/f102765d-3368-4b79-9643-97be918daa59-kube-api-access-f6qlw\") pod \"test-curl-7729-ad7b59\" (UID: \"f102765d-3368-4b79-9643-97be918daa59\") " pod="opendatahub/test-curl-7729-ad7b59"
Sep 14 10:51:54.770411 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.770373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qlw\" (UniqueName: \"kubernetes.io/projected/f102765d-3368-4b79-9643-97be918daa59-kube-api-access-f6qlw\") pod \"test-curl-7729-ad7b59\" (UID: \"f102765d-3368-4b79-9643-97be918daa59\") " pod="opendatahub/test-curl-7729-ad7b59"
Sep 14 10:51:54.781198 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.781164    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6qlw\" (UniqueName: \"kubernetes.io/projected/f102765d-3368-4b79-9643-97be918daa59-kube-api-access-f6qlw\") pod \"test-curl-7729-ad7b59\" (UID: \"f102765d-3368-4b79-9643-97be918daa59\") " pod="opendatahub/test-curl-7729-ad7b59"
Sep 14 10:51:54.830169 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:51:54.830132    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7729-a73214" container="test-curl-7729-a73214"
Sep 14 10:51:54.897949 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:54.897918    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-ad7b59"
Sep 14 10:51:55.173638 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:55.173611    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7729-ad7b59"]
Sep 14 10:51:55.175364 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:51:55.175337    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf102765d_3368_4b79_9643_97be918daa59.slice/crio-b929e998412e946953c1060104030bddb019574bb21d2e68a647cb7c2fd2ad1c WatchSource:0}: Error finding container b929e998412e946953c1060104030bddb019574bb21d2e68a647cb7c2fd2ad1c: Status 404 returned error can't find the container with id b929e998412e946953c1060104030bddb019574bb21d2e68a647cb7c2fd2ad1c
Sep 14 10:51:55.837289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:55.837252    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7729-ad7b59" event={"ID":"f102765d-3368-4b79-9643-97be918daa59","Type":"ContainerStarted","Data":"4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1"}
Sep 14 10:51:55.837774 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:55.837303    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7729-ad7b59" event={"ID":"f102765d-3368-4b79-9643-97be918daa59","Type":"ContainerStarted","Data":"b929e998412e946953c1060104030bddb019574bb21d2e68a647cb7c2fd2ad1c"}
Sep 14 10:51:55.837774 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:55.837350    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7729-a73214" podUID="006e93cb-c75a-4745-b77d-4b335afae9dc" containerName="test-curl-7729-a73214" containerID="cri-o://7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3" gracePeriod=2
Sep 14 10:51:55.853950 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:55.853898    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7729-ad7b59" podStartSLOduration=1.8538581 podStartE2EDuration="1.8538581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:51:55.853151081 +0000 UTC m=+1638.738220189" watchObservedRunningTime="2026-09-14 10:51:55.8538581 +0000 UTC m=+1638.738927207"
Sep 14 10:51:56.488141 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:56.488103    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7729-ad7b59"]
Sep 14 10:51:56.490499 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:56.490472    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7729-ad7b59"]
Sep 14 10:51:56.843992 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:51:56.843958    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7729-ad7b59" container="test-curl-7729-ad7b59"
Sep 14 10:51:57.850906 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:57.850855    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7729-ad7b59" podUID="f102765d-3368-4b79-9643-97be918daa59" containerName="test-curl-7729-ad7b59" containerID="cri-o://4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1" gracePeriod=2
Sep 14 10:51:58.035707 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:58.035673    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-a73214"
Sep 14 10:51:58.102636 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:58.102550    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c65lk\" (UniqueName: \"kubernetes.io/projected/006e93cb-c75a-4745-b77d-4b335afae9dc-kube-api-access-c65lk\") pod \"006e93cb-c75a-4745-b77d-4b335afae9dc\" (UID: \"006e93cb-c75a-4745-b77d-4b335afae9dc\") "
Sep 14 10:51:58.104922 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:58.104888    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006e93cb-c75a-4745-b77d-4b335afae9dc-kube-api-access-c65lk" (OuterVolumeSpecName: "kube-api-access-c65lk") pod "006e93cb-c75a-4745-b77d-4b335afae9dc" (UID: "006e93cb-c75a-4745-b77d-4b335afae9dc"). InnerVolumeSpecName "kube-api-access-c65lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:51:58.203904 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:58.203836    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c65lk\" (UniqueName: \"kubernetes.io/projected/006e93cb-c75a-4745-b77d-4b335afae9dc-kube-api-access-c65lk\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:51:58.857632 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:58.857600    2574 generic.go:356] "Generic (PLEG): container finished" podID="006e93cb-c75a-4745-b77d-4b335afae9dc" containerID="7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3" exitCode=137
Sep 14 10:51:58.858130 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:58.857647    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-a73214"
Sep 14 10:51:58.858130 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:58.857706    2574 scope.go:117] "RemoveContainer" containerID="7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3"
Sep 14 10:51:58.866966 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:58.866949    2574 scope.go:117] "RemoveContainer" containerID="7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3"
Sep 14 10:51:58.867266 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:51:58.867250    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3\": container with ID starting with 7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3 not found: ID does not exist" containerID="7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3"
Sep 14 10:51:58.867314 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:58.867275    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3"} err="failed to get container status \"7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3\": rpc error: code = NotFound desc = could not find container \"7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3\": container with ID starting with 7ddcdd735930a9e1969b9dfff5f2de35303ef0feb5f0dae301f47e73229b01b3 not found: ID does not exist"
Sep 14 10:51:58.868294 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:51:58.868275    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7729-a73214\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="006e93cb-c75a-4745-b77d-4b335afae9dc" pod="opendatahub/test-curl-7729-a73214"
Sep 14 10:51:59.613568 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:51:59.613537    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="006e93cb-c75a-4745-b77d-4b335afae9dc" path="/var/lib/kubelet/pods/006e93cb-c75a-4745-b77d-4b335afae9dc/volumes"
Sep 14 10:52:00.038884 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:00.038844    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-ad7b59"
Sep 14 10:52:00.122321 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:00.122225    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6qlw\" (UniqueName: \"kubernetes.io/projected/f102765d-3368-4b79-9643-97be918daa59-kube-api-access-f6qlw\") pod \"f102765d-3368-4b79-9643-97be918daa59\" (UID: \"f102765d-3368-4b79-9643-97be918daa59\") "
Sep 14 10:52:00.124541 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:00.124506    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f102765d-3368-4b79-9643-97be918daa59-kube-api-access-f6qlw" (OuterVolumeSpecName: "kube-api-access-f6qlw") pod "f102765d-3368-4b79-9643-97be918daa59" (UID: "f102765d-3368-4b79-9643-97be918daa59"). InnerVolumeSpecName "kube-api-access-f6qlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:52:00.223383 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:00.223343    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6qlw\" (UniqueName: \"kubernetes.io/projected/f102765d-3368-4b79-9643-97be918daa59-kube-api-access-f6qlw\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:52:00.871827 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:00.871790    2574 generic.go:356] "Generic (PLEG): container finished" podID="f102765d-3368-4b79-9643-97be918daa59" containerID="4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1" exitCode=137
Sep 14 10:52:00.872038 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:00.871833    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-ad7b59"
Sep 14 10:52:00.872038 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:00.871927    2574 scope.go:117] "RemoveContainer" containerID="4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1"
Sep 14 10:52:00.882032 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:00.882013    2574 scope.go:117] "RemoveContainer" containerID="4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1"
Sep 14 10:52:00.882367 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:52:00.882346    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1\": container with ID starting with 4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1 not found: ID does not exist" containerID="4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1"
Sep 14 10:52:00.882420 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:00.882379    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1"} err="failed to get container status \"4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1\": rpc error: code = NotFound desc = could not find container \"4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1\": container with ID starting with 4d00d21ed9713379290d06402956181767acc34315b64df3da3b127ca095aec1 not found: ID does not exist"
Sep 14 10:52:00.882706 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:52:00.882685    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7729-ad7b59\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="f102765d-3368-4b79-9643-97be918daa59" pod="opendatahub/test-curl-7729-ad7b59"
Sep 14 10:52:01.609511 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:01.609474    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f102765d-3368-4b79-9643-97be918daa59" path="/var/lib/kubelet/pods/f102765d-3368-4b79-9643-97be918daa59/volumes"
Sep 14 10:52:38.126505 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:52:38.126386    2574 scope.go:117] "RemoveContainer" containerID="eb6b91bd94216bf5ef046fabce059e694ce35b646f870ebe47f0f76aad31f3c3"
Sep 14 10:54:16.641602 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:16.641574    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ncl9j_70af39b3-c409-42a2-8453-02e61a6a03ee/payload-processing/0.log"
Sep 14 10:54:38.253123 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:38.253095    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:54:38.265224 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:38.265199    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:54:47.583130 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:47.583098    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ncl9j_70af39b3-c409-42a2-8453-02e61a6a03ee/payload-processing/0.log"
Sep 14 10:54:56.435569 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.435530    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"]
Sep 14 10:54:56.436071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.435982    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f102765d-3368-4b79-9643-97be918daa59" containerName="test-curl-7729-ad7b59"
Sep 14 10:54:56.436071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.435994    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f102765d-3368-4b79-9643-97be918daa59" containerName="test-curl-7729-ad7b59"
Sep 14 10:54:56.436071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.436065    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f102765d-3368-4b79-9643-97be918daa59" containerName="test-curl-7729-ad7b59"
Sep 14 10:54:56.439324 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.439307    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:56.442444 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:54:56.442421    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-e2e-ipp-cleanup-7599d7-dockercfg-p8d5z\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-7599d7-dockercfg-p8d5z\"" type="*v1.Secret"
Sep 14 10:54:56.443374 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:54:56.443341    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-ipp-cleanup-7599d7\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-7599d7\"" type="*v1.ConfigMap"
Sep 14 10:54:56.443501 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:54:56.443476    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f\" is forbidden: User \"system:node:ip-10-0-141-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-156.ec2.internal' and this object" podUID="b9797241-40b6-4b10-9603-2a99860e7171" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:56.467779 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.467750    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"]
Sep 14 10:54:56.552015 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.551982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdgl\" (UniqueName: \"kubernetes.io/projected/b9797241-40b6-4b10-9603-2a99860e7171-kube-api-access-zrdgl\") pod \"payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f\" (UID: \"b9797241-40b6-4b10-9603-2a99860e7171\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:56.552204 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.552079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9797241-40b6-4b10-9603-2a99860e7171-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f\" (UID: \"b9797241-40b6-4b10-9603-2a99860e7171\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:56.652554 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.652522    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdgl\" (UniqueName: \"kubernetes.io/projected/b9797241-40b6-4b10-9603-2a99860e7171-kube-api-access-zrdgl\") pod \"payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f\" (UID: \"b9797241-40b6-4b10-9603-2a99860e7171\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:56.652742 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.652607    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9797241-40b6-4b10-9603-2a99860e7171-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f\" (UID: \"b9797241-40b6-4b10-9603-2a99860e7171\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:56.664095 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:56.664072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdgl\" (UniqueName: \"kubernetes.io/projected/b9797241-40b6-4b10-9603-2a99860e7171-kube-api-access-zrdgl\") pod \"payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f\" (UID: \"b9797241-40b6-4b10-9603-2a99860e7171\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:57.394269 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:57.394233    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-7599d7-dockercfg-p8d5z\""
Sep 14 10:54:57.653773 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:54:57.653738    2574 configmap.go:193] Couldn't get configMap openshift-ingress/payload-processing-plugins-e2e-ipp-cleanup-7599d7: failed to sync configmap cache: timed out waiting for the condition
Sep 14 10:54:57.654193 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:54:57.653834    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9797241-40b6-4b10-9603-2a99860e7171-plugins-config-volume podName:b9797241-40b6-4b10-9603-2a99860e7171 nodeName:}" failed. No retries permitted until 2026-09-14 10:54:58.153818782 +0000 UTC m=+1821.038887868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugins-config-volume" (UniqueName: "kubernetes.io/configmap/b9797241-40b6-4b10-9603-2a99860e7171-plugins-config-volume") pod "payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f" (UID: "b9797241-40b6-4b10-9603-2a99860e7171") : failed to sync configmap cache: timed out waiting for the condition
Sep 14 10:54:57.980064 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:57.979970    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-7599d7\""
Sep 14 10:54:58.168375 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:58.168319    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9797241-40b6-4b10-9603-2a99860e7171-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f\" (UID: \"b9797241-40b6-4b10-9603-2a99860e7171\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:58.169089 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:58.169065    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9797241-40b6-4b10-9603-2a99860e7171-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f\" (UID: \"b9797241-40b6-4b10-9603-2a99860e7171\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:58.249388 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:58.249280    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:54:58.529342 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:58.529316    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"]
Sep 14 10:54:58.531780 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:54:58.531750    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9797241_40b6_4b10_9603_2a99860e7171.slice/crio-de38c957430e70ae5a1963bd44370d25a1cb179f8cce627af24a49b9a5a24573 WatchSource:0}: Error finding container de38c957430e70ae5a1963bd44370d25a1cb179f8cce627af24a49b9a5a24573: Status 404 returned error can't find the container with id de38c957430e70ae5a1963bd44370d25a1cb179f8cce627af24a49b9a5a24573
Sep 14 10:54:58.907993 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:58.907947    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f" event={"ID":"b9797241-40b6-4b10-9603-2a99860e7171","Type":"ContainerStarted","Data":"d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916"}
Sep 14 10:54:58.908489 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:58.908008    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f" event={"ID":"b9797241-40b6-4b10-9603-2a99860e7171","Type":"ContainerStarted","Data":"de38c957430e70ae5a1963bd44370d25a1cb179f8cce627af24a49b9a5a24573"}
Sep 14 10:54:58.908489 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:54:58.908038    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:55:09.916923 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:09.916863    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:55:09.938819 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:09.938762    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f" podStartSLOduration=13.9387465 podStartE2EDuration="13.9387465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:54:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:54:58.953414548 +0000 UTC m=+1821.838483656" watchObservedRunningTime="2026-09-14 10:55:09.9387465 +0000 UTC m=+1832.823815607"
Sep 14 10:55:22.726927 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:22.726888    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"]
Sep 14 10:55:22.730738 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:22.730720    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"
Sep 14 10:55:22.733713 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:22.733695    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:55:22.743310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:22.743286    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"]
Sep 14 10:55:22.810231 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:22.810200    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms\" (UID: \"bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"
Sep 14 10:55:22.911588 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:22.911551    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms\" (UID: \"bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"
Sep 14 10:55:22.912283 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:22.912255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms\" (UID: \"bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"
Sep 14 10:55:23.042697 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:23.042601    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"
Sep 14 10:55:23.322161 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:23.321930    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"]
Sep 14 10:55:23.324626 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:55:23.324595    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf4bbbc0_5958_44bb_ac5e_c1f1cc5135b4.slice/crio-8d907de69e696aac4e06010a01b2c1be46f753c9bab1fa2886beaa52d88d56bd WatchSource:0}: Error finding container 8d907de69e696aac4e06010a01b2c1be46f753c9bab1fa2886beaa52d88d56bd: Status 404 returned error can't find the container with id 8d907de69e696aac4e06010a01b2c1be46f753c9bab1fa2886beaa52d88d56bd
Sep 14 10:55:24.054993 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:24.054953    2574 generic.go:356] "Generic (PLEG): container finished" podID="bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4" containerID="215f93755bc9d92c0c641d011dfe59f9a7bd68499eedcb280d02d5980715fd95" exitCode=0
Sep 14 10:55:24.055409 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:24.055037    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms" event={"ID":"bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4","Type":"ContainerDied","Data":"215f93755bc9d92c0c641d011dfe59f9a7bd68499eedcb280d02d5980715fd95"}
Sep 14 10:55:24.055409 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:24.055091    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms" event={"ID":"bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4","Type":"ContainerStarted","Data":"8d907de69e696aac4e06010a01b2c1be46f753c9bab1fa2886beaa52d88d56bd"}
Sep 14 10:55:25.206286 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:25.206263    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"
Sep 14 10:55:25.337515 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:25.337431    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4-maas-api-service-ca\") pod \"bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4\" (UID: \"bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4\") "
Sep 14 10:55:25.337859 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:25.337834    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4" (UID: "bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:55:25.439170 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:25.439135    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:55:26.067469 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:26.067441    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"
Sep 14 10:55:26.067661 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:26.067444    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms" event={"ID":"bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4","Type":"ContainerDied","Data":"8d907de69e696aac4e06010a01b2c1be46f753c9bab1fa2886beaa52d88d56bd"}
Sep 14 10:55:26.067661 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:26.067567    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d907de69e696aac4e06010a01b2c1be46f753c9bab1fa2886beaa52d88d56bd"
Sep 14 10:55:34.160028 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.159998    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"]
Sep 14 10:55:34.160567 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.160223    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f" podUID="b9797241-40b6-4b10-9603-2a99860e7171" containerName="payload-processing" containerID="cri-o://d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916" gracePeriod=30
Sep 14 10:55:34.442402 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.442374    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:55:34.529330 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.529302    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9797241-40b6-4b10-9603-2a99860e7171-plugins-config-volume\") pod \"b9797241-40b6-4b10-9603-2a99860e7171\" (UID: \"b9797241-40b6-4b10-9603-2a99860e7171\") "
Sep 14 10:55:34.529534 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.529489    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrdgl\" (UniqueName: \"kubernetes.io/projected/b9797241-40b6-4b10-9603-2a99860e7171-kube-api-access-zrdgl\") pod \"b9797241-40b6-4b10-9603-2a99860e7171\" (UID: \"b9797241-40b6-4b10-9603-2a99860e7171\") "
Sep 14 10:55:34.529699 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.529669    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9797241-40b6-4b10-9603-2a99860e7171-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9797241-40b6-4b10-9603-2a99860e7171" (UID: "b9797241-40b6-4b10-9603-2a99860e7171"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:55:34.529815 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.529797    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9797241-40b6-4b10-9603-2a99860e7171-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:55:34.531834 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.531806    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9797241-40b6-4b10-9603-2a99860e7171-kube-api-access-zrdgl" (OuterVolumeSpecName: "kube-api-access-zrdgl") pod "b9797241-40b6-4b10-9603-2a99860e7171" (UID: "b9797241-40b6-4b10-9603-2a99860e7171"). InnerVolumeSpecName "kube-api-access-zrdgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:55:34.611842 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.611806    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"]
Sep 14 10:55:34.618481 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.618449    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7599d7-4c8ms"]
Sep 14 10:55:34.631427 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:34.631394    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrdgl\" (UniqueName: \"kubernetes.io/projected/b9797241-40b6-4b10-9603-2a99860e7171-kube-api-access-zrdgl\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:55:35.122780 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.122738    2574 generic.go:356] "Generic (PLEG): container finished" podID="b9797241-40b6-4b10-9603-2a99860e7171" containerID="d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916" exitCode=0
Sep 14 10:55:35.123022 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.122798    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"
Sep 14 10:55:35.123022 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.122849    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f" event={"ID":"b9797241-40b6-4b10-9603-2a99860e7171","Type":"ContainerDied","Data":"d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916"}
Sep 14 10:55:35.123022 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.122945    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f" event={"ID":"b9797241-40b6-4b10-9603-2a99860e7171","Type":"ContainerDied","Data":"de38c957430e70ae5a1963bd44370d25a1cb179f8cce627af24a49b9a5a24573"}
Sep 14 10:55:35.123022 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.122976    2574 scope.go:117] "RemoveContainer" containerID="d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916"
Sep 14 10:55:35.133441 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.133421    2574 scope.go:117] "RemoveContainer" containerID="d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916"
Sep 14 10:55:35.133755 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:55:35.133733    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916\": container with ID starting with d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916 not found: ID does not exist" containerID="d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916"
Sep 14 10:55:35.133818 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.133765    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916"} err="failed to get container status \"d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916\": rpc error: code = NotFound desc = could not find container \"d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916\": container with ID starting with d291613b4d0e4a098407d34125298feea5e2194c32301a6dc744b527a2bbc916 not found: ID does not exist"
Sep 14 10:55:35.158757 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.158723    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"]
Sep 14 10:55:35.165402 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.165374    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7599d7-5679466c8f-nds9f"]
Sep 14 10:55:35.610972 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.610944    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9797241-40b6-4b10-9603-2a99860e7171" path="/var/lib/kubelet/pods/b9797241-40b6-4b10-9603-2a99860e7171/volumes"
Sep 14 10:55:35.611319 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:35.611306    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4" path="/var/lib/kubelet/pods/bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4/volumes"
Sep 14 10:55:45.074038 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.074003    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"]
Sep 14 10:55:45.074469 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.074456    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9797241-40b6-4b10-9603-2a99860e7171" containerName="payload-processing"
Sep 14 10:55:45.074519 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.074471    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9797241-40b6-4b10-9603-2a99860e7171" containerName="payload-processing"
Sep 14 10:55:45.074519 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.074486    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4" containerName="revoke-keys"
Sep 14 10:55:45.074519 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.074491    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4" containerName="revoke-keys"
Sep 14 10:55:45.074614 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.074559    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf4bbbc0-5958-44bb-ac5e-c1f1cc5135b4" containerName="revoke-keys"
Sep 14 10:55:45.074614 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.074568    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9797241-40b6-4b10-9603-2a99860e7171" containerName="payload-processing"
Sep 14 10:55:45.078547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.078514    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"
Sep 14 10:55:45.083022 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.082988    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:55:45.090126 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.090100    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"]
Sep 14 10:55:45.136071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.136028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2caab006-e4a6-4979-8990-f3a0b1c718d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d\" (UID: \"2caab006-e4a6-4979-8990-f3a0b1c718d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"
Sep 14 10:55:45.236683 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.236636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2caab006-e4a6-4979-8990-f3a0b1c718d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d\" (UID: \"2caab006-e4a6-4979-8990-f3a0b1c718d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"
Sep 14 10:55:45.237337 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.237314    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2caab006-e4a6-4979-8990-f3a0b1c718d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d\" (UID: \"2caab006-e4a6-4979-8990-f3a0b1c718d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"
Sep 14 10:55:45.392516 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.392425    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"
Sep 14 10:55:45.675255 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:45.675226    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"]
Sep 14 10:55:45.677588 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:55:45.677548    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2caab006_e4a6_4979_8990_f3a0b1c718d2.slice/crio-7c444a082916b37d98cf553148de4d34de765f3e98667c92934090a2b94f0f70 WatchSource:0}: Error finding container 7c444a082916b37d98cf553148de4d34de765f3e98667c92934090a2b94f0f70: Status 404 returned error can't find the container with id 7c444a082916b37d98cf553148de4d34de765f3e98667c92934090a2b94f0f70
Sep 14 10:55:46.191233 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:46.191198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d" event={"ID":"2caab006-e4a6-4979-8990-f3a0b1c718d2","Type":"ContainerStarted","Data":"d218d51f7c9706c33d93fcd3ed719616a9f9ae42048eaa3338dfdd3f05f2fdc6"}
Sep 14 10:55:46.191678 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:46.191254    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d" event={"ID":"2caab006-e4a6-4979-8990-f3a0b1c718d2","Type":"ContainerStarted","Data":"7c444a082916b37d98cf553148de4d34de765f3e98667c92934090a2b94f0f70"}
Sep 14 10:55:46.210568 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:46.210499    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d" podStartSLOduration=1.210475365 podStartE2EDuration="1.210475365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:55:46.206723736 +0000 UTC m=+1869.091792847" watchObservedRunningTime="2026-09-14 10:55:46.210475365 +0000 UTC m=+1869.095544474"
Sep 14 10:55:47.198850 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:47.198806    2574 generic.go:356] "Generic (PLEG): container finished" podID="2caab006-e4a6-4979-8990-f3a0b1c718d2" containerID="d218d51f7c9706c33d93fcd3ed719616a9f9ae42048eaa3338dfdd3f05f2fdc6" exitCode=0
Sep 14 10:55:47.199305 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:47.198926    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d" event={"ID":"2caab006-e4a6-4979-8990-f3a0b1c718d2","Type":"ContainerDied","Data":"d218d51f7c9706c33d93fcd3ed719616a9f9ae42048eaa3338dfdd3f05f2fdc6"}
Sep 14 10:55:48.357784 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:48.357754    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"
Sep 14 10:55:48.361024 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:48.361001    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2caab006-e4a6-4979-8990-f3a0b1c718d2-maas-api-service-ca\") pod \"2caab006-e4a6-4979-8990-f3a0b1c718d2\" (UID: \"2caab006-e4a6-4979-8990-f3a0b1c718d2\") "
Sep 14 10:55:48.361347 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:48.361326    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2caab006-e4a6-4979-8990-f3a0b1c718d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2caab006-e4a6-4979-8990-f3a0b1c718d2" (UID: "2caab006-e4a6-4979-8990-f3a0b1c718d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:55:48.461804 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:48.461702    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2caab006-e4a6-4979-8990-f3a0b1c718d2-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:55:49.212457 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:49.212423    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"
Sep 14 10:55:49.212679 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:49.212422    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d" event={"ID":"2caab006-e4a6-4979-8990-f3a0b1c718d2","Type":"ContainerDied","Data":"7c444a082916b37d98cf553148de4d34de765f3e98667c92934090a2b94f0f70"}
Sep 14 10:55:49.212679 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:55:49.212542    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c444a082916b37d98cf553148de4d34de765f3e98667c92934090a2b94f0f70"
Sep 14 10:56:00.873417 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:00.873303    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"]
Sep 14 10:56:00.876184 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:00.876153    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-689fac-fgm6d"]
Sep 14 10:56:01.610756 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:01.610726    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2caab006-e4a6-4979-8990-f3a0b1c718d2" path="/var/lib/kubelet/pods/2caab006-e4a6-4979-8990-f3a0b1c718d2/volumes"
Sep 14 10:56:38.204561 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:38.204519    2574 scope.go:117] "RemoveContainer" containerID="05fb589fc3182686ca1cfffd5b7823864e44c798138169901639a50de344ef73"
Sep 14 10:56:38.215223 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:38.215192    2574 scope.go:117] "RemoveContainer" containerID="056d16fd7e6c4a1b320b67e3874d3728f60275774ded7811b2a1c48b93a38d9f"
Sep 14 10:56:38.225173 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:38.225143    2574 scope.go:117] "RemoveContainer" containerID="6c15ff5f8f96a9d4f75cd89d93e29ea89344183fb31ac31e59d0fd7c8dd83641"
Sep 14 10:56:38.233788 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:38.233771    2574 scope.go:117] "RemoveContainer" containerID="99b7cfaf8e4a6fddba6f069c24a7ee563e47b43e1e37c9165813934e5a8098e3"
Sep 14 10:56:49.848735 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:49.848697    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"]
Sep 14 10:56:49.849187 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:49.849173    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2caab006-e4a6-4979-8990-f3a0b1c718d2" containerName="revoke-keys"
Sep 14 10:56:49.849233 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:49.849188    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2caab006-e4a6-4979-8990-f3a0b1c718d2" containerName="revoke-keys"
Sep 14 10:56:49.849272 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:49.849254    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2caab006-e4a6-4979-8990-f3a0b1c718d2" containerName="revoke-keys"
Sep 14 10:56:49.852455 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:49.852436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"
Sep 14 10:56:49.855326 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:49.855302    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:56:49.862284 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:49.862256    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"]
Sep 14 10:56:49.984397 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:49.984361    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eac9a3-b100-426f-8ec0-1e44bdfe1e65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2\" (UID: \"d2eac9a3-b100-426f-8ec0-1e44bdfe1e65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"
Sep 14 10:56:50.085047 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:50.085002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eac9a3-b100-426f-8ec0-1e44bdfe1e65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2\" (UID: \"d2eac9a3-b100-426f-8ec0-1e44bdfe1e65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"
Sep 14 10:56:50.085643 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:50.085621    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eac9a3-b100-426f-8ec0-1e44bdfe1e65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2\" (UID: \"d2eac9a3-b100-426f-8ec0-1e44bdfe1e65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"
Sep 14 10:56:50.164547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:50.164504    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"
Sep 14 10:56:50.444524 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:50.444496    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"]
Sep 14 10:56:50.447410 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:56:50.447377    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2eac9a3_b100_426f_8ec0_1e44bdfe1e65.slice/crio-709b3e3a4e34c340a0c0080919704b6e65868bfc5ab0ac571bbc42f3ff75fd5f WatchSource:0}: Error finding container 709b3e3a4e34c340a0c0080919704b6e65868bfc5ab0ac571bbc42f3ff75fd5f: Status 404 returned error can't find the container with id 709b3e3a4e34c340a0c0080919704b6e65868bfc5ab0ac571bbc42f3ff75fd5f
Sep 14 10:56:50.583023 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:50.582990    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2" event={"ID":"d2eac9a3-b100-426f-8ec0-1e44bdfe1e65","Type":"ContainerStarted","Data":"709b3e3a4e34c340a0c0080919704b6e65868bfc5ab0ac571bbc42f3ff75fd5f"}
Sep 14 10:56:51.590384 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:51.590351    2574 generic.go:356] "Generic (PLEG): container finished" podID="d2eac9a3-b100-426f-8ec0-1e44bdfe1e65" containerID="2dd4cfef547ecb748e784e68508c265e0d565d109216f77506f1a6de66f42e24" exitCode=0
Sep 14 10:56:51.590801 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:51.590434    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2" event={"ID":"d2eac9a3-b100-426f-8ec0-1e44bdfe1e65","Type":"ContainerDied","Data":"2dd4cfef547ecb748e784e68508c265e0d565d109216f77506f1a6de66f42e24"}
Sep 14 10:56:52.742788 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:52.742763    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"
Sep 14 10:56:52.811538 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:52.811505    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eac9a3-b100-426f-8ec0-1e44bdfe1e65-maas-api-service-ca\") pod \"d2eac9a3-b100-426f-8ec0-1e44bdfe1e65\" (UID: \"d2eac9a3-b100-426f-8ec0-1e44bdfe1e65\") "
Sep 14 10:56:52.811993 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:52.811967    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2eac9a3-b100-426f-8ec0-1e44bdfe1e65-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d2eac9a3-b100-426f-8ec0-1e44bdfe1e65" (UID: "d2eac9a3-b100-426f-8ec0-1e44bdfe1e65"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:56:52.913261 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:52.913227    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2eac9a3-b100-426f-8ec0-1e44bdfe1e65-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:56:53.604310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:53.604279    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"
Sep 14 10:56:53.610250 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:53.610219    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2" event={"ID":"d2eac9a3-b100-426f-8ec0-1e44bdfe1e65","Type":"ContainerDied","Data":"709b3e3a4e34c340a0c0080919704b6e65868bfc5ab0ac571bbc42f3ff75fd5f"}
Sep 14 10:56:53.610417 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:56:53.610268    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="709b3e3a4e34c340a0c0080919704b6e65868bfc5ab0ac571bbc42f3ff75fd5f"
Sep 14 10:57:00.565203 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:00.565152    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"]
Sep 14 10:57:00.567976 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:00.567944    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-7406d4-4gbt2"]
Sep 14 10:57:01.610216 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:01.610184    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2eac9a3-b100-426f-8ec0-1e44bdfe1e65" path="/var/lib/kubelet/pods/d2eac9a3-b100-426f-8ec0-1e44bdfe1e65/volumes"
Sep 14 10:57:07.430332 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.430296    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"]
Sep 14 10:57:07.430760 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.430729    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2eac9a3-b100-426f-8ec0-1e44bdfe1e65" containerName="revoke-keys"
Sep 14 10:57:07.430760 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.430740    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2eac9a3-b100-426f-8ec0-1e44bdfe1e65" containerName="revoke-keys"
Sep 14 10:57:07.430841 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.430827    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2eac9a3-b100-426f-8ec0-1e44bdfe1e65" containerName="revoke-keys"
Sep 14 10:57:07.434341 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.434319    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"
Sep 14 10:57:07.436948 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.436923    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:57:07.441920 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.441887    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"]
Sep 14 10:57:07.463792 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.463758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/810b790a-3a33-428e-873f-43d7b3fd3449-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n\" (UID: \"810b790a-3a33-428e-873f-43d7b3fd3449\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"
Sep 14 10:57:07.565351 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.565316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/810b790a-3a33-428e-873f-43d7b3fd3449-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n\" (UID: \"810b790a-3a33-428e-873f-43d7b3fd3449\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"
Sep 14 10:57:07.566000 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.565982    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/810b790a-3a33-428e-873f-43d7b3fd3449-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n\" (UID: \"810b790a-3a33-428e-873f-43d7b3fd3449\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"
Sep 14 10:57:07.747560 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:07.747422    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"
Sep 14 10:57:08.021788 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:08.021764    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"]
Sep 14 10:57:08.024041 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:57:08.024009    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810b790a_3a33_428e_873f_43d7b3fd3449.slice/crio-1024cb2568f88f9097bc713bf130a19610b6f481de30bb9f64d8fe8638eabf4c WatchSource:0}: Error finding container 1024cb2568f88f9097bc713bf130a19610b6f481de30bb9f64d8fe8638eabf4c: Status 404 returned error can't find the container with id 1024cb2568f88f9097bc713bf130a19610b6f481de30bb9f64d8fe8638eabf4c
Sep 14 10:57:08.691235 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:08.691203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n" event={"ID":"810b790a-3a33-428e-873f-43d7b3fd3449","Type":"ContainerStarted","Data":"eb32a75540accb1e94606cc41df8f5a853da113286ba6cdae66c4755f3f65b3f"}
Sep 14 10:57:08.691654 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:08.691255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n" event={"ID":"810b790a-3a33-428e-873f-43d7b3fd3449","Type":"ContainerStarted","Data":"1024cb2568f88f9097bc713bf130a19610b6f481de30bb9f64d8fe8638eabf4c"}
Sep 14 10:57:08.714530 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:08.714467    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n" podStartSLOduration=1.714441178 podStartE2EDuration="1.714441178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:57:08.711422827 +0000 UTC m=+1951.596491937" watchObservedRunningTime="2026-09-14 10:57:08.714441178 +0000 UTC m=+1951.599510287"
Sep 14 10:57:09.698438 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:09.698404    2574 generic.go:356] "Generic (PLEG): container finished" podID="810b790a-3a33-428e-873f-43d7b3fd3449" containerID="eb32a75540accb1e94606cc41df8f5a853da113286ba6cdae66c4755f3f65b3f" exitCode=0
Sep 14 10:57:09.698950 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:09.698490    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n" event={"ID":"810b790a-3a33-428e-873f-43d7b3fd3449","Type":"ContainerDied","Data":"eb32a75540accb1e94606cc41df8f5a853da113286ba6cdae66c4755f3f65b3f"}
Sep 14 10:57:10.839622 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:10.839594    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"
Sep 14 10:57:10.899950 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:10.899904    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/810b790a-3a33-428e-873f-43d7b3fd3449-maas-api-service-ca\") pod \"810b790a-3a33-428e-873f-43d7b3fd3449\" (UID: \"810b790a-3a33-428e-873f-43d7b3fd3449\") "
Sep 14 10:57:10.900256 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:10.900233    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/810b790a-3a33-428e-873f-43d7b3fd3449-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "810b790a-3a33-428e-873f-43d7b3fd3449" (UID: "810b790a-3a33-428e-873f-43d7b3fd3449"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:57:11.000897 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:11.000795    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/810b790a-3a33-428e-873f-43d7b3fd3449-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:57:11.712360 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:11.712326    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"
Sep 14 10:57:11.712549 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:11.712356    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n" event={"ID":"810b790a-3a33-428e-873f-43d7b3fd3449","Type":"ContainerDied","Data":"1024cb2568f88f9097bc713bf130a19610b6f481de30bb9f64d8fe8638eabf4c"}
Sep 14 10:57:11.712549 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:11.712417    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1024cb2568f88f9097bc713bf130a19610b6f481de30bb9f64d8fe8638eabf4c"
Sep 14 10:57:17.998219 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:17.998182    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z"]
Sep 14 10:57:18.003412 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.003362    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1cbcd0-29823045-mnt5z"]
Sep 14 10:57:18.031151 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.031099    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"]
Sep 14 10:57:18.031421 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.031388    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6" podUID="23930b48-e0a9-4cc0-a4e2-688b641cea7d" containerName="payload-processing" containerID="cri-o://3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520" gracePeriod=30
Sep 14 10:57:18.185442 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.185394    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"]
Sep 14 10:57:18.188996 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.188965    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1cbcd0-v764n"]
Sep 14 10:57:18.313997 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.313959    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:57:18.372966 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.372935    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23930b48-e0a9-4cc0-a4e2-688b641cea7d-plugins-config-volume\") pod \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\" (UID: \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\") "
Sep 14 10:57:18.373181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.372995    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgrl2\" (UniqueName: \"kubernetes.io/projected/23930b48-e0a9-4cc0-a4e2-688b641cea7d-kube-api-access-qgrl2\") pod \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\" (UID: \"23930b48-e0a9-4cc0-a4e2-688b641cea7d\") "
Sep 14 10:57:18.373416 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.373383    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23930b48-e0a9-4cc0-a4e2-688b641cea7d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23930b48-e0a9-4cc0-a4e2-688b641cea7d" (UID: "23930b48-e0a9-4cc0-a4e2-688b641cea7d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:57:18.375280 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.375257    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23930b48-e0a9-4cc0-a4e2-688b641cea7d-kube-api-access-qgrl2" (OuterVolumeSpecName: "kube-api-access-qgrl2") pod "23930b48-e0a9-4cc0-a4e2-688b641cea7d" (UID: "23930b48-e0a9-4cc0-a4e2-688b641cea7d"). InnerVolumeSpecName "kube-api-access-qgrl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:57:18.474785 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.474752    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgrl2\" (UniqueName: \"kubernetes.io/projected/23930b48-e0a9-4cc0-a4e2-688b641cea7d-kube-api-access-qgrl2\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:57:18.474785 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.474780    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23930b48-e0a9-4cc0-a4e2-688b641cea7d-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:57:18.755133 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.755097    2574 generic.go:356] "Generic (PLEG): container finished" podID="23930b48-e0a9-4cc0-a4e2-688b641cea7d" containerID="3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520" exitCode=0
Sep 14 10:57:18.755133 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.755135    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"
Sep 14 10:57:18.755396 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.755182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6" event={"ID":"23930b48-e0a9-4cc0-a4e2-688b641cea7d","Type":"ContainerDied","Data":"3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520"}
Sep 14 10:57:18.755396 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.755235    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6" event={"ID":"23930b48-e0a9-4cc0-a4e2-688b641cea7d","Type":"ContainerDied","Data":"05be97562d7dfd61c357a7e1d26ea9ecc1dbb1a68645c1513755150f9e15e1f6"}
Sep 14 10:57:18.755396 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.755256    2574 scope.go:117] "RemoveContainer" containerID="3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520"
Sep 14 10:57:18.764739 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.764721    2574 scope.go:117] "RemoveContainer" containerID="3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520"
Sep 14 10:57:18.765105 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:57:18.765086    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520\": container with ID starting with 3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520 not found: ID does not exist" containerID="3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520"
Sep 14 10:57:18.765181 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.765118    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520"} err="failed to get container status \"3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520\": rpc error: code = NotFound desc = could not find container \"3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520\": container with ID starting with 3d5c0b0e954edc0dcbbc46750e2975f0e377b63b683873a09b057c26880bf520 not found: ID does not exist"
Sep 14 10:57:18.781596 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.781559    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"]
Sep 14 10:57:18.786259 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:18.786230    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1cbcd0-5dbd87cccc-m68h6"]
Sep 14 10:57:19.609887 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:19.609834    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23930b48-e0a9-4cc0-a4e2-688b641cea7d" path="/var/lib/kubelet/pods/23930b48-e0a9-4cc0-a4e2-688b641cea7d/volumes"
Sep 14 10:57:19.610367 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:19.610335    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="810b790a-3a33-428e-873f-43d7b3fd3449" path="/var/lib/kubelet/pods/810b790a-3a33-428e-873f-43d7b3fd3449/volumes"
Sep 14 10:57:19.610700 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:19.610680    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c84fec2e-be48-4f8a-845a-8cab52a47ebb" path="/var/lib/kubelet/pods/c84fec2e-be48-4f8a-845a-8cab52a47ebb/volumes"
Sep 14 10:57:25.257860 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.257823    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"]
Sep 14 10:57:25.258265 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.258251    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="810b790a-3a33-428e-873f-43d7b3fd3449" containerName="revoke-keys"
Sep 14 10:57:25.258313 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.258268    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="810b790a-3a33-428e-873f-43d7b3fd3449" containerName="revoke-keys"
Sep 14 10:57:25.258313 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.258279    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23930b48-e0a9-4cc0-a4e2-688b641cea7d" containerName="payload-processing"
Sep 14 10:57:25.258313 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.258285    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="23930b48-e0a9-4cc0-a4e2-688b641cea7d" containerName="payload-processing"
Sep 14 10:57:25.258414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.258362    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="810b790a-3a33-428e-873f-43d7b3fd3449" containerName="revoke-keys"
Sep 14 10:57:25.258414 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.258373    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="23930b48-e0a9-4cc0-a4e2-688b641cea7d" containerName="payload-processing"
Sep 14 10:57:25.262778 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.262758    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"
Sep 14 10:57:25.265854 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.265826    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 10:57:25.270849 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.270811    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"]
Sep 14 10:57:25.345769 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.345734    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35be788-f056-4913-b89a-88340d6ef596-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25\" (UID: \"c35be788-f056-4913-b89a-88340d6ef596\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"
Sep 14 10:57:25.446527 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.446489    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35be788-f056-4913-b89a-88340d6ef596-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25\" (UID: \"c35be788-f056-4913-b89a-88340d6ef596\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"
Sep 14 10:57:25.447156 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.447134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35be788-f056-4913-b89a-88340d6ef596-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25\" (UID: \"c35be788-f056-4913-b89a-88340d6ef596\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"
Sep 14 10:57:25.575811 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.575715    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"
Sep 14 10:57:25.853198 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:25.853168    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"]
Sep 14 10:57:25.854766 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:57:25.854737    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35be788_f056_4913_b89a_88340d6ef596.slice/crio-94fe80dd9d114ecfb4959e61b60b543f3d94a33ac6b1e79d716294bdf632bd85 WatchSource:0}: Error finding container 94fe80dd9d114ecfb4959e61b60b543f3d94a33ac6b1e79d716294bdf632bd85: Status 404 returned error can't find the container with id 94fe80dd9d114ecfb4959e61b60b543f3d94a33ac6b1e79d716294bdf632bd85
Sep 14 10:57:26.802315 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:26.802280    2574 generic.go:356] "Generic (PLEG): container finished" podID="c35be788-f056-4913-b89a-88340d6ef596" containerID="01654b962bc9c1955df05a92ec36b41e351d568af5b670c636bf7a6887a6081b" exitCode=0
Sep 14 10:57:26.802810 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:26.802374    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25" event={"ID":"c35be788-f056-4913-b89a-88340d6ef596","Type":"ContainerDied","Data":"01654b962bc9c1955df05a92ec36b41e351d568af5b670c636bf7a6887a6081b"}
Sep 14 10:57:26.802810 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:26.802434    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25" event={"ID":"c35be788-f056-4913-b89a-88340d6ef596","Type":"ContainerStarted","Data":"94fe80dd9d114ecfb4959e61b60b543f3d94a33ac6b1e79d716294bdf632bd85"}
Sep 14 10:57:27.960828 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:27.960798    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"
Sep 14 10:57:28.073752 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:28.073653    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35be788-f056-4913-b89a-88340d6ef596-maas-api-service-ca\") pod \"c35be788-f056-4913-b89a-88340d6ef596\" (UID: \"c35be788-f056-4913-b89a-88340d6ef596\") "
Sep 14 10:57:28.074067 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:28.074043    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c35be788-f056-4913-b89a-88340d6ef596-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c35be788-f056-4913-b89a-88340d6ef596" (UID: "c35be788-f056-4913-b89a-88340d6ef596"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:57:28.174982 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:28.174936    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c35be788-f056-4913-b89a-88340d6ef596-maas-api-service-ca\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:57:28.816196 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:28.816104    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"
Sep 14 10:57:28.816196 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:28.816140    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25" event={"ID":"c35be788-f056-4913-b89a-88340d6ef596","Type":"ContainerDied","Data":"94fe80dd9d114ecfb4959e61b60b543f3d94a33ac6b1e79d716294bdf632bd85"}
Sep 14 10:57:28.816196 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:28.816193    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94fe80dd9d114ecfb4959e61b60b543f3d94a33ac6b1e79d716294bdf632bd85"
Sep 14 10:57:35.930963 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:35.930928    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6"]
Sep 14 10:57:35.936317 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:35.936279    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7bdcda-29823045-t4dk6"]
Sep 14 10:57:35.961256 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:35.961224    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"]
Sep 14 10:57:35.961511 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:35.961478    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w" podUID="324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f" containerName="payload-processing" containerID="cri-o://af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe" gracePeriod=30
Sep 14 10:57:36.174157 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.174036    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"]
Sep 14 10:57:36.176520 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.176493    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7bdcda-dff25"]
Sep 14 10:57:36.231345 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.231315    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:57:36.357221 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.357186    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-plugins-config-volume\") pod \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\" (UID: \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\") "
Sep 14 10:57:36.357432 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.357236    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nclm9\" (UniqueName: \"kubernetes.io/projected/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-kube-api-access-nclm9\") pod \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\" (UID: \"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f\") "
Sep 14 10:57:36.357680 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.357654    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f" (UID: "324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:57:36.359597 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.359573    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-kube-api-access-nclm9" (OuterVolumeSpecName: "kube-api-access-nclm9") pod "324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f" (UID: "324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f"). InnerVolumeSpecName "kube-api-access-nclm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:57:36.458699 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.458604    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-plugins-config-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:57:36.458699 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.458639    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nclm9\" (UniqueName: \"kubernetes.io/projected/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f-kube-api-access-nclm9\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:57:36.865310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.865214    2574 generic.go:356] "Generic (PLEG): container finished" podID="324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f" containerID="af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe" exitCode=0
Sep 14 10:57:36.865310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.865258    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"
Sep 14 10:57:36.865310 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.865294    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w" event={"ID":"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f","Type":"ContainerDied","Data":"af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe"}
Sep 14 10:57:36.865547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.865354    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w" event={"ID":"324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f","Type":"ContainerDied","Data":"7b54831277132a84ccc67eee31738c4a4b4763acddd9f86695fb63351527e7f8"}
Sep 14 10:57:36.865547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.865378    2574 scope.go:117] "RemoveContainer" containerID="af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe"
Sep 14 10:57:36.875661 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.875644    2574 scope.go:117] "RemoveContainer" containerID="af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe"
Sep 14 10:57:36.876033 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:57:36.876009    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe\": container with ID starting with af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe not found: ID does not exist" containerID="af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe"
Sep 14 10:57:36.876141 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.876042    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe"} err="failed to get container status \"af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe\": rpc error: code = NotFound desc = could not find container \"af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe\": container with ID starting with af99a8f39806cc15a6556c2e0a04349060245c332eb3f17dfa5f18167ff39ffe not found: ID does not exist"
Sep 14 10:57:36.888260 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.888235    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"]
Sep 14 10:57:36.892174 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:36.892149    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7bdcda-7d4d7d4c75-mm46w"]
Sep 14 10:57:37.609082 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:37.609052    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f" path="/var/lib/kubelet/pods/324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f/volumes"
Sep 14 10:57:37.609479 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:37.609368    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="580a8270-27d6-4e6e-a3b8-0b316c8b3ed4" path="/var/lib/kubelet/pods/580a8270-27d6-4e6e-a3b8-0b316c8b3ed4/volumes"
Sep 14 10:57:37.609614 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:37.609602    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c35be788-f056-4913-b89a-88340d6ef596" path="/var/lib/kubelet/pods/c35be788-f056-4913-b89a-88340d6ef596/volumes"
Sep 14 10:57:38.267053 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:38.267024    2574 scope.go:117] "RemoveContainer" containerID="d7d37f3720649abe698df02de022cd59d25a034049e514ead46526c9855f4a57"
Sep 14 10:57:38.276753 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:38.276727    2574 scope.go:117] "RemoveContainer" containerID="c8680c46e42383f175953af052d3f375a2afccaee18a619d5c8d87731a1db1a9"
Sep 14 10:57:38.285152 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:38.285128    2574 scope.go:117] "RemoveContainer" containerID="27bc2fa37303904d009912f44bfd0352222e89dd0de0e1266ae80aac1b70dd1f"
Sep 14 10:57:45.741308 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:45.741262    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6555589997-8jpzl"]
Sep 14 10:57:45.741950 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:45.741509    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6555589997-8jpzl" podUID="0c72753d-076b-4d96-9422-135fcd201781" containerName="manager" containerID="cri-o://330a42bfd78009f9595a29ec847e757bd3ac6aaee5d86d19960cb92f7626f3f9" gracePeriod=30
Sep 14 10:57:45.925516 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:45.925270    2574 generic.go:356] "Generic (PLEG): container finished" podID="0c72753d-076b-4d96-9422-135fcd201781" containerID="330a42bfd78009f9595a29ec847e757bd3ac6aaee5d86d19960cb92f7626f3f9" exitCode=0
Sep 14 10:57:45.925516 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:45.925365    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-8jpzl" event={"ID":"0c72753d-076b-4d96-9422-135fcd201781","Type":"ContainerDied","Data":"330a42bfd78009f9595a29ec847e757bd3ac6aaee5d86d19960cb92f7626f3f9"}
Sep 14 10:57:46.008100 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.008022    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:57:46.054340 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.054309    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-webhook-cert\") pod \"0c72753d-076b-4d96-9422-135fcd201781\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") "
Sep 14 10:57:46.054527 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.054375    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr2xk\" (UniqueName: \"kubernetes.io/projected/0c72753d-076b-4d96-9422-135fcd201781-kube-api-access-vr2xk\") pod \"0c72753d-076b-4d96-9422-135fcd201781\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") "
Sep 14 10:57:46.054527 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.054451    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-metrics-certs\") pod \"0c72753d-076b-4d96-9422-135fcd201781\" (UID: \"0c72753d-076b-4d96-9422-135fcd201781\") "
Sep 14 10:57:46.056907 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.056845    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0c72753d-076b-4d96-9422-135fcd201781" (UID: "0c72753d-076b-4d96-9422-135fcd201781"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:57:46.057071 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.057040    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c72753d-076b-4d96-9422-135fcd201781-kube-api-access-vr2xk" (OuterVolumeSpecName: "kube-api-access-vr2xk") pod "0c72753d-076b-4d96-9422-135fcd201781" (UID: "0c72753d-076b-4d96-9422-135fcd201781"). InnerVolumeSpecName "kube-api-access-vr2xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:57:46.057214 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.057184    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0c72753d-076b-4d96-9422-135fcd201781" (UID: "0c72753d-076b-4d96-9422-135fcd201781"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:57:46.156139 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.156103    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr2xk\" (UniqueName: \"kubernetes.io/projected/0c72753d-076b-4d96-9422-135fcd201781-kube-api-access-vr2xk\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:57:46.156139 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.156134    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-metrics-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:57:46.156139 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.156143    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c72753d-076b-4d96-9422-135fcd201781-webhook-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:57:46.931929 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.931894    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-8jpzl" event={"ID":"0c72753d-076b-4d96-9422-135fcd201781","Type":"ContainerDied","Data":"c6f2c0125c439a1a786c14963ef470de219418bf16773d4db67baf948b796ab7"}
Sep 14 10:57:46.931929 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.931923    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-8jpzl"
Sep 14 10:57:46.932441 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.931958    2574 scope.go:117] "RemoveContainer" containerID="330a42bfd78009f9595a29ec847e757bd3ac6aaee5d86d19960cb92f7626f3f9"
Sep 14 10:57:46.954816 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.954783    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6555589997-8jpzl"]
Sep 14 10:57:46.959491 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:46.959462    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6555589997-8jpzl"]
Sep 14 10:57:47.614093 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:57:47.614052    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c72753d-076b-4d96-9422-135fcd201781" path="/var/lib/kubelet/pods/0c72753d-076b-4d96-9422-135fcd201781/volumes"
Sep 14 10:58:47.783373 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.783336    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6555589997-7p6qv"]
Sep 14 10:58:47.783903 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.783884    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35be788-f056-4913-b89a-88340d6ef596" containerName="revoke-keys"
Sep 14 10:58:47.783960 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.783906    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35be788-f056-4913-b89a-88340d6ef596" containerName="revoke-keys"
Sep 14 10:58:47.783960 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.783918    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f" containerName="payload-processing"
Sep 14 10:58:47.783960 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.783924    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f" containerName="payload-processing"
Sep 14 10:58:47.783960 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.783935    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c72753d-076b-4d96-9422-135fcd201781" containerName="manager"
Sep 14 10:58:47.783960 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.783941    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c72753d-076b-4d96-9422-135fcd201781" containerName="manager"
Sep 14 10:58:47.784122 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.784003    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35be788-f056-4913-b89a-88340d6ef596" containerName="revoke-keys"
Sep 14 10:58:47.784122 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.784013    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c72753d-076b-4d96-9422-135fcd201781" containerName="manager"
Sep 14 10:58:47.784122 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.784022    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="324e53cc-32b2-46f1-b7f6-9fbbf85cbd0f" containerName="payload-processing"
Sep 14 10:58:47.786744 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.786728    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:47.790793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.790765    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 14 10:58:47.790793 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.790791    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 14 10:58:47.791086 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.790843    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7ckql\""
Sep 14 10:58:47.791086 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.790906    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 14 10:58:47.797410 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.797387    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6555589997-7p6qv"]
Sep 14 10:58:47.954094 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.954054    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-webhook-cert\") pod \"maas-controller-6555589997-7p6qv\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") " pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:47.954273 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.954141    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-metrics-certs\") pod \"maas-controller-6555589997-7p6qv\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") " pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:47.954273 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:47.954185    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87k7\" (UniqueName: \"kubernetes.io/projected/bde43012-d739-4812-a68a-38b911183647-kube-api-access-z87k7\") pod \"maas-controller-6555589997-7p6qv\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") " pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:48.055375 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:48.055286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-webhook-cert\") pod \"maas-controller-6555589997-7p6qv\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") " pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:48.055547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:48.055377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-metrics-certs\") pod \"maas-controller-6555589997-7p6qv\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") " pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:48.055547 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:48.055433    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87k7\" (UniqueName: \"kubernetes.io/projected/bde43012-d739-4812-a68a-38b911183647-kube-api-access-z87k7\") pod \"maas-controller-6555589997-7p6qv\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") " pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:48.058019 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:48.057985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-metrics-certs\") pod \"maas-controller-6555589997-7p6qv\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") " pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:48.058164 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:48.058030    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-webhook-cert\") pod \"maas-controller-6555589997-7p6qv\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") " pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:48.064887 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:48.064846    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87k7\" (UniqueName: \"kubernetes.io/projected/bde43012-d739-4812-a68a-38b911183647-kube-api-access-z87k7\") pod \"maas-controller-6555589997-7p6qv\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") " pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:48.097734 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:48.097697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:48.376458 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:48.376433    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6555589997-7p6qv"]
Sep 14 10:58:48.378724 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:58:48.378698    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde43012_d739_4812_a68a_38b911183647.slice/crio-3904542410bcfa5a4c59a81077a5416af97d0b3b36cfb9004b057532e558fd97 WatchSource:0}: Error finding container 3904542410bcfa5a4c59a81077a5416af97d0b3b36cfb9004b057532e558fd97: Status 404 returned error can't find the container with id 3904542410bcfa5a4c59a81077a5416af97d0b3b36cfb9004b057532e558fd97
Sep 14 10:58:48.380147 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:48.380130    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:58:49.277036 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:49.276998    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-7p6qv" event={"ID":"bde43012-d739-4812-a68a-38b911183647","Type":"ContainerStarted","Data":"eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c"}
Sep 14 10:58:49.277483 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:49.277049    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-7p6qv" event={"ID":"bde43012-d739-4812-a68a-38b911183647","Type":"ContainerStarted","Data":"3904542410bcfa5a4c59a81077a5416af97d0b3b36cfb9004b057532e558fd97"}
Sep 14 10:58:49.277483 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:49.277081    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:58:49.297072 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:58:49.297013    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6555589997-7p6qv" podStartSLOduration=1.877952668 podStartE2EDuration="2.296994717s" totalImagesPullingTime="419.042049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:58:49.294592859 +0000 UTC m=+2052.179661967" watchObservedRunningTime="2026-09-14 10:58:49.296994717 +0000 UTC m=+2052.182063867"
Sep 14 10:59:00.284137 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:00.284058    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:59:09.659249 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:09.659209    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6555589997-7p6qv"]
Sep 14 10:59:09.659912 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:09.659438    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6555589997-7p6qv" podUID="bde43012-d739-4812-a68a-38b911183647" containerName="manager" containerID="cri-o://eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c" gracePeriod=30
Sep 14 10:59:09.913775 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:09.913709    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:59:09.954098 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:09.954070    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-webhook-cert\") pod \"bde43012-d739-4812-a68a-38b911183647\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") "
Sep 14 10:59:09.954263 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:09.954175    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-metrics-certs\") pod \"bde43012-d739-4812-a68a-38b911183647\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") "
Sep 14 10:59:09.954263 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:09.954212    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z87k7\" (UniqueName: \"kubernetes.io/projected/bde43012-d739-4812-a68a-38b911183647-kube-api-access-z87k7\") pod \"bde43012-d739-4812-a68a-38b911183647\" (UID: \"bde43012-d739-4812-a68a-38b911183647\") "
Sep 14 10:59:09.956435 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:09.956397    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bde43012-d739-4812-a68a-38b911183647" (UID: "bde43012-d739-4812-a68a-38b911183647"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:59:09.956576 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:09.956431    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bde43012-d739-4812-a68a-38b911183647-kube-api-access-z87k7" (OuterVolumeSpecName: "kube-api-access-z87k7") pod "bde43012-d739-4812-a68a-38b911183647" (UID: "bde43012-d739-4812-a68a-38b911183647"). InnerVolumeSpecName "kube-api-access-z87k7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:59:09.956576 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:09.956472    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bde43012-d739-4812-a68a-38b911183647" (UID: "bde43012-d739-4812-a68a-38b911183647"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:59:10.055369 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.055338    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-webhook-cert\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:59:10.055369 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.055366    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bde43012-d739-4812-a68a-38b911183647-metrics-certs\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:59:10.055369 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.055376    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z87k7\" (UniqueName: \"kubernetes.io/projected/bde43012-d739-4812-a68a-38b911183647-kube-api-access-z87k7\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 10:59:10.405317 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.405277    2574 generic.go:356] "Generic (PLEG): container finished" podID="bde43012-d739-4812-a68a-38b911183647" containerID="eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c" exitCode=0
Sep 14 10:59:10.405509 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.405327    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-7p6qv"
Sep 14 10:59:10.405509 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.405372    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-7p6qv" event={"ID":"bde43012-d739-4812-a68a-38b911183647","Type":"ContainerDied","Data":"eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c"}
Sep 14 10:59:10.405509 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.405437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-7p6qv" event={"ID":"bde43012-d739-4812-a68a-38b911183647","Type":"ContainerDied","Data":"3904542410bcfa5a4c59a81077a5416af97d0b3b36cfb9004b057532e558fd97"}
Sep 14 10:59:10.405509 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.405466    2574 scope.go:117] "RemoveContainer" containerID="eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c"
Sep 14 10:59:10.416450 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.416430    2574 scope.go:117] "RemoveContainer" containerID="eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c"
Sep 14 10:59:10.416742 ip-10-0-141-156 kubenswrapper[2574]: E0914 10:59:10.416716    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c\": container with ID starting with eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c not found: ID does not exist" containerID="eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c"
Sep 14 10:59:10.416837 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.416745    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c"} err="failed to get container status \"eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c\": rpc error: code = NotFound desc = could not find container \"eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c\": container with ID starting with eccd669f7443deb2e849bb52d216b8fc5ee5c93ab89d64ee564743b52d75e70c not found: ID does not exist"
Sep 14 10:59:10.439676 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.439643    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6555589997-7p6qv"]
Sep 14 10:59:10.442200 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:10.442179    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6555589997-7p6qv"]
Sep 14 10:59:11.210719 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.210682    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6555589997-vnszm"]
Sep 14 10:59:11.211352 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.211331    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bde43012-d739-4812-a68a-38b911183647" containerName="manager"
Sep 14 10:59:11.211404 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.211357    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bde43012-d739-4812-a68a-38b911183647" containerName="manager"
Sep 14 10:59:11.211499 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.211487    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bde43012-d739-4812-a68a-38b911183647" containerName="manager"
Sep 14 10:59:11.216182 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.216162    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.220570 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.220544    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 14 10:59:11.220709 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.220576    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 14 10:59:11.220709 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.220544    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7ckql\""
Sep 14 10:59:11.220709 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.220544    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 14 10:59:11.227736 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.227711    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6555589997-vnszm"]
Sep 14 10:59:11.266980 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.266934    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de915fa7-c66e-4cf8-9a1f-676c561b6aea-metrics-certs\") pod \"maas-controller-6555589997-vnszm\" (UID: \"de915fa7-c66e-4cf8-9a1f-676c561b6aea\") " pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.267172 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.267006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de915fa7-c66e-4cf8-9a1f-676c561b6aea-webhook-cert\") pod \"maas-controller-6555589997-vnszm\" (UID: \"de915fa7-c66e-4cf8-9a1f-676c561b6aea\") " pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.267172 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.267031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p66t2\" (UniqueName: \"kubernetes.io/projected/de915fa7-c66e-4cf8-9a1f-676c561b6aea-kube-api-access-p66t2\") pod \"maas-controller-6555589997-vnszm\" (UID: \"de915fa7-c66e-4cf8-9a1f-676c561b6aea\") " pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.368383 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.368346    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de915fa7-c66e-4cf8-9a1f-676c561b6aea-metrics-certs\") pod \"maas-controller-6555589997-vnszm\" (UID: \"de915fa7-c66e-4cf8-9a1f-676c561b6aea\") " pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.368585 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.368420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de915fa7-c66e-4cf8-9a1f-676c561b6aea-webhook-cert\") pod \"maas-controller-6555589997-vnszm\" (UID: \"de915fa7-c66e-4cf8-9a1f-676c561b6aea\") " pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.368585 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.368451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p66t2\" (UniqueName: \"kubernetes.io/projected/de915fa7-c66e-4cf8-9a1f-676c561b6aea-kube-api-access-p66t2\") pod \"maas-controller-6555589997-vnszm\" (UID: \"de915fa7-c66e-4cf8-9a1f-676c561b6aea\") " pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.371167 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.371140    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de915fa7-c66e-4cf8-9a1f-676c561b6aea-webhook-cert\") pod \"maas-controller-6555589997-vnszm\" (UID: \"de915fa7-c66e-4cf8-9a1f-676c561b6aea\") " pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.371289 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.371196    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de915fa7-c66e-4cf8-9a1f-676c561b6aea-metrics-certs\") pod \"maas-controller-6555589997-vnszm\" (UID: \"de915fa7-c66e-4cf8-9a1f-676c561b6aea\") " pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.378133 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.378109    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p66t2\" (UniqueName: \"kubernetes.io/projected/de915fa7-c66e-4cf8-9a1f-676c561b6aea-kube-api-access-p66t2\") pod \"maas-controller-6555589997-vnszm\" (UID: \"de915fa7-c66e-4cf8-9a1f-676c561b6aea\") " pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.528794 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.528694    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:11.614329 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.614295    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bde43012-d739-4812-a68a-38b911183647" path="/var/lib/kubelet/pods/bde43012-d739-4812-a68a-38b911183647/volumes"
Sep 14 10:59:11.808593 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:11.808562    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6555589997-vnszm"]
Sep 14 10:59:11.809613 ip-10-0-141-156 kubenswrapper[2574]: W0914 10:59:11.809587    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde915fa7_c66e_4cf8_9a1f_676c561b6aea.slice/crio-c270bd3ac5535d3805afe68e0892474275c5fba6c3d6af21efb434cbb302b895 WatchSource:0}: Error finding container c270bd3ac5535d3805afe68e0892474275c5fba6c3d6af21efb434cbb302b895: Status 404 returned error can't find the container with id c270bd3ac5535d3805afe68e0892474275c5fba6c3d6af21efb434cbb302b895
Sep 14 10:59:12.420646 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:12.420605    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-vnszm" event={"ID":"de915fa7-c66e-4cf8-9a1f-676c561b6aea","Type":"ContainerStarted","Data":"7a133715164f408d1ca8f406ded4dafae13ea97bd4457505509721c44dd3ce1e"}
Sep 14 10:59:12.421129 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:12.420666    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6555589997-vnszm" event={"ID":"de915fa7-c66e-4cf8-9a1f-676c561b6aea","Type":"ContainerStarted","Data":"c270bd3ac5535d3805afe68e0892474275c5fba6c3d6af21efb434cbb302b895"}
Sep 14 10:59:12.421129 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:12.420693    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:12.443546 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:12.443478    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6555589997-vnszm" podStartSLOduration=1.108574903 podStartE2EDuration="1.443455495s" totalImagesPullingTime="334.880592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:59:12.44195227 +0000 UTC m=+2075.327021379" watchObservedRunningTime="2026-09-14 10:59:12.443455495 +0000 UTC m=+2075.328524604"
Sep 14 10:59:23.428317 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:23.428282    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6555589997-vnszm"
Sep 14 10:59:38.292298 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:38.292267    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 10:59:38.302827 ip-10-0-141-156 kubenswrapper[2574]: I0914 10:59:38.302802    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 11:00:00.137799 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:00.137761    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx"]
Sep 14 11:00:00.141466 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:00.141451    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx"
Sep 14 11:00:00.144423 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:00.144401    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6vmmw\""
Sep 14 11:00:00.149722 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:00.149690    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx"]
Sep 14 11:00:00.152507 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:00.152485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx"
Sep 14 11:00:00.428807 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:00.428782    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx"]
Sep 14 11:00:00.430966 ip-10-0-141-156 kubenswrapper[2574]: W0914 11:00:00.430932    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67bb9c99_e768_43ef_ad20_97ad077f9b38.slice/crio-3acf5bf30fad25a1cbd98807a66e3147a0f341f8e2dfd9ba4606fe31212bf690 WatchSource:0}: Error finding container 3acf5bf30fad25a1cbd98807a66e3147a0f341f8e2dfd9ba4606fe31212bf690: Status 404 returned error can't find the container with id 3acf5bf30fad25a1cbd98807a66e3147a0f341f8e2dfd9ba4606fe31212bf690
Sep 14 11:00:00.686679 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:00.686586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx" event={"ID":"67bb9c99-e768-43ef-ad20-97ad077f9b38","Type":"ContainerStarted","Data":"3acf5bf30fad25a1cbd98807a66e3147a0f341f8e2dfd9ba4606fe31212bf690"}
Sep 14 11:00:01.693967 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:01.693931    2574 generic.go:356] "Generic (PLEG): container finished" podID="67bb9c99-e768-43ef-ad20-97ad077f9b38" containerID="8cfd06e62b2c59e68ac65a14f52a0d2c9cbcf116495f223d68984c2d57ae9af6" exitCode=0
Sep 14 11:00:01.694349 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:01.693986    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx" event={"ID":"67bb9c99-e768-43ef-ad20-97ad077f9b38","Type":"ContainerDied","Data":"8cfd06e62b2c59e68ac65a14f52a0d2c9cbcf116495f223d68984c2d57ae9af6"}
Sep 14 11:00:02.848777 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:02.848752    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx"
Sep 14 11:00:03.705689 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:03.705659    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx"
Sep 14 11:00:03.705841 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:03.705697    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823060-6x9cx" event={"ID":"67bb9c99-e768-43ef-ad20-97ad077f9b38","Type":"ContainerDied","Data":"3acf5bf30fad25a1cbd98807a66e3147a0f341f8e2dfd9ba4606fe31212bf690"}
Sep 14 11:00:03.705841 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:03.705743    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3acf5bf30fad25a1cbd98807a66e3147a0f341f8e2dfd9ba4606fe31212bf690"
Sep 14 11:00:22.199307 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:22.199270    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"]
Sep 14 11:00:22.199803 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:22.199555    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx" podUID="79456edb-d358-4c32-b3c9-b73407a0c47d" containerName="manager" containerID="cri-o://709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed" gracePeriod=10
Sep 14 11:00:23.461744 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.461715    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 11:00:23.550981 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.550952    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79456edb-d358-4c32-b3c9-b73407a0c47d-extensions-socket-volume\") pod \"79456edb-d358-4c32-b3c9-b73407a0c47d\" (UID: \"79456edb-d358-4c32-b3c9-b73407a0c47d\") "
Sep 14 11:00:23.551183 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.551035    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46lnw\" (UniqueName: \"kubernetes.io/projected/79456edb-d358-4c32-b3c9-b73407a0c47d-kube-api-access-46lnw\") pod \"79456edb-d358-4c32-b3c9-b73407a0c47d\" (UID: \"79456edb-d358-4c32-b3c9-b73407a0c47d\") "
Sep 14 11:00:23.551342 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.551315    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79456edb-d358-4c32-b3c9-b73407a0c47d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "79456edb-d358-4c32-b3c9-b73407a0c47d" (UID: "79456edb-d358-4c32-b3c9-b73407a0c47d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 11:00:23.553226 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.553206    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79456edb-d358-4c32-b3c9-b73407a0c47d-kube-api-access-46lnw" (OuterVolumeSpecName: "kube-api-access-46lnw") pod "79456edb-d358-4c32-b3c9-b73407a0c47d" (UID: "79456edb-d358-4c32-b3c9-b73407a0c47d"). InnerVolumeSpecName "kube-api-access-46lnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 11:00:23.652335 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.652296    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79456edb-d358-4c32-b3c9-b73407a0c47d-extensions-socket-volume\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 11:00:23.652335 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.652329    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46lnw\" (UniqueName: \"kubernetes.io/projected/79456edb-d358-4c32-b3c9-b73407a0c47d-kube-api-access-46lnw\") on node \"ip-10-0-141-156.ec2.internal\" DevicePath \"\""
Sep 14 11:00:23.816336 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.816302    2574 generic.go:356] "Generic (PLEG): container finished" podID="79456edb-d358-4c32-b3c9-b73407a0c47d" containerID="709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed" exitCode=0
Sep 14 11:00:23.816512 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.816348    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"
Sep 14 11:00:23.816512 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.816385    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx" event={"ID":"79456edb-d358-4c32-b3c9-b73407a0c47d","Type":"ContainerDied","Data":"709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed"}
Sep 14 11:00:23.816512 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.816440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx" event={"ID":"79456edb-d358-4c32-b3c9-b73407a0c47d","Type":"ContainerDied","Data":"54bfcf2cce1cb86a59013653ca6094904c28d58f3a133c6f411ba04b93ca3c0d"}
Sep 14 11:00:23.816512 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.816464    2574 scope.go:117] "RemoveContainer" containerID="709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed"
Sep 14 11:00:23.826078 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.826059    2574 scope.go:117] "RemoveContainer" containerID="709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed"
Sep 14 11:00:23.826346 ip-10-0-141-156 kubenswrapper[2574]: E0914 11:00:23.826331    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed\": container with ID starting with 709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed not found: ID does not exist" containerID="709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed"
Sep 14 11:00:23.826397 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.826355    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed"} err="failed to get container status \"709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed\": rpc error: code = NotFound desc = could not find container \"709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed\": container with ID starting with 709620954e54af4066aa94daa95bdf905fcaf5d1429442667060353cbda4e1ed not found: ID does not exist"
Sep 14 11:00:23.836476 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.836448    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"]
Sep 14 11:00:23.840514 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:23.840488    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l5wbx"]
Sep 14 11:00:25.609526 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:00:25.609491    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79456edb-d358-4c32-b3c9-b73407a0c47d" path="/var/lib/kubelet/pods/79456edb-d358-4c32-b3c9-b73407a0c47d/volumes"
Sep 14 11:01:22.914188 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.914154    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"]
Sep 14 11:01:22.914672 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.914586    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79456edb-d358-4c32-b3c9-b73407a0c47d" containerName="manager"
Sep 14 11:01:22.914672 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.914598    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="79456edb-d358-4c32-b3c9-b73407a0c47d" containerName="manager"
Sep 14 11:01:22.914672 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.914609    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67bb9c99-e768-43ef-ad20-97ad077f9b38" containerName="cleanup"
Sep 14 11:01:22.914672 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.914615    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="67bb9c99-e768-43ef-ad20-97ad077f9b38" containerName="cleanup"
Sep 14 11:01:22.914809 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.914691    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="79456edb-d358-4c32-b3c9-b73407a0c47d" containerName="manager"
Sep 14 11:01:22.914809 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.914702    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="67bb9c99-e768-43ef-ad20-97ad077f9b38" containerName="cleanup"
Sep 14 11:01:22.918063 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.918042    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:22.922747 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.922728    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-png22\""
Sep 14 11:01:22.936205 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:22.936176    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"]
Sep 14 11:01:23.018325 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:23.018290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-p7924\" (UID: \"35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:23.018325 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:23.018340    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wksh\" (UniqueName: \"kubernetes.io/projected/35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff-kube-api-access-6wksh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-p7924\" (UID: \"35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:23.119553 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:23.119516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-p7924\" (UID: \"35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:23.119757 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:23.119567    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wksh\" (UniqueName: \"kubernetes.io/projected/35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff-kube-api-access-6wksh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-p7924\" (UID: \"35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:23.119976 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:23.119955    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-p7924\" (UID: \"35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:23.131008 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:23.130970    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wksh\" (UniqueName: \"kubernetes.io/projected/35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff-kube-api-access-6wksh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-p7924\" (UID: \"35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:23.228094 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:23.227999    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:23.508921 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:23.508894    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"]
Sep 14 11:01:23.512742 ip-10-0-141-156 kubenswrapper[2574]: W0914 11:01:23.512701    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a9ae3b_acd7_4b9d_a4be_6fbd4b1125ff.slice/crio-7799ae80c4fcc3d45313156aab8e60c0decb455f9b3ecd917a8db2124bf8518e WatchSource:0}: Error finding container 7799ae80c4fcc3d45313156aab8e60c0decb455f9b3ecd917a8db2124bf8518e: Status 404 returned error can't find the container with id 7799ae80c4fcc3d45313156aab8e60c0decb455f9b3ecd917a8db2124bf8518e
Sep 14 11:01:24.148892 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:24.148840    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924" event={"ID":"35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff","Type":"ContainerStarted","Data":"76eef19a856e203e7768beaa66805933e354aaa0aac70c0e239b0244fadd05f9"}
Sep 14 11:01:24.149386 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:24.148929    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924" event={"ID":"35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff","Type":"ContainerStarted","Data":"7799ae80c4fcc3d45313156aab8e60c0decb455f9b3ecd917a8db2124bf8518e"}
Sep 14 11:01:24.149386 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:24.149014    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:24.174219 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:24.174166    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924" podStartSLOduration=2.174147519 podStartE2EDuration="2.174147519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:01:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:01:24.171856068 +0000 UTC m=+2207.056925178" watchObservedRunningTime="2026-09-14 11:01:24.174147519 +0000 UTC m=+2207.059216626"
Sep 14 11:01:35.157594 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:35.157554    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-p7924"
Sep 14 11:01:38.360414 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:01:38.360370    2574 scope.go:117] "RemoveContainer" containerID="215f93755bc9d92c0c641d011dfe59f9a7bd68499eedcb280d02d5980715fd95"
Sep 14 11:02:38.381770 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:02:38.381653    2574 scope.go:117] "RemoveContainer" containerID="d218d51f7c9706c33d93fcd3ed719616a9f9ae42048eaa3338dfdd3f05f2fdc6"
Sep 14 11:03:25.665160 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:25.665116    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qpfhm_32a82ab9-5a10-4073-a440-06ded49a6eeb/manager/0.log"
Sep 14 11:03:25.787975 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:25.787935    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fxcxp_15a3ac82-cc12-488e-ad68-498d92930d61/manager/0.log"
Sep 14 11:03:25.922841 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:25.922762    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6555589997-vnszm_de915fa7-c66e-4cf8-9a1f-676c561b6aea/manager/0.log"
Sep 14 11:03:26.035524 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:26.035493    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zmqzh_adaf889b-7dad-4d9d-886d-6721a089fc7c/server/0.log"
Sep 14 11:03:26.173153 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:26.173065    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m92ch_909acd21-f705-4f36-8176-1d5beb702510/manager/0.log"
Sep 14 11:03:26.296971 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:26.296942    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757dcccd8b-fmqc7_7c283c7f-0962-4570-b434-3338bafca2bb/copy-manifests/0.log"
Sep 14 11:03:26.305444 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:26.305409    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757dcccd8b-fmqc7_7c283c7f-0962-4570-b434-3338bafca2bb/manager/0.log"
Sep 14 11:03:27.245134 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:27.245103    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29823060-6x9cx_67bb9c99-e768-43ef-ad20-97ad077f9b38/cleanup/0.log"
Sep 14 11:03:27.353562 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:27.353528    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-2qmbr_433a4c66-ff1c-444c-bf3e-dedaa6416cb9/postgres/0.log"
Sep 14 11:03:28.376741 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:28.376701    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-w5hm5_59e02da0-d8eb-4b17-9739-f9fe55a62f04/manager/0.log"
Sep 14 11:03:28.494813 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:28.494786    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vlpnb_0bdf6be4-0c54-4a87-9822-4fcda13ae7ef/kuadrant-console-plugin/0.log"
Sep 14 11:03:28.631284 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:28.631161    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-p7924_35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff/manager/0.log"
Sep 14 11:03:29.209576 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:29.209543    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd_75727cf9-eb49-44c5-bbba-8bcc879f8b29/istio-proxy/0.log"
Sep 14 11:03:29.430427 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:29.430394    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cb779b95-vtsgd_abc1babb-61ee-4958-8c40-f2d16691eea6/kube-auth-proxy/0.log"
Sep 14 11:03:29.661099 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:29.661068    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkbk_a3ca7d48-2152-44d9-a235-89bad9b45782/istio-proxy/1.log"
Sep 14 11:03:29.775581 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:29.775553    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wkmjz_f502e30f-c158-4a43-8c65-4fbe958bb3e4/payload-pre-processing/0.log"
Sep 14 11:03:29.894200 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:29.894163    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ncl9j_70af39b3-c409-42a2-8453-02e61a6a03ee/payload-processing/0.log"
Sep 14 11:03:30.005304 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:30.005221    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbc499686-jdqd8_b3188e21-0cb0-486e-9746-30bdf61825ac/router/0.log"
Sep 14 11:03:30.338894 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:30.338770    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-sq6j7_248e7256-4e3c-4db8-9946-2ac084c96c0c/main/0.log"
Sep 14 11:03:30.568269 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:30.568234    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-46gnn_30a117e6-d4f5-4173-b787-7e31e02d89c2/main/0.log"
Sep 14 11:03:36.272685 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.272639    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qn42v/must-gather-vkt8p"]
Sep 14 11:03:36.276973 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.276948    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qn42v/must-gather-vkt8p"
Sep 14 11:03:36.280683 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.280659    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qn42v\"/\"default-dockercfg-dgh7x\""
Sep 14 11:03:36.280996 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.280982    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qn42v\"/\"openshift-service-ca.crt\""
Sep 14 11:03:36.281082 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.281003    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qn42v\"/\"kube-root-ca.crt\""
Sep 14 11:03:36.289624 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.289597    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qn42v/must-gather-vkt8p"]
Sep 14 11:03:36.326065 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.326032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwgb\" (UniqueName: \"kubernetes.io/projected/1b176fd2-421f-4f28-9a59-7437928b509b-kube-api-access-7dwgb\") pod \"must-gather-vkt8p\" (UID: \"1b176fd2-421f-4f28-9a59-7437928b509b\") " pod="openshift-must-gather-qn42v/must-gather-vkt8p"
Sep 14 11:03:36.326256 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.326090    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b176fd2-421f-4f28-9a59-7437928b509b-must-gather-output\") pod \"must-gather-vkt8p\" (UID: \"1b176fd2-421f-4f28-9a59-7437928b509b\") " pod="openshift-must-gather-qn42v/must-gather-vkt8p"
Sep 14 11:03:36.427566 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.427519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwgb\" (UniqueName: \"kubernetes.io/projected/1b176fd2-421f-4f28-9a59-7437928b509b-kube-api-access-7dwgb\") pod \"must-gather-vkt8p\" (UID: \"1b176fd2-421f-4f28-9a59-7437928b509b\") " pod="openshift-must-gather-qn42v/must-gather-vkt8p"
Sep 14 11:03:36.427753 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.427583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b176fd2-421f-4f28-9a59-7437928b509b-must-gather-output\") pod \"must-gather-vkt8p\" (UID: \"1b176fd2-421f-4f28-9a59-7437928b509b\") " pod="openshift-must-gather-qn42v/must-gather-vkt8p"
Sep 14 11:03:36.428012 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.427991    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b176fd2-421f-4f28-9a59-7437928b509b-must-gather-output\") pod \"must-gather-vkt8p\" (UID: \"1b176fd2-421f-4f28-9a59-7437928b509b\") " pod="openshift-must-gather-qn42v/must-gather-vkt8p"
Sep 14 11:03:36.448834 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.448797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwgb\" (UniqueName: \"kubernetes.io/projected/1b176fd2-421f-4f28-9a59-7437928b509b-kube-api-access-7dwgb\") pod \"must-gather-vkt8p\" (UID: \"1b176fd2-421f-4f28-9a59-7437928b509b\") " pod="openshift-must-gather-qn42v/must-gather-vkt8p"
Sep 14 11:03:36.587553 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.587449    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qn42v/must-gather-vkt8p"
Sep 14 11:03:36.865142 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.865115    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qn42v/must-gather-vkt8p"]
Sep 14 11:03:36.867412 ip-10-0-141-156 kubenswrapper[2574]: W0914 11:03:36.867384    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b176fd2_421f_4f28_9a59_7437928b509b.slice/crio-45914db68569a291f8fdf6dc626be3d12538c82e53537d33e4627f1028f606e0 WatchSource:0}: Error finding container 45914db68569a291f8fdf6dc626be3d12538c82e53537d33e4627f1028f606e0: Status 404 returned error can't find the container with id 45914db68569a291f8fdf6dc626be3d12538c82e53537d33e4627f1028f606e0
Sep 14 11:03:36.902518 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:36.902482    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qn42v/must-gather-vkt8p" event={"ID":"1b176fd2-421f-4f28-9a59-7437928b509b","Type":"ContainerStarted","Data":"45914db68569a291f8fdf6dc626be3d12538c82e53537d33e4627f1028f606e0"}
Sep 14 11:03:37.911496 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:37.911451    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qn42v/must-gather-vkt8p" event={"ID":"1b176fd2-421f-4f28-9a59-7437928b509b","Type":"ContainerStarted","Data":"0794a7e49d012064c96bd706b5bae17a5d15349760177553580d038611c25840"}
Sep 14 11:03:37.911938 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:37.911513    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qn42v/must-gather-vkt8p" event={"ID":"1b176fd2-421f-4f28-9a59-7437928b509b","Type":"ContainerStarted","Data":"5f694f5e828205e8098b96d1c2731600d56106701c102e7bb1c3d76341ed4b19"}
Sep 14 11:03:37.931826 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:37.931774    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qn42v/must-gather-vkt8p" podStartSLOduration=1.155638542 podStartE2EDuration="1.931756107s" totalImagesPullingTime="776.117565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 11:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:37.929892623 +0000 UTC m=+2340.814961724" watchObservedRunningTime="2026-09-14 11:03:37.931756107 +0000 UTC m=+2340.816825214"
Sep 14 11:03:38.403278 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:38.403245    2574 scope.go:117] "RemoveContainer" containerID="eb32a75540accb1e94606cc41df8f5a853da113286ba6cdae66c4755f3f65b3f"
Sep 14 11:03:38.419406 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:38.419160    2574 scope.go:117] "RemoveContainer" containerID="2dd4cfef547ecb748e784e68508c265e0d565d109216f77506f1a6de66f42e24"
Sep 14 11:03:38.433232 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:38.433200    2574 scope.go:117] "RemoveContainer" containerID="01654b962bc9c1955df05a92ec36b41e351d568af5b670c636bf7a6887a6081b"
Sep 14 11:03:39.283009 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:39.282971    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kfv78_edaf9e65-4df9-4d03-8371-8349eb66dfbd/global-pull-secret-syncer/0.log"
Sep 14 11:03:39.474123 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:39.474088    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-thqbm_28411147-5c17-42e2-91a5-2558eea261f3/konnectivity-agent/0.log"
Sep 14 11:03:39.587314 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:39.587228    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-156.ec2.internal_e272105baf092ca2ccbcf8e39766ef49/haproxy/0.log"
Sep 14 11:03:44.217157 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:44.217122    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-w5hm5_59e02da0-d8eb-4b17-9739-f9fe55a62f04/manager/0.log"
Sep 14 11:03:44.247446 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:44.247412    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vlpnb_0bdf6be4-0c54-4a87-9822-4fcda13ae7ef/kuadrant-console-plugin/0.log"
Sep 14 11:03:44.297284 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:44.297243    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-p7924_35a9ae3b-acd7-4b9d-a4be-6fbd4b1125ff/manager/0.log"
Sep 14 11:03:46.117252 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:46.117210    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-2dbtk_1df802cf-5d9c-48a8-bf65-3f527b45d319/cluster-monitoring-operator/0.log"
Sep 14 11:03:46.358050 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:46.358017    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fwh5m_9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4/node-exporter/0.log"
Sep 14 11:03:46.384372 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:46.384205    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fwh5m_9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4/kube-rbac-proxy/0.log"
Sep 14 11:03:46.413327 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:46.413299    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fwh5m_9d7cef41-9bab-4ae8-b2fe-34f5ccb0bdf4/init-textfile/0.log"
Sep 14 11:03:46.958573 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:46.958541    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-hljwn_2d6ff551-9424-4de8-873c-73cfe5302e63/prometheus-operator-admission-webhook/0.log"
Sep 14 11:03:48.589795 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:48.589768    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-v6dkv_a9baf0bd-67d4-43e7-a332-f07090b1b9d6/networking-console-plugin/0.log"
Sep 14 11:03:49.234290 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:49.234255    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/1.log"
Sep 14 11:03:49.246752 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:49.246712    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9gmht_7545b769-2bd9-4233-8670-d659be985d44/console-operator/2.log"
Sep 14 11:03:49.756202 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:49.756167    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59fbffc489-ls4sl_2c51462b-939b-4152-bbab-0fdfdd909c95/console/0.log"
Sep 14 11:03:49.792141 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:49.792104    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-6v8gb_ecd49ef6-e67d-4019-834b-f62abf796b3c/download-server/0.log"
Sep 14 11:03:49.943663 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:49.943624    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"]
Sep 14 11:03:49.949699 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:49.949668    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:49.956278 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:49.956248    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"]
Sep 14 11:03:50.086958 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.086843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-proc\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.087265 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.087229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-podres\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.087413 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.087285    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-sys\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.087413 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.087313    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2jv5\" (UniqueName: \"kubernetes.io/projected/8f75811f-b7fd-43cc-971d-44b397398ea2-kube-api-access-z2jv5\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.087530 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.087412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-lib-modules\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.188275 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.188233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-lib-modules\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.188471 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.188372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-proc\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.188471 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.188418    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-podres\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.188471 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.188444    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-sys\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.188639 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.188473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2jv5\" (UniqueName: \"kubernetes.io/projected/8f75811f-b7fd-43cc-971d-44b397398ea2-kube-api-access-z2jv5\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.188639 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.188474    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-lib-modules\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.188639 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.188487    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-proc\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.188639 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.188588    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-sys\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.188639 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.188599    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f75811f-b7fd-43cc-971d-44b397398ea2-podres\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.197770 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.197740    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2jv5\" (UniqueName: \"kubernetes.io/projected/8f75811f-b7fd-43cc-971d-44b397398ea2-kube-api-access-z2jv5\") pod \"perf-node-gather-daemonset-xmfvv\" (UID: \"8f75811f-b7fd-43cc-971d-44b397398ea2\") " pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.264690 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.264444    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:50.519909 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.519859    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-smhg4_4ec1881a-938a-44c1-b8ff-022c8d261a68/volume-data-source-validator/0.log"
Sep 14 11:03:50.562555 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:50.559829    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"]
Sep 14 11:03:50.563390 ip-10-0-141-156 kubenswrapper[2574]: W0914 11:03:50.563352    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8f75811f_b7fd_43cc_971d_44b397398ea2.slice/crio-fb6d78457397d82f8b26a99a25cb764b69734a65b73db0894797d9dfb6470078 WatchSource:0}: Error finding container fb6d78457397d82f8b26a99a25cb764b69734a65b73db0894797d9dfb6470078: Status 404 returned error can't find the container with id fb6d78457397d82f8b26a99a25cb764b69734a65b73db0894797d9dfb6470078
Sep 14 11:03:51.038369 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:51.038324    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv" event={"ID":"8f75811f-b7fd-43cc-971d-44b397398ea2","Type":"ContainerStarted","Data":"4e261dec7ddea8458dbd276c106483413c3084d795698e90419ef26ff4a2f340"}
Sep 14 11:03:51.038862 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:51.038411    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv" event={"ID":"8f75811f-b7fd-43cc-971d-44b397398ea2","Type":"ContainerStarted","Data":"fb6d78457397d82f8b26a99a25cb764b69734a65b73db0894797d9dfb6470078"}
Sep 14 11:03:51.038862 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:51.038559    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:51.057772 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:51.057701    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv" podStartSLOduration=2.057679523 podStartE2EDuration="2.057679523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 11:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 11:03:51.056418112 +0000 UTC m=+2353.941487221" watchObservedRunningTime="2026-09-14 11:03:51.057679523 +0000 UTC m=+2353.942748632"
Sep 14 11:03:51.713927 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:51.713897    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-thbpk_6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b/dns/0.log"
Sep 14 11:03:51.734801 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:51.734771    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-thbpk_6e9f4ee8-3c9e-4178-bd69-8b89d2dcd66b/kube-rbac-proxy/0.log"
Sep 14 11:03:51.822085 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:51.822058    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zjzt4_be40853d-ecb0-4226-b63d-2e9b514a7124/dns-node-resolver/0.log"
Sep 14 11:03:52.447514 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:52.447465    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jbkd8_87a193a1-7c8e-49cd-8c5b-0a885657e21d/node-ca/0.log"
Sep 14 11:03:53.358247 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:53.358213    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd_75727cf9-eb49-44c5-bbba-8bcc879f8b29/istio-proxy/0.log"
Sep 14 11:03:53.769618 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:53.769591    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cb779b95-vtsgd_abc1babb-61ee-4958-8c40-f2d16691eea6/kube-auth-proxy/0.log"
Sep 14 11:03:53.830524 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:53.830469    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkbk_a3ca7d48-2152-44d9-a235-89bad9b45782/istio-proxy/0.log"
Sep 14 11:03:53.836200 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:53.836174    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkbk_a3ca7d48-2152-44d9-a235-89bad9b45782/istio-proxy/1.log"
Sep 14 11:03:53.876756 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:53.876720    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wkmjz_f502e30f-c158-4a43-8c65-4fbe958bb3e4/payload-pre-processing/0.log"
Sep 14 11:03:53.917590 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:53.917559    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ncl9j_70af39b3-c409-42a2-8453-02e61a6a03ee/payload-processing/0.log"
Sep 14 11:03:53.941379 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:53.941348    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbc499686-jdqd8_b3188e21-0cb0-486e-9746-30bdf61825ac/router/0.log"
Sep 14 11:03:54.832530 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:54.832486    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-54hlz_165e36cd-48b6-4cdc-bb57-aeef5ce536de/serve-healthcheck-canary/0.log"
Sep 14 11:03:55.347030 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:55.347001    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-xwpfk_7224b4b8-bcb6-40e7-bade-a29550063f2f/insights-operator/0.log"
Sep 14 11:03:55.348274 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:55.348251    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-xwpfk_7224b4b8-bcb6-40e7-bade-a29550063f2f/insights-operator/1.log"
Sep 14 11:03:55.386887 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:55.386837    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5j2fs_f9fda6cb-d549-4076-bc65-4638d564bbc9/kube-rbac-proxy/0.log"
Sep 14 11:03:55.429113 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:55.429085    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5j2fs_f9fda6cb-d549-4076-bc65-4638d564bbc9/exporter/0.log"
Sep 14 11:03:55.469376 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:55.469346    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5j2fs_f9fda6cb-d549-4076-bc65-4638d564bbc9/extractor/0.log"
Sep 14 11:03:57.058693 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:57.058663    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qn42v/perf-node-gather-daemonset-xmfvv"
Sep 14 11:03:58.009923 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:58.009852    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qpfhm_32a82ab9-5a10-4073-a440-06ded49a6eeb/manager/0.log"
Sep 14 11:03:58.485891 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:58.485494    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fxcxp_15a3ac82-cc12-488e-ad68-498d92930d61/manager/0.log"
Sep 14 11:03:58.581922 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:58.581818    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6555589997-vnszm_de915fa7-c66e-4cf8-9a1f-676c561b6aea/manager/0.log"
Sep 14 11:03:58.608488 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:58.608459    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zmqzh_adaf889b-7dad-4d9d-886d-6721a089fc7c/server/0.log"
Sep 14 11:03:58.760939 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:58.760470    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m92ch_909acd21-f705-4f36-8176-1d5beb702510/manager/0.log"
Sep 14 11:03:58.786215 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:58.786187    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757dcccd8b-fmqc7_7c283c7f-0962-4570-b434-3338bafca2bb/manager/0.log"
Sep 14 11:03:58.808333 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:03:58.808296    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757dcccd8b-fmqc7_7c283c7f-0962-4570-b434-3338bafca2bb/copy-manifests/0.log"
Sep 14 11:04:00.643777 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:00.643660    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd_75727cf9-eb49-44c5-bbba-8bcc879f8b29/istio-proxy/0.log"
Sep 14 11:04:01.035983 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:01.035943    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cb779b95-vtsgd_abc1babb-61ee-4958-8c40-f2d16691eea6/kube-auth-proxy/0.log"
Sep 14 11:04:01.083721 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:01.083693    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkbk_a3ca7d48-2152-44d9-a235-89bad9b45782/istio-proxy/0.log"
Sep 14 11:04:01.088690 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:01.088662    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkbk_a3ca7d48-2152-44d9-a235-89bad9b45782/istio-proxy/1.log"
Sep 14 11:04:01.124296 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:01.124262    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wkmjz_f502e30f-c158-4a43-8c65-4fbe958bb3e4/payload-pre-processing/0.log"
Sep 14 11:04:01.156217 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:01.156182    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ncl9j_70af39b3-c409-42a2-8453-02e61a6a03ee/payload-processing/0.log"
Sep 14 11:04:01.174412 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:01.174383    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbc499686-jdqd8_b3188e21-0cb0-486e-9746-30bdf61825ac/router/0.log"
Sep 14 11:04:02.835234 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:02.835200    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ch6bdd_75727cf9-eb49-44c5-bbba-8bcc879f8b29/istio-proxy/0.log"
Sep 14 11:04:03.259394 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:03.259363    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cb779b95-vtsgd_abc1babb-61ee-4958-8c40-f2d16691eea6/kube-auth-proxy/0.log"
Sep 14 11:04:03.308020 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:03.307993    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkbk_a3ca7d48-2152-44d9-a235-89bad9b45782/istio-proxy/0.log"
Sep 14 11:04:03.314438 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:03.314412    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkbk_a3ca7d48-2152-44d9-a235-89bad9b45782/istio-proxy/1.log"
Sep 14 11:04:03.353836 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:03.353797    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wkmjz_f502e30f-c158-4a43-8c65-4fbe958bb3e4/payload-pre-processing/0.log"
Sep 14 11:04:03.390407 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:03.390373    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ncl9j_70af39b3-c409-42a2-8453-02e61a6a03ee/payload-processing/0.log"
Sep 14 11:04:03.412250 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:03.412206    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbc499686-jdqd8_b3188e21-0cb0-486e-9746-30bdf61825ac/router/0.log"
Sep 14 11:04:05.864222 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:05.864192    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-24ghf_8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a/migrator/0.log"
Sep 14 11:04:05.884382 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:05.884352    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-24ghf_8a5f2204-c5bd-45e0-b716-51fbc2bb1b7a/graceful-termination/0.log"
Sep 14 11:04:06.236434 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:06.236403    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-jcvw4_866357bc-923e-4c1b-aa65-3e34fafdbb6a/kube-storage-version-migrator-operator/1.log"
Sep 14 11:04:06.238354 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:06.238331    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-jcvw4_866357bc-923e-4c1b-aa65-3e34fafdbb6a/kube-storage-version-migrator-operator/0.log"
Sep 14 11:04:07.266783 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:07.266706    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8mkjw_051ca948-ae4f-47a9-b04e-919e83e571a2/kube-multus-additional-cni-plugins/0.log"
Sep 14 11:04:07.297748 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:07.297719    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8mkjw_051ca948-ae4f-47a9-b04e-919e83e571a2/egress-router-binary-copy/0.log"
Sep 14 11:04:07.329133 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:07.329108    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8mkjw_051ca948-ae4f-47a9-b04e-919e83e571a2/cni-plugins/0.log"
Sep 14 11:04:07.363375 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:07.363342    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8mkjw_051ca948-ae4f-47a9-b04e-919e83e571a2/bond-cni-plugin/0.log"
Sep 14 11:04:07.390324 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:07.390301    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8mkjw_051ca948-ae4f-47a9-b04e-919e83e571a2/routeoverride-cni/0.log"
Sep 14 11:04:07.417891 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:07.417835    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8mkjw_051ca948-ae4f-47a9-b04e-919e83e571a2/whereabouts-cni-bincopy/0.log"
Sep 14 11:04:07.445030 ip-10-0-141-156 kubenswrapper[2574]: I0914 11:04:07.445003    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8mkjw_051ca948-ae4f-47a9-b04e-919e83e571a2/whereabouts-cni/0.log"