Sep 10 19:13:41.667571 ip-10-0-130-178 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 19:13:41.667582 ip-10-0-130-178 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 19:13:41.667588 ip-10-0-130-178 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 19:13:41.667741 ip-10-0-130-178 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 19:13:51.739574 ip-10-0-130-178 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 19:13:51.739591 ip-10-0-130-178 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 260499f385004b85a2bc13c1e6536037 --
Sep 10 19:15:48.032709 ip-10-0-130-178 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 19:15:48.420767 ip-10-0-130-178 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 19:15:48.420767 ip-10-0-130-178 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 19:15:48.420767 ip-10-0-130-178 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 19:15:48.420767 ip-10-0-130-178 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 19:15:48.420767 ip-10-0-130-178 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 19:15:48.423291 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.423194    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 19:15:48.428385 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428369    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:15:48.428385 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428386    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428391    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428395    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428398    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428401    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428405    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428408    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428422    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428425    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428427    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428435    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428439    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428443    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428445    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428448    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428451    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428453    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428456    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428460    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:15:48.428465 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428463    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428467    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428470    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428473    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428476    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428478    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428481    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428484    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428487    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428489    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428492    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428496    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428499    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428501    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428504    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428506    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428509    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428511    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428514    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428516    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:15:48.428919 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428518    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428521    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428524    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428527    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428530    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428532    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428535    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428537    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428540    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428542    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428544    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428547    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428549    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428552    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428555    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428558    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428561    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428563    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428566    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428569    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:15:48.429404 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428571    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428574    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428577    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428579    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428582    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428584    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428587    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428589    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428592    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428594    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428597    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428599    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428603    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428606    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428608    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428611    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428614    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428616    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428619    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428622    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:15:48.429920 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428625    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428628    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428630    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428633    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428635    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428638    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428641    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428644    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428646    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428649    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428652    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428654    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428657    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428660    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428663    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428665    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428668    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428670    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.428672    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429381    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:15:48.430391 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429387    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429391    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429394    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429397    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429400    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429403    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429407    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429425    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429429    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429432    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429435    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429438    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429441    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429444    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429447    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429449    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429458    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429462    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429465    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429468    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:15:48.430888 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429470    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429473    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429476    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429479    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429481    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429484    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429488    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429492    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429495    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429498    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429501    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429503    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429506    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429508    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429511    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429513    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429516    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429519    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429521    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429524    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:15:48.431381 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429526    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429529    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429532    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429535    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429538    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429540    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429543    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429546    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429549    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429551    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429554    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429557    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429559    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429562    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429564    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429567    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429569    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429572    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429574    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:15:48.431905 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429577    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429579    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429582    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429584    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429587    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429589    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429592    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429595    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429598    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429600    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429603    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429605    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429608    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429610    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429613    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429616    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429618    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429622    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429625    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429627    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:15:48.432370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429631    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429634    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429636    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429639    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429641    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429644    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429646    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429649    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429651    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429654    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429656    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429660    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429663    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429666    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429668    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429671    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429674    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429676    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.429679    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:15:48.432878 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430049    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430054    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430057    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430060    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430063    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430065    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430068    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430071    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430074    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430077    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430079    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430082    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430085    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430087    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430090    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430093    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430095    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430098    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430100    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430103    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:15:48.433355 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430105    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430108    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430110    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430113    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430115    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430118    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430121    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430123    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430126    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430128    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430131    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430135    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430141    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430144    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430148    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430151    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430154    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430157    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430161    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:15:48.433857 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430164    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430167    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430170    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430173    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430176    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430179    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430182    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430184    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430187    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430190    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430193    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430195    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430198    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430200    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430203    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430205    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430208    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430210    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430213    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430216    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:15:48.434331 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430218    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430220    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430223    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430226    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430228    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430232    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430235    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430238    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430240    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430243    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430245    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430248    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430250    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430253    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430255    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430260    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430263    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430266    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430268    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430271    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:15:48.434955 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430273    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430276    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430279    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430281    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430284    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430286    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430289    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430291    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430294    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430296    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430298    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430301    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430303    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430307    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430310    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430313    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430315    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430319    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430322    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:15:48.435459 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.430325    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430404    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430453    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430460    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430464    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430469    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430472    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430476    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430482    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430486    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430489    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430492    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430495    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430498    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430501    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430504    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430507    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430510    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430513    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430518    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430520    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430523    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430526    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430530    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 19:15:48.435925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430534    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430537    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430541    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430544    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430547    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430550    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430555    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430558    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430561    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430565    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430568    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430571    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430574    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430576    2582 flags.go:64] FLAG: --enable-server="true"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430579    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430584    2582 flags.go:64] FLAG: --event-burst="100"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430587    2582 flags.go:64] FLAG: --event-qps="50"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430590    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430593    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430596    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430600    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430603    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430606    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430609    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430612    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 19:15:48.436604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430615    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430618    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430620    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430623    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430626    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430629    2582 flags.go:64] FLAG: --feature-gates=""
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430633    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430636    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430639    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430643    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430646    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430649    2582 flags.go:64] FLAG: --help="false"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430652    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430659    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430662    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430665    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430668    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430671    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430674    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430676    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430679    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430682    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430685    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430688    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 19:15:48.437238 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430691    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430694    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430698    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430701    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430704    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430706    2582 flags.go:64] FLAG: --lock-file=""
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430709    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430712    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430715    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430721    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430724    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430726    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430729    2582 flags.go:64] FLAG: --logging-format="text"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430732    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430735    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430738    2582 flags.go:64] FLAG: --manifest-url=""
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430741    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430745    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430748    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430753    2582 flags.go:64] FLAG: --max-pods="110"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430756    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430760    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430764    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430767    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430770    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 19:15:48.437876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430773    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430776    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430782    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430786    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430788    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430791    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430794    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430807    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430810    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430813    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430816    2582 flags.go:64] FLAG: --port="10250"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430819    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430822    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-020f47b0380ac4085"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430825    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430828    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430831    2582 flags.go:64] FLAG: --register-node="true"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430834    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430841    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430844    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430847    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430850    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430853    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430856    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430859    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430862    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 19:15:48.438833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430864    2582 flags.go:64] FLAG: --runonce="false"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430867    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430870    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430874    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430877    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430880    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430883    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430886    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430889    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430892    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430895    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430897    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430900    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430903    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430908    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430911    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430916    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430919    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430937    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430944    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430947    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430950    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430953    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430956    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430960    2582 flags.go:64] FLAG: --v="2"
Sep 10 19:15:48.439867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430964    2582 flags.go:64] FLAG: --version="false"
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430968    2582 flags.go:64] FLAG: --vmodule=""
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430972    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.430975    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431088    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431093    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431096    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431099    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431102    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431104    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431108    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431110    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431113    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431115    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431118    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431121    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431123    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431126    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431128    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431131    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:15:48.440924 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431134    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431138    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431141    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431143    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431146    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431148    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431151    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431154    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431157    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431168    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431170    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431174    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431176    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431179    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431183    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431185    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431188    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431191    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431193    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431196    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:15:48.441534 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431198    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431201    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431204    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431207    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431209    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431212    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431215    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431218    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431220    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431223    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431225    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431229    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431231    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431235    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431237    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431240    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431242    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431245    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431248    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431251    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:15:48.442401 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431254    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431257    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431260    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431262    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431265    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431267    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431270    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431273    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431275    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431278    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431280    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431283    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431285    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431288    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431290    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431293    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431295    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431298    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431301    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431303    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:15:48.443158 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431306    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431310    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431313    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431316    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431319    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431323    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431326    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431329    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431333    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431336    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431338    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431341    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431344    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431347    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431350    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431353    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431355    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431358    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431360    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:15:48.443810 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431363    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431366    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431368    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.431371    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.431935    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.440744    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.440769    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.441448    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.441468    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441556    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441563    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441569    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441575    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441579    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441584    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:15:48.444284 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441589    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441594    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441599    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441603    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441607    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441611    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441616    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441620    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441624    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441628    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441635    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441641    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441645    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441650    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441654    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441658    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441662    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441668    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441672    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:15:48.444803 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441677    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441681    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441686    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441690    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441697    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441703    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441708    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441713    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441718    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441722    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441726    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441730    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441734    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441738    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441743    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441747    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441752    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441755    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441760    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441765    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:15:48.445303 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441769    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441774    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441777    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441782    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441787    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441791    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441795    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441799    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441804    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441808    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441812    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441816    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441821    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441824    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441830    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441834    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441839    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441843    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441848    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441852    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:15:48.446181 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441856    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441860    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441864    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441868    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441873    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441877    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441881    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441886    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441890    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441894    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441899    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441904    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441908    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441912    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441917    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441922    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441927    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441931    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441935    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:15:48.446853 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441939    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441944    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441947    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441954    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441959    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441964    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441969    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441974    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441978    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441982    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441987    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441991    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441995    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.441999    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442003    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:15:48.447460 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.442011    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442213    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442222    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442228    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442232    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442236    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442241    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442245    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442250    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442255    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442259    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442264    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442269    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442275    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442280    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442284    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442289    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442293    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442298    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442305    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:15:48.447840 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442311    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442315    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442319    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442324    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442329    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442333    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442337    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442342    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442346    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442351    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442355    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442359    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442363    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442368    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442372    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442376    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442380    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442384    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442388    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442392    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:15:48.448380 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442396    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442400    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442404    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442424    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442428    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442432    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442437    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442441    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442445    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442449    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442454    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442458    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442462    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442466    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442470    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442475    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442479    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442484    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442488    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:15:48.448939 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442492    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442496    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442500    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442505    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442509    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442514    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442518    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442525    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442530    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442535    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442540    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442544    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442548    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442553    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442557    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442561    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442566    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442570    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442574    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:15:48.449521 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442578    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442584    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442588    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442593    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442597    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442603    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442608    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442613    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442617    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442622    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442626    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442630    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442635    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442639    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442643    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442647    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442651    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442656    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442660    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442664    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:15:48.449987 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442668    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:15:48.450623 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:48.442672    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:15:48.450623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.442680    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 19:15:48.450623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.442865    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 19:15:48.450623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.447040    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 19:15:48.450623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.447938    2582 server.go:1019] "Starting client certificate rotation"
Sep 10 19:15:48.450623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.448039    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 19:15:48.450623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.448070    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 19:15:48.451185 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.451167    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 19:15:48.452444 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.452424    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 19:15:48.462532 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.462513    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 10 19:15:48.465731 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.465714    2582 log.go:25] "Validated CRI v1 image API"
Sep 10 19:15:48.466585 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.466563    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 19:15:48.470176 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.470153    2582 fs.go:135] Filesystem UUIDs: map[2f3b06bf-655a-43d1-ad9f-63a7532d03d3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 be216120-c532-450c-ba3e-2ee824af7a7c:/dev/nvme0n1p3]
Sep 10 19:15:48.470253 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.470176    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 19:15:48.476227 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.476204    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 19:15:48.477276 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.477157    2582 manager.go:216] Machine: {Timestamp:2026-09-10 19:15:48.475828058 +0000 UTC m=+0.331383082 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100958 MemoryCapacity:33164464128 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b6d18824a6b075aea342630883795 SystemUUID:ec2b6d18-824a-6b07-5aea-342630883795 BootID:260499f3-8500-4b85-a2bc-13c1e6536037 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582230016 Type:vfs Inodes:4048396 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:85:7a:38:79:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:85:7a:38:79:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:69:79:b8:67:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164464128 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 19:15:48.477276 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.477268    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 19:15:48.477448 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.477388    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 19:15:48.480569 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.480536    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 19:15:48.480710 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.480572    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 19:15:48.481282 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.481273    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 19:15:48.481312 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.481285    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 19:15:48.481312 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.481293    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 19:15:48.482012 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.482001    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 19:15:48.483144 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.483133    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 19:15:48.486184 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.486171    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 19:15:48.486308 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.486298    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 19:15:48.486340 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.486330    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 19:15:48.486371 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.486344    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 19:15:48.486371 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.486368    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 19:15:48.486451 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.486381    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 10 19:15:48.486451 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.486393    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 19:15:48.486878 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.486865    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 19:15:48.486949 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.486890    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 19:15:48.488992 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.488966    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 19:15:48.491055 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491040    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 19:15:48.491128 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491070    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 19:15:48.491281 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491270    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 19:15:48.491320 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491289    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 19:15:48.491320 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491298    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 19:15:48.491320 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491305    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 19:15:48.491320 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491318    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 19:15:48.491498 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491327    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 19:15:48.491881 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491869    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 19:15:48.491918 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491882    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 19:15:48.491918 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491890    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 19:15:48.491918 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491896    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 19:15:48.491918 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491905    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 19:15:48.491918 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.491913    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 19:15:48.494811 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.494799    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 19:15:48.494852 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.494812    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 19:15:48.496014 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.495986    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 19:15:48.496014 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.495986    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 19:15:48.498752 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.498728    2582 server.go:1268] "Started kubelet"
Sep 10 19:15:48.498878 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.498851    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 19:15:48.499349 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.499024    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 19:15:48.499349 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.499307    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 19:15:48.499804 ip-10-0-130-178 systemd[1]: Started Kubernetes Kubelet.
Sep 10 19:15:48.500475 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.500448    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 19:15:48.500630 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.500615    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 19:15:48.504145 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.504129    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 19:15:48.504670 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.504653    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 19:15:48.504866 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.504813    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:48.505330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505305    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 19:15:48.505478 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505460    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 19:15:48.505574 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505436    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 19:15:48.505574 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505526    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 19:15:48.505679 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.505578    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 19:15:48.505679 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505519    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qvnf"
Sep 10 19:15:48.505763 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505747    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 19:15:48.505763 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505755    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 19:15:48.505763 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505758    2582 factory.go:55] Registering systemd factory
Sep 10 19:15:48.505896 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505772    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 10 19:15:48.506006 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.505994    2582 factory.go:153] Registering CRI-O factory
Sep 10 19:15:48.506071 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.506007    2582 factory.go:223] Registration of the crio container factory successfully
Sep 10 19:15:48.506071 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.506047    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 19:15:48.506071 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.506066    2582 factory.go:103] Registering Raw factory
Sep 10 19:15:48.506164 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.506077    2582 manager.go:1196] Started watching for new ooms in manager
Sep 10 19:15:48.506544 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.506525    2582 manager.go:349] Starting recovery of all containers
Sep 10 19:15:48.506757 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.505853    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-178.ec2.internal.18d40ba36c5f7406  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-178.ec2.internal,UID:ip-10-0-130-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-178.ec2.internal,},FirstTimestamp:2026-09-10 19:15:48.49869927 +0000 UTC m=+0.354254290,LastTimestamp:2026-09-10 19:15:48.49869927 +0000 UTC m=+0.354254290,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-178.ec2.internal,}"
Sep 10 19:15:48.513432 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.513394    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qvnf"
Sep 10 19:15:48.513882 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.513847    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 19:15:48.513980 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.513942    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 19:15:48.519475 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.519455    2582 manager.go:354] Recovery completed
Sep 10 19:15:48.524588 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.524451    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:15:48.526425 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.526394    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:15:48.526495 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.526455    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:15:48.526495 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.526473    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:15:48.527118 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.527101    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 19:15:48.527118 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.527115    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:15:48.527224 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.527117    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 19:15:48.527224 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.527193    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 19:15:48.527894 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.527874    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:15:48.527953 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.527906    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:15:48.527953 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.527917    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:15:48.528352 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.528340    2582 policy_none.go:49] "None policy: Start"
Sep 10 19:15:48.528386 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.528356    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 19:15:48.528386 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.528365    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 19:15:48.528871 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.528806    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-178.ec2.internal.18d40ba36e06af05  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-178.ec2.internal,UID:ip-10-0-130-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-178.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-178.ec2.internal,},FirstTimestamp:2026-09-10 19:15:48.526436101 +0000 UTC m=+0.381991141,LastTimestamp:2026-09-10 19:15:48.526436101 +0000 UTC m=+0.381991141,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-178.ec2.internal,}"
Sep 10 19:15:48.529487 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.529475    2582 policy_none.go:47] "Start"
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.557224    2582 manager.go:337] "Starting Device Plugin manager"
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.557271    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.557284    2582 server.go:87] "Starting device plugin registration server"
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.557672    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.557686    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.557780    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.557870    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.557880    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.558939    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 19:15:48.568878 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.558987    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:48.658396 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.658363    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:15:48.659454 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.659433    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:15:48.659560 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.659472    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:15:48.659560 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.659487    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:15:48.659560 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.659524    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.660992 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.660965    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 19:15:48.662207 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.662185    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 19:15:48.662325 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.662242    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 19:15:48.662325 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.662268    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 19:15:48.662404 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.662371    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 19:15:48.665074 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.665057    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:15:48.667015 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.667001    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.667080 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.667021    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-178.ec2.internal\": node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:48.734721 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.734615    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:48.762769 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.762740    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal"]
Sep 10 19:15:48.762865 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.762822    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:15:48.764569 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.764549    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:15:48.764675 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.764581    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:15:48.764675 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.764595    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:15:48.766218 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.766205    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:15:48.766328 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.766312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.766368 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.766355    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:15:48.766988 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.766968    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:15:48.767112 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.767001    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:15:48.767112 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.767030    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:15:48.767112 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.766973    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:15:48.767112 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.767075    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:15:48.767112 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.767086    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:15:48.768400 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.768382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.768514 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.768434    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:15:48.769224 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.769209    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:15:48.769284 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.769238    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:15:48.769284 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.769248    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:15:48.790153 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.790125    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-178.ec2.internal\" not found" node="ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.793686 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.793670    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-178.ec2.internal\" not found" node="ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.806925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.806901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd5a51648b67abc20f8ee816314baeef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"dd5a51648b67abc20f8ee816314baeef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.807021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.806931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd5a51648b67abc20f8ee816314baeef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"dd5a51648b67abc20f8ee816314baeef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.807021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.806961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0b12b2fbd9460cffd368b1bb1ef73f5-config\") pod \"kube-apiserver-proxy-ip-10-0-130-178.ec2.internal\" (UID: \"b0b12b2fbd9460cffd368b1bb1ef73f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.835201 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.835177    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:48.907582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.907549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0b12b2fbd9460cffd368b1bb1ef73f5-config\") pod \"kube-apiserver-proxy-ip-10-0-130-178.ec2.internal\" (UID: \"b0b12b2fbd9460cffd368b1bb1ef73f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.907582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.907564    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0b12b2fbd9460cffd368b1bb1ef73f5-config\") pod \"kube-apiserver-proxy-ip-10-0-130-178.ec2.internal\" (UID: \"b0b12b2fbd9460cffd368b1bb1ef73f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.907755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.907589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd5a51648b67abc20f8ee816314baeef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"dd5a51648b67abc20f8ee816314baeef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.907755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.907611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd5a51648b67abc20f8ee816314baeef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"dd5a51648b67abc20f8ee816314baeef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.907755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.907648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd5a51648b67abc20f8ee816314baeef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"dd5a51648b67abc20f8ee816314baeef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.907755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:48.907654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd5a51648b67abc20f8ee816314baeef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"dd5a51648b67abc20f8ee816314baeef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:48.936047 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:48.936014    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:49.036870 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.036791    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:49.093004 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.092976    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:49.095990 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.095973    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:49.137954 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.137924    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:49.240156 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.240114    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:49.341830 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.341748    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found"
Sep 10 19:15:49.377776 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.377748    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:15:49.406201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.406170    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:49.418596 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.418570    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 19:15:49.420097 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.420082    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal"
Sep 10 19:15:49.430399 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.430377    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 19:15:49.448152 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.448127    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 19:15:49.448326 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.448305    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 19:15:49.481876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.481848    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:15:49.487079 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.487061    2582 apiserver.go:52] "Watching apiserver"
Sep 10 19:15:49.494863 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.494846    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 19:15:49.496622 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.496601    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2cpxl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal","openshift-multus/multus-additional-cni-plugins-2m8jt","openshift-multus/multus-chrt4","kube-system/konnectivity-agent-zmmqh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f","openshift-multus/network-metrics-daemon-p8fkk","openshift-network-diagnostics/network-check-target-drkm5","openshift-network-operator/iptables-alerter-hstsm","openshift-ovn-kubernetes/ovnkube-node-qmhz5","kube-system/global-pull-secret-syncer-4rh8j","kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cwq9b","openshift-dns/node-resolver-hxp26"]
Sep 10 19:15:49.498704 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.498686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:49.498796 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.498776    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:15:49.500081 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.500064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.501480 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.501459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.502361 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.502343    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 19:15:49.502435 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.502418    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 19:15:49.502498 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.502442    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-djhw8\""
Sep 10 19:15:49.502800 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.502781    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.503721 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.503704    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 19:15:49.503914 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.503896    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 19:15:49.503958 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.503914    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wngt5\""
Sep 10 19:15:49.503958 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.503916    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 19:15:49.504179 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.504162    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 19:15:49.504265 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.504248    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:15:49.504319 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.504289    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 19:15:49.504572 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.504553    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 19:15:49.504884 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.504868    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gjcr8\""
Sep 10 19:15:49.505199 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.505184    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 19:15:49.505761 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.505741    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.506861 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.506840    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 19:15:49.507072 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.507056    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4mkp5\""
Sep 10 19:15:49.507168 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.507060    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 19:15:49.507168 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.507140    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.508119 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.508101    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 19:15:49.508119 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.508113    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v6xb6\""
Sep 10 19:15:49.508251 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.508146    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 19:15:49.508251 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.508164    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 19:15:49.508505 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.508489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.509412 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.509392    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 19:15:49.509488 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.509400    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 19:15:49.509488 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.509447    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pcj9f\""
Sep 10 19:15:49.509488 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.509456    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 19:15:49.510221 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.510202    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.511376 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511356    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r45qd\""
Sep 10 19:15:49.511467 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511377    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 19:15:49.511582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511314    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/485070b7-9f4c-4d85-8253-89e4199f27a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.511639 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/485070b7-9f4c-4d85-8253-89e4199f27a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.511677 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-daemon-config\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.511714 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-sys-fs\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.511848 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-systemd\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.511889 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511853    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 19:15:49.511889 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-lib-modules\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.511951 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-run-multus-certs\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.511951 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm5pt\" (UniqueName: \"kubernetes.io/projected/dc737961-c84b-467d-9627-dcbdfa1571d2-kube-api-access-nm5pt\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.512016 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.511970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-registration-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.512016 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-host\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.512098 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512082    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-tuned\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.512134 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/485070b7-9f4c-4d85-8253-89e4199f27a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.512194 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbrc4\" (UniqueName: \"kubernetes.io/projected/485070b7-9f4c-4d85-8253-89e4199f27a5-kube-api-access-qbrc4\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.512335 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-run-k8s-cni-cncf-io\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.512406 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512358    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-run-netns\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.512463 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13c9f34d-129c-4305-afec-7e721ec05a79-konnectivity-ca\") pod \"konnectivity-agent-zmmqh\" (UID: \"13c9f34d-129c-4305-afec-7e721ec05a79\") " pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:15:49.512463 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-device-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.512590 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-run\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.512590 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/485070b7-9f4c-4d85-8253-89e4199f27a5-system-cni-dir\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.512590 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/485070b7-9f4c-4d85-8253-89e4199f27a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.512738 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512585    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-var-lib-kubelet\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.512738 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512654    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 19:15:49.512738 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-conf-dir\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.512738 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-var-lib-kubelet\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.512738 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-system-cni-dir\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512740    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-var-lib-cni-bin\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-etc-selinux\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9xks\" (UniqueName: \"kubernetes.io/projected/3211ac29-bc2c-4f3d-8d0d-d12b16845380-kube-api-access-f9xks\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-modprobe-d\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-kubernetes\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512948    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-sys\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.512983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfswf\" (UniqueName: \"kubernetes.io/projected/28c1a812-4250-459c-b182-899b0cb7d1e3-kube-api-access-nfswf\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28c1a812-4250-459c-b182-899b0cb7d1e3-tmp\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/485070b7-9f4c-4d85-8253-89e4199f27a5-cnibin\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513068    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-cni-dir\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.513177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-cnibin\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513546    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-hostroot\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513726    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-etc-kubernetes\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13c9f34d-129c-4305-afec-7e721ec05a79-agent-certs\") pod \"konnectivity-agent-zmmqh\" (UID: \"13c9f34d-129c-4305-afec-7e721ec05a79\") " pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-sysconfig\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-sysctl-conf\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513870    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4zrjm\""
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc737961-c84b-467d-9627-dcbdfa1571d2-cni-binary-copy\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513915    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-socket-dir-parent\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-var-lib-cni-multus\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.513987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.514021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.514018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-socket-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.514735 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.514079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm2mf\" (UniqueName: \"kubernetes.io/projected/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-kube-api-access-lm2mf\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.514735 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.514112    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:49.514735 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.514150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-sysctl-d\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.515323 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.515300    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 19:15:49.515438 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.515349    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 19:10:49 +0000 UTC" deadline="2028-04-14 10:01:38.574928398 +0000 UTC"
Sep 10 19:15:49.515438 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.515434    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13958h45m49.059500078s"
Sep 10 19:15:49.515549 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.515495    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tj896\""
Sep 10 19:15:49.516016 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.516001    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 19:15:49.516454 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.516436    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 19:15:49.516704 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.516688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:49.516773 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.516758    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:15:49.517518 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.517496    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 19:15:49.517518 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.517514    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 19:15:49.517667 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.517560    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 19:15:49.518292 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.518273    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:49.518360 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.518329    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:15:49.519330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.519316    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 19:15:49.546742 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.546714    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-75vgd"
Sep 10 19:15:49.554967 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.554948    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-75vgd"
Sep 10 19:15:49.608657 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.606877    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 19:15:49.614872 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.614850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a99c79-d5ae-4757-b689-764bd57e3eea-host\") pod \"node-ca-2cpxl\" (UID: \"91a99c79-d5ae-4757-b689-764bd57e3eea\") " pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.614952 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.614881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a99c79-d5ae-4757-b689-764bd57e3eea-serviceca\") pod \"node-ca-2cpxl\" (UID: \"91a99c79-d5ae-4757-b689-764bd57e3eea\") " pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.614952 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.614904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28c1a812-4250-459c-b182-899b0cb7d1e3-tmp\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.615054 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.614946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-cni-dir\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.615054 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.614973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-socket-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.615054 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.614997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:49.615054 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-sysconfig\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.615054 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc737961-c84b-467d-9627-dcbdfa1571d2-cni-binary-copy\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-socket-dir-parent\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-cni-dir\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-var-lib-cni-multus\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2mf\" (UniqueName: \"kubernetes.io/projected/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-kube-api-access-lm2mf\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-kubelet\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615137    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-sysconfig\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615147    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-socket-dir-parent\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-socket-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/485070b7-9f4c-4d85-8253-89e4199f27a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-var-lib-cni-multus\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-daemon-config\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-sys-fs\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:49.615330 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-systemd\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615339    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-sys-fs\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.615269    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1cc866ad-d504-4217-96d6-877ba5ef6153-ovn-node-metrics-cert\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615426    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-systemd\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.615507    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs podName:3211ac29-bc2c-4f3d-8d0d-d12b16845380 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:50.115430871 +0000 UTC m=+1.970985884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs") pod "network-metrics-daemon-p8fkk" (UID: "3211ac29-bc2c-4f3d-8d0d-d12b16845380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44581864-3e22-4509-ad4f-03e3ec946cd5-kubelet-config\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-tuned\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/485070b7-9f4c-4d85-8253-89e4199f27a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-device-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615645    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7qj5\" (UniqueName: \"kubernetes.io/projected/70eaf2fa-cb02-4833-9b86-02b4780ce3a7-kube-api-access-g7qj5\") pod \"iptables-alerter-hstsm\" (UID: \"70eaf2fa-cb02-4833-9b86-02b4780ce3a7\") " pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nldwg\" (UniqueName: \"kubernetes.io/projected/04db8de7-0543-4f84-b79b-58de660fd4d3-kube-api-access-nldwg\") pod \"node-resolver-hxp26\" (UID: \"04db8de7-0543-4f84-b79b-58de660fd4d3\") " pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-slash\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615719    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-etc-openvswitch\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-cni-bin\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.616151 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-run\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/485070b7-9f4c-4d85-8253-89e4199f27a5-system-cni-dir\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/485070b7-9f4c-4d85-8253-89e4199f27a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-var-lib-kubelet\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615884    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/485070b7-9f4c-4d85-8253-89e4199f27a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-cni-netd\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615888    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/485070b7-9f4c-4d85-8253-89e4199f27a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1cc866ad-d504-4217-96d6-877ba5ef6153-env-overrides\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615942    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-device-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-etc-selinux\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.615982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-run-systemd\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-var-lib-kubelet\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-var-lib-openvswitch\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-run\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44581864-3e22-4509-ad4f-03e3ec946cd5-dbus\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616094    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/485070b7-9f4c-4d85-8253-89e4199f27a5-system-cni-dir\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616171    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-etc-selinux\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.617036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-modprobe-d\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616222    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-kubernetes\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfswf\" (UniqueName: \"kubernetes.io/projected/28c1a812-4250-459c-b182-899b0cb7d1e3-kube-api-access-nfswf\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04db8de7-0543-4f84-b79b-58de660fd4d3-tmp-dir\") pod \"node-resolver-hxp26\" (UID: \"04db8de7-0543-4f84-b79b-58de660fd4d3\") " pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616297    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc737961-c84b-467d-9627-dcbdfa1571d2-cni-binary-copy\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1cc866ad-d504-4217-96d6-877ba5ef6153-ovnkube-config\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1cc866ad-d504-4217-96d6-877ba5ef6153-ovnkube-script-lib\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/485070b7-9f4c-4d85-8253-89e4199f27a5-cnibin\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616309    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-modprobe-d\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616394    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-kubernetes\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616429    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/485070b7-9f4c-4d85-8253-89e4199f27a5-cnibin\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-cnibin\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-cnibin\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-hostroot\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-etc-kubernetes\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616595    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-etc-kubernetes\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-hostroot\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13c9f34d-129c-4305-afec-7e721ec05a79-agent-certs\") pod \"konnectivity-agent-zmmqh\" (UID: \"13c9f34d-129c-4305-afec-7e721ec05a79\") " pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:15:49.617898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/485070b7-9f4c-4d85-8253-89e4199f27a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616641    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04db8de7-0543-4f84-b79b-58de660fd4d3-hosts-file\") pod \"node-resolver-hxp26\" (UID: \"04db8de7-0543-4f84-b79b-58de660fd4d3\") " pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-sysctl-conf\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616709    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-systemd-units\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-sysctl-d\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616753    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/485070b7-9f4c-4d85-8253-89e4199f27a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.616768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-daemon-config\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-sysctl-conf\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70eaf2fa-cb02-4833-9b86-02b4780ce3a7-host-slash\") pod \"iptables-alerter-hstsm\" (UID: \"70eaf2fa-cb02-4833-9b86-02b4780ce3a7\") " pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srxgv\" (UniqueName: \"kubernetes.io/projected/91a99c79-d5ae-4757-b689-764bd57e3eea-kube-api-access-srxgv\") pod \"node-ca-2cpxl\" (UID: \"91a99c79-d5ae-4757-b689-764bd57e3eea\") " pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-lib-modules\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-run-multus-certs\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5pt\" (UniqueName: \"kubernetes.io/projected/dc737961-c84b-467d-9627-dcbdfa1571d2-kube-api-access-nm5pt\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-registration-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-log-socket\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-host\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.618849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbrc4\" (UniqueName: \"kubernetes.io/projected/485070b7-9f4c-4d85-8253-89e4199f27a5-kube-api-access-qbrc4\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-run-k8s-cni-cncf-io\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-run-netns\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13c9f34d-129c-4305-afec-7e721ec05a79-konnectivity-ca\") pod \"konnectivity-agent-zmmqh\" (UID: \"13c9f34d-129c-4305-afec-7e721ec05a79\") " pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6pmq\" (UniqueName: \"kubernetes.io/projected/1cc866ad-d504-4217-96d6-877ba5ef6153-kube-api-access-t6pmq\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617753    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-conf-dir\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-run-ovn\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-var-lib-kubelet\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/485070b7-9f4c-4d85-8253-89e4199f27a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-system-cni-dir\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-var-lib-cni-bin\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617897    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-lib-modules\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-run-netns\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-node-log\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-run-multus-certs\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.619794 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.617973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9xks\" (UniqueName: \"kubernetes.io/projected/3211ac29-bc2c-4f3d-8d0d-d12b16845380-kube-api-access-f9xks\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-sys\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-host\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-run-openvswitch\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70eaf2fa-cb02-4833-9b86-02b4780ce3a7-iptables-alerter-script\") pod \"iptables-alerter-hstsm\" (UID: \"70eaf2fa-cb02-4833-9b86-02b4780ce3a7\") " pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-run-k8s-cni-cncf-io\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618246    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-run-netns\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618254    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-registration-dir\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-sys\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-multus-conf-dir\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618401    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-sysctl-d\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618436    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-system-cni-dir\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c1a812-4250-459c-b182-899b0cb7d1e3-var-lib-kubelet\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618481    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc737961-c84b-467d-9627-dcbdfa1571d2-host-var-lib-cni-bin\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.618945    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13c9f34d-129c-4305-afec-7e721ec05a79-konnectivity-ca\") pod \"konnectivity-agent-zmmqh\" (UID: \"13c9f34d-129c-4305-afec-7e721ec05a79\") " pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.619735    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/28c1a812-4250-459c-b182-899b0cb7d1e3-etc-tuned\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.619768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28c1a812-4250-459c-b182-899b0cb7d1e3-tmp\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.620712 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.619992    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13c9f34d-129c-4305-afec-7e721ec05a79-agent-certs\") pod \"konnectivity-agent-zmmqh\" (UID: \"13c9f34d-129c-4305-afec-7e721ec05a79\") " pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:15:49.626123 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.626104    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm2mf\" (UniqueName: \"kubernetes.io/projected/300c6d9d-1b78-46e9-a0f0-f9ba4baa8952-kube-api-access-lm2mf\") pod \"aws-ebs-csi-driver-node-xv48f\" (UID: \"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.631477 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.631415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbrc4\" (UniqueName: \"kubernetes.io/projected/485070b7-9f4c-4d85-8253-89e4199f27a5-kube-api-access-qbrc4\") pod \"multus-additional-cni-plugins-2m8jt\" (UID: \"485070b7-9f4c-4d85-8253-89e4199f27a5\") " pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.631925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.631901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm5pt\" (UniqueName: \"kubernetes.io/projected/dc737961-c84b-467d-9627-dcbdfa1571d2-kube-api-access-nm5pt\") pod \"multus-chrt4\" (UID: \"dc737961-c84b-467d-9627-dcbdfa1571d2\") " pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.632125 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.632105    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9xks\" (UniqueName: \"kubernetes.io/projected/3211ac29-bc2c-4f3d-8d0d-d12b16845380-kube-api-access-f9xks\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:49.632190 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.632154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfswf\" (UniqueName: \"kubernetes.io/projected/28c1a812-4250-459c-b182-899b0cb7d1e3-kube-api-access-nfswf\") pod \"tuned-cwq9b\" (UID: \"28c1a812-4250-459c-b182-899b0cb7d1e3\") " pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.718769 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-run-netns\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.718769 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-node-log\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.718982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-run-openvswitch\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.718982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718847    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-run-netns\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.718982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70eaf2fa-cb02-4833-9b86-02b4780ce3a7-iptables-alerter-script\") pod \"iptables-alerter-hstsm\" (UID: \"70eaf2fa-cb02-4833-9b86-02b4780ce3a7\") " pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.718982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a99c79-d5ae-4757-b689-764bd57e3eea-host\") pod \"node-ca-2cpxl\" (UID: \"91a99c79-d5ae-4757-b689-764bd57e3eea\") " pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.718982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718887    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-node-log\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.718982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-run-openvswitch\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.718982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a99c79-d5ae-4757-b689-764bd57e3eea-serviceca\") pod \"node-ca-2cpxl\" (UID: \"91a99c79-d5ae-4757-b689-764bd57e3eea\") " pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.718982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-kubelet\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.718941    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a99c79-d5ae-4757-b689-764bd57e3eea-host\") pod \"node-ca-2cpxl\" (UID: \"91a99c79-d5ae-4757-b689-764bd57e3eea\") " pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1cc866ad-d504-4217-96d6-877ba5ef6153-ovn-node-metrics-cert\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44581864-3e22-4509-ad4f-03e3ec946cd5-kubelet-config\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7qj5\" (UniqueName: \"kubernetes.io/projected/70eaf2fa-cb02-4833-9b86-02b4780ce3a7-kube-api-access-g7qj5\") pod \"iptables-alerter-hstsm\" (UID: \"70eaf2fa-cb02-4833-9b86-02b4780ce3a7\") " pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719149    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.719172    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-kubelet\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.719311    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret podName:44581864-3e22-4509-ad4f-03e3ec946cd5 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:50.219288407 +0000 UTC m=+2.074843427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret") pod "global-pull-secret-syncer-4rh8j" (UID: "44581864-3e22-4509-ad4f-03e3ec946cd5") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:49.719378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719330    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44581864-3e22-4509-ad4f-03e3ec946cd5-kubelet-config\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nldwg\" (UniqueName: \"kubernetes.io/projected/04db8de7-0543-4f84-b79b-58de660fd4d3-kube-api-access-nldwg\") pod \"node-resolver-hxp26\" (UID: \"04db8de7-0543-4f84-b79b-58de660fd4d3\") " pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a99c79-d5ae-4757-b689-764bd57e3eea-serviceca\") pod \"node-ca-2cpxl\" (UID: \"91a99c79-d5ae-4757-b689-764bd57e3eea\") " pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-slash\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-etc-openvswitch\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-slash\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719534    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-etc-openvswitch\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-cni-bin\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70eaf2fa-cb02-4833-9b86-02b4780ce3a7-iptables-alerter-script\") pod \"iptables-alerter-hstsm\" (UID: \"70eaf2fa-cb02-4833-9b86-02b4780ce3a7\") " pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-cni-bin\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719632    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-cni-netd\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-cni-netd\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1cc866ad-d504-4217-96d6-877ba5ef6153-env-overrides\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-run-systemd\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719731    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-run-systemd\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-var-lib-openvswitch\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44581864-3e22-4509-ad4f-03e3ec946cd5-dbus\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719851    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-var-lib-openvswitch\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.720041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04db8de7-0543-4f84-b79b-58de660fd4d3-tmp-dir\") pod \"node-resolver-hxp26\" (UID: \"04db8de7-0543-4f84-b79b-58de660fd4d3\") " pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44581864-3e22-4509-ad4f-03e3ec946cd5-dbus\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719931    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1cc866ad-d504-4217-96d6-877ba5ef6153-ovnkube-config\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1cc866ad-d504-4217-96d6-877ba5ef6153-ovnkube-script-lib\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.719983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04db8de7-0543-4f84-b79b-58de660fd4d3-hosts-file\") pod \"node-resolver-hxp26\" (UID: \"04db8de7-0543-4f84-b79b-58de660fd4d3\") " pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-systemd-units\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70eaf2fa-cb02-4833-9b86-02b4780ce3a7-host-slash\") pod \"iptables-alerter-hstsm\" (UID: \"70eaf2fa-cb02-4833-9b86-02b4780ce3a7\") " pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srxgv\" (UniqueName: \"kubernetes.io/projected/91a99c79-d5ae-4757-b689-764bd57e3eea-kube-api-access-srxgv\") pod \"node-ca-2cpxl\" (UID: \"91a99c79-d5ae-4757-b689-764bd57e3eea\") " pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720094    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-log-socket\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6pmq\" (UniqueName: \"kubernetes.io/projected/1cc866ad-d504-4217-96d6-877ba5ef6153-kube-api-access-t6pmq\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720146    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1cc866ad-d504-4217-96d6-877ba5ef6153-env-overrides\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720167    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04db8de7-0543-4f84-b79b-58de660fd4d3-tmp-dir\") pod \"node-resolver-hxp26\" (UID: \"04db8de7-0543-4f84-b79b-58de660fd4d3\") " pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-run-ovn\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720211    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70eaf2fa-cb02-4833-9b86-02b4780ce3a7-host-slash\") pod \"iptables-alerter-hstsm\" (UID: \"70eaf2fa-cb02-4833-9b86-02b4780ce3a7\") " pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720183    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-run-ovn\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720318    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04db8de7-0543-4f84-b79b-58de660fd4d3-hosts-file\") pod \"node-resolver-hxp26\" (UID: \"04db8de7-0543-4f84-b79b-58de660fd4d3\") " pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720363    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-systemd-units\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720414    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-log-socket\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721651 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720491    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cc866ad-d504-4217-96d6-877ba5ef6153-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721651 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1cc866ad-d504-4217-96d6-877ba5ef6153-ovnkube-config\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721651 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.720616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1cc866ad-d504-4217-96d6-877ba5ef6153-ovnkube-script-lib\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.721970 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.721946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1cc866ad-d504-4217-96d6-877ba5ef6153-ovn-node-metrics-cert\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.729468 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.729441    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:15:49.729468 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.729471    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:15:49.729635 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.729482    2582 projected.go:196] Error preparing data for projected volume kube-api-access-c9fq8 for pod openshift-network-diagnostics/network-check-target-drkm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:49.729635 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:49.729550    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8 podName:5f6cc199-d996-427d-bc8f-39adb7d6a4d6 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:50.229535422 +0000 UTC m=+2.085090455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c9fq8" (UniqueName: "kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8") pod "network-check-target-drkm5" (UID: "5f6cc199-d996-427d-bc8f-39adb7d6a4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:49.731640 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.731608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7qj5\" (UniqueName: \"kubernetes.io/projected/70eaf2fa-cb02-4833-9b86-02b4780ce3a7-kube-api-access-g7qj5\") pod \"iptables-alerter-hstsm\" (UID: \"70eaf2fa-cb02-4833-9b86-02b4780ce3a7\") " pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.731987 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.731958    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nldwg\" (UniqueName: \"kubernetes.io/projected/04db8de7-0543-4f84-b79b-58de660fd4d3-kube-api-access-nldwg\") pod \"node-resolver-hxp26\" (UID: \"04db8de7-0543-4f84-b79b-58de660fd4d3\") " pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.731987 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.731975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srxgv\" (UniqueName: \"kubernetes.io/projected/91a99c79-d5ae-4757-b689-764bd57e3eea-kube-api-access-srxgv\") pod \"node-ca-2cpxl\" (UID: \"91a99c79-d5ae-4757-b689-764bd57e3eea\") " pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.732146 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.732128    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6pmq\" (UniqueName: \"kubernetes.io/projected/1cc866ad-d504-4217-96d6-877ba5ef6153-kube-api-access-t6pmq\") pod \"ovnkube-node-qmhz5\" (UID: \"1cc866ad-d504-4217-96d6-877ba5ef6153\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.739442 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.739418    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5a51648b67abc20f8ee816314baeef.slice/crio-59493ec9a078f9f55cd8aafc54160f6a76bb285524e11829442505dc5ec68276 WatchSource:0}: Error finding container 59493ec9a078f9f55cd8aafc54160f6a76bb285524e11829442505dc5ec68276: Status 404 returned error can't find the container with id 59493ec9a078f9f55cd8aafc54160f6a76bb285524e11829442505dc5ec68276
Sep 10 19:15:49.739727 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.739708    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b12b2fbd9460cffd368b1bb1ef73f5.slice/crio-fe2247054b71e56d3f8bcd0a8851954dfe279e6f7b47764e342844993da4af28 WatchSource:0}: Error finding container fe2247054b71e56d3f8bcd0a8851954dfe279e6f7b47764e342844993da4af28: Status 404 returned error can't find the container with id fe2247054b71e56d3f8bcd0a8851954dfe279e6f7b47764e342844993da4af28
Sep 10 19:15:49.748189 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.748171    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:15:49.820856 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.820808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwq9b"
Sep 10 19:15:49.830015 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.829987    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c1a812_4250_459c_b182_899b0cb7d1e3.slice/crio-d3ed0ccd077967ce696e19f5fc63834e8966b264e6c80fe156061951210a27d6 WatchSource:0}: Error finding container d3ed0ccd077967ce696e19f5fc63834e8966b264e6c80fe156061951210a27d6: Status 404 returned error can't find the container with id d3ed0ccd077967ce696e19f5fc63834e8966b264e6c80fe156061951210a27d6
Sep 10 19:15:49.846867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.846845    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2m8jt"
Sep 10 19:15:49.854789 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.854767    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485070b7_9f4c_4d85_8253_89e4199f27a5.slice/crio-32a201d5466517e744e649a458daae2eaff9e2cf58df43c8a3d501f125d801ae WatchSource:0}: Error finding container 32a201d5466517e744e649a458daae2eaff9e2cf58df43c8a3d501f125d801ae: Status 404 returned error can't find the container with id 32a201d5466517e744e649a458daae2eaff9e2cf58df43c8a3d501f125d801ae
Sep 10 19:15:49.856307 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.856289    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chrt4"
Sep 10 19:15:49.864516 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.864473    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc737961_c84b_467d_9627_dcbdfa1571d2.slice/crio-58dcb0156b4b153dd2ecf09e7d544ce5c55b27452ad79bb8545149d37a374556 WatchSource:0}: Error finding container 58dcb0156b4b153dd2ecf09e7d544ce5c55b27452ad79bb8545149d37a374556: Status 404 returned error can't find the container with id 58dcb0156b4b153dd2ecf09e7d544ce5c55b27452ad79bb8545149d37a374556
Sep 10 19:15:49.871959 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.871943    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:15:49.879047 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.879019    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c9f34d_129c_4305_afec_7e721ec05a79.slice/crio-7472c8cac26f0f1d582b9670be1a1e9c907d007b6d0c51f6e0e842a4747b6db7 WatchSource:0}: Error finding container 7472c8cac26f0f1d582b9670be1a1e9c907d007b6d0c51f6e0e842a4747b6db7: Status 404 returned error can't find the container with id 7472c8cac26f0f1d582b9670be1a1e9c907d007b6d0c51f6e0e842a4747b6db7
Sep 10 19:15:49.894761 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.894738    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f"
Sep 10 19:15:49.902060 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.902039    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hstsm"
Sep 10 19:15:49.903960 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.903937    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod300c6d9d_1b78_46e9_a0f0_f9ba4baa8952.slice/crio-b7d36cefa88024ff3e7d7c49bde1e60b2044646e309e64f7de746e654c74690f WatchSource:0}: Error finding container b7d36cefa88024ff3e7d7c49bde1e60b2044646e309e64f7de746e654c74690f: Status 404 returned error can't find the container with id b7d36cefa88024ff3e7d7c49bde1e60b2044646e309e64f7de746e654c74690f
Sep 10 19:15:49.910254 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.910233    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70eaf2fa_cb02_4833_9b86_02b4780ce3a7.slice/crio-4c0ba6b05258c8f1e47bcd3c062b258737d044e8e6d34d635ebcbb69bf98319c WatchSource:0}: Error finding container 4c0ba6b05258c8f1e47bcd3c062b258737d044e8e6d34d635ebcbb69bf98319c: Status 404 returned error can't find the container with id 4c0ba6b05258c8f1e47bcd3c062b258737d044e8e6d34d635ebcbb69bf98319c
Sep 10 19:15:49.917564 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.917545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2cpxl"
Sep 10 19:15:49.926127 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.926106    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a99c79_d5ae_4757_b689_764bd57e3eea.slice/crio-f9d31971eca56a9fc4da3f639a7e63fb40708733aa19538cad08cf9ffce324a5 WatchSource:0}: Error finding container f9d31971eca56a9fc4da3f639a7e63fb40708733aa19538cad08cf9ffce324a5: Status 404 returned error can't find the container with id f9d31971eca56a9fc4da3f639a7e63fb40708733aa19538cad08cf9ffce324a5
Sep 10 19:15:49.943601 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.943578    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hxp26"
Sep 10 19:15:49.948765 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:49.948743    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:15:49.951635 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.951617    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04db8de7_0543_4f84_b79b_58de660fd4d3.slice/crio-04b7da6581412b4226e6716827c437b3ca4f52ba8b723a2c6b477838492c540b WatchSource:0}: Error finding container 04b7da6581412b4226e6716827c437b3ca4f52ba8b723a2c6b477838492c540b: Status 404 returned error can't find the container with id 04b7da6581412b4226e6716827c437b3ca4f52ba8b723a2c6b477838492c540b
Sep 10 19:15:49.956891 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:15:49.956868    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc866ad_d504_4217_96d6_877ba5ef6153.slice/crio-8771c3ce01696d47e69efc53d9d6a5b5b60966f7f4c597186929cef1460539a3 WatchSource:0}: Error finding container 8771c3ce01696d47e69efc53d9d6a5b5b60966f7f4c597186929cef1460539a3: Status 404 returned error can't find the container with id 8771c3ce01696d47e69efc53d9d6a5b5b60966f7f4c597186929cef1460539a3
Sep 10 19:15:50.040207 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.040170    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:15:50.123298 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.123205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:50.123479 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:50.123381    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:50.123568 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:50.123483    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs podName:3211ac29-bc2c-4f3d-8d0d-d12b16845380 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:51.123462083 +0000 UTC m=+2.979017096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs") pod "network-metrics-daemon-p8fkk" (UID: "3211ac29-bc2c-4f3d-8d0d-d12b16845380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:50.223866 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.223827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:50.224054 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:50.224032    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:50.224134 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:50.224120    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret podName:44581864-3e22-4509-ad4f-03e3ec946cd5 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:51.224099197 +0000 UTC m=+3.079654216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret") pod "global-pull-secret-syncer-4rh8j" (UID: "44581864-3e22-4509-ad4f-03e3ec946cd5") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:50.256292 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.256260    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:15:50.325032 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.324985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:50.325264 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:50.325215    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:15:50.325264 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:50.325241    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:15:50.325264 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:50.325256    2582 projected.go:196] Error preparing data for projected volume kube-api-access-c9fq8 for pod openshift-network-diagnostics/network-check-target-drkm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:50.325264 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:50.325331    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8 podName:5f6cc199-d996-427d-bc8f-39adb7d6a4d6 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:51.32530802 +0000 UTC m=+3.180863031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9fq8" (UniqueName: "kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8") pod "network-check-target-drkm5" (UID: "5f6cc199-d996-427d-bc8f-39adb7d6a4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:50.557258 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.557132    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 19:10:50 +0000 UTC" deadline="2028-06-09 04:12:04.278365156 +0000 UTC"
Sep 10 19:15:50.557258 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.557206    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15296h56m13.721163442s"
Sep 10 19:15:50.665557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.665526    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:50.665710 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:50.665660    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:15:50.705155 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.705024    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" event={"ID":"dd5a51648b67abc20f8ee816314baeef","Type":"ContainerStarted","Data":"59493ec9a078f9f55cd8aafc54160f6a76bb285524e11829442505dc5ec68276"}
Sep 10 19:15:50.726519 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.726456    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" event={"ID":"b0b12b2fbd9460cffd368b1bb1ef73f5","Type":"ContainerStarted","Data":"fe2247054b71e56d3f8bcd0a8851954dfe279e6f7b47764e342844993da4af28"}
Sep 10 19:15:50.737278 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.737140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" event={"ID":"1cc866ad-d504-4217-96d6-877ba5ef6153","Type":"ContainerStarted","Data":"8771c3ce01696d47e69efc53d9d6a5b5b60966f7f4c597186929cef1460539a3"}
Sep 10 19:15:50.745284 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.745253    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hxp26" event={"ID":"04db8de7-0543-4f84-b79b-58de660fd4d3","Type":"ContainerStarted","Data":"04b7da6581412b4226e6716827c437b3ca4f52ba8b723a2c6b477838492c540b"}
Sep 10 19:15:50.754876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.754846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2cpxl" event={"ID":"91a99c79-d5ae-4757-b689-764bd57e3eea","Type":"ContainerStarted","Data":"f9d31971eca56a9fc4da3f639a7e63fb40708733aa19538cad08cf9ffce324a5"}
Sep 10 19:15:50.774711 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.774677    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hstsm" event={"ID":"70eaf2fa-cb02-4833-9b86-02b4780ce3a7","Type":"ContainerStarted","Data":"4c0ba6b05258c8f1e47bcd3c062b258737d044e8e6d34d635ebcbb69bf98319c"}
Sep 10 19:15:50.792310 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.792273    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f" event={"ID":"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952","Type":"ContainerStarted","Data":"b7d36cefa88024ff3e7d7c49bde1e60b2044646e309e64f7de746e654c74690f"}
Sep 10 19:15:50.824597 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.824506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmmqh" event={"ID":"13c9f34d-129c-4305-afec-7e721ec05a79","Type":"ContainerStarted","Data":"7472c8cac26f0f1d582b9670be1a1e9c907d007b6d0c51f6e0e842a4747b6db7"}
Sep 10 19:15:50.840085 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.840048    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chrt4" event={"ID":"dc737961-c84b-467d-9627-dcbdfa1571d2","Type":"ContainerStarted","Data":"58dcb0156b4b153dd2ecf09e7d544ce5c55b27452ad79bb8545149d37a374556"}
Sep 10 19:15:50.859673 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.859594    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m8jt" event={"ID":"485070b7-9f4c-4d85-8253-89e4199f27a5","Type":"ContainerStarted","Data":"32a201d5466517e744e649a458daae2eaff9e2cf58df43c8a3d501f125d801ae"}
Sep 10 19:15:50.868752 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:50.868030    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwq9b" event={"ID":"28c1a812-4250-459c-b182-899b0cb7d1e3","Type":"ContainerStarted","Data":"d3ed0ccd077967ce696e19f5fc63834e8966b264e6c80fe156061951210a27d6"}
Sep 10 19:15:51.133635 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:51.133547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:51.133795 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.133728    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:51.133863 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.133796    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs podName:3211ac29-bc2c-4f3d-8d0d-d12b16845380 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:53.133775295 +0000 UTC m=+4.989330331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs") pod "network-metrics-daemon-p8fkk" (UID: "3211ac29-bc2c-4f3d-8d0d-d12b16845380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:51.234973 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:51.234927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:51.235172 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.235110    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:51.235237 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.235193    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret podName:44581864-3e22-4509-ad4f-03e3ec946cd5 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:53.235159964 +0000 UTC m=+5.090714977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret") pod "global-pull-secret-syncer-4rh8j" (UID: "44581864-3e22-4509-ad4f-03e3ec946cd5") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:51.335935 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:51.335894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:51.336174 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.336130    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:15:51.336174 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.336160    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:15:51.336174 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.336173    2582 projected.go:196] Error preparing data for projected volume kube-api-access-c9fq8 for pod openshift-network-diagnostics/network-check-target-drkm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:51.336355 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.336235    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8 podName:5f6cc199-d996-427d-bc8f-39adb7d6a4d6 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:53.336216516 +0000 UTC m=+5.191771543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9fq8" (UniqueName: "kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8") pod "network-check-target-drkm5" (UID: "5f6cc199-d996-427d-bc8f-39adb7d6a4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:51.557882 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:51.557516    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 19:10:50 +0000 UTC" deadline="2028-02-20 19:43:14.510566488 +0000 UTC"
Sep 10 19:15:51.557882 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:51.557833    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12672h27m22.952741133s"
Sep 10 19:15:51.663400 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:51.663353    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:51.663607 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.663515    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:15:51.664015 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:51.663991    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:51.664133 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:51.664113    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:15:52.663645 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:52.663614    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:52.664112 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:52.663753    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:15:53.152545 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:53.152376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:53.152727 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.152562    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:53.152727 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.152640    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs podName:3211ac29-bc2c-4f3d-8d0d-d12b16845380 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:57.152618655 +0000 UTC m=+9.008173670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs") pod "network-metrics-daemon-p8fkk" (UID: "3211ac29-bc2c-4f3d-8d0d-d12b16845380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:53.253096 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:53.253036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:53.253287 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.253220    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:53.253350 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.253290    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret podName:44581864-3e22-4509-ad4f-03e3ec946cd5 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:57.253271113 +0000 UTC m=+9.108826138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret") pod "global-pull-secret-syncer-4rh8j" (UID: "44581864-3e22-4509-ad4f-03e3ec946cd5") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:53.354744 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:53.354029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:53.354744 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.354267    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:15:53.354744 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.354289    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:15:53.354744 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.354303    2582 projected.go:196] Error preparing data for projected volume kube-api-access-c9fq8 for pod openshift-network-diagnostics/network-check-target-drkm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:53.354744 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.354367    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8 podName:5f6cc199-d996-427d-bc8f-39adb7d6a4d6 nodeName:}" failed. No retries permitted until 2026-09-10 19:15:57.354346894 +0000 UTC m=+9.209901911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9fq8" (UniqueName: "kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8") pod "network-check-target-drkm5" (UID: "5f6cc199-d996-427d-bc8f-39adb7d6a4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:53.663199 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:53.663154    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:53.663373 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:53.663215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:53.663373 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.663311    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:15:53.663557 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:53.663493    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:15:54.664176 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:54.663639    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:54.664176 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:54.663785    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:15:55.663548 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:55.663008    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:55.663548 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:55.663151    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:15:55.663548 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:55.663204    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:55.663548 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:55.663317    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:15:56.663569 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:56.663494    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:56.664046 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:56.663645    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:15:57.187492 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:57.187423    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:57.187705 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.187599    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:57.187705 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.187675    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs podName:3211ac29-bc2c-4f3d-8d0d-d12b16845380 nodeName:}" failed. No retries permitted until 2026-09-10 19:16:05.187654606 +0000 UTC m=+17.043209620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs") pod "network-metrics-daemon-p8fkk" (UID: "3211ac29-bc2c-4f3d-8d0d-d12b16845380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:15:57.289058 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:57.288776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:57.289058 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.288929    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:57.289058 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.289002    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret podName:44581864-3e22-4509-ad4f-03e3ec946cd5 nodeName:}" failed. No retries permitted until 2026-09-10 19:16:05.288980722 +0000 UTC m=+17.144535731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret") pod "global-pull-secret-syncer-4rh8j" (UID: "44581864-3e22-4509-ad4f-03e3ec946cd5") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:15:57.389649 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:57.389587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:57.389814 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.389771    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:15:57.389814 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.389799    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:15:57.389814 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.389809    2582 projected.go:196] Error preparing data for projected volume kube-api-access-c9fq8 for pod openshift-network-diagnostics/network-check-target-drkm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:57.389995 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.389896    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8 podName:5f6cc199-d996-427d-bc8f-39adb7d6a4d6 nodeName:}" failed. No retries permitted until 2026-09-10 19:16:05.389875421 +0000 UTC m=+17.245430489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9fq8" (UniqueName: "kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8") pod "network-check-target-drkm5" (UID: "5f6cc199-d996-427d-bc8f-39adb7d6a4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:15:57.664079 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:57.663450    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:57.664079 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.663604    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:15:57.664079 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:57.663657    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:57.664079 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:57.663801    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:15:58.664378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:58.664340    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:15:58.664892 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:58.664465    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:15:59.663061 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:59.662895    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:15:59.663061 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:15:59.662942    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:15:59.663061 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:59.663041    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:15:59.663355 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:15:59.663188    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:00.663528 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:00.663491    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:00.663984 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:00.663646    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:01.662486 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:01.662458    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:01.662486 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:01.662468    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:01.662718 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:01.662562    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:01.662718 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:01.662693    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:02.663355 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:02.663317    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:02.663840 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:02.663465    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:03.662834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:03.662797    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:03.663004 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:03.662935    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:03.663004 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:03.662987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:03.663123 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:03.663101    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:04.663323 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:04.663268    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:04.663906 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:04.663423    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:05.248985 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:05.248952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:05.249211 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.249108    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:16:05.249211 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.249195    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs podName:3211ac29-bc2c-4f3d-8d0d-d12b16845380 nodeName:}" failed. No retries permitted until 2026-09-10 19:16:21.249173885 +0000 UTC m=+33.104728911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs") pod "network-metrics-daemon-p8fkk" (UID: "3211ac29-bc2c-4f3d-8d0d-d12b16845380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:16:05.349517 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:05.349480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:05.349659 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.349639    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:16:05.349728 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.349716    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret podName:44581864-3e22-4509-ad4f-03e3ec946cd5 nodeName:}" failed. No retries permitted until 2026-09-10 19:16:21.349696994 +0000 UTC m=+33.205252004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret") pod "global-pull-secret-syncer-4rh8j" (UID: "44581864-3e22-4509-ad4f-03e3ec946cd5") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:16:05.449983 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:05.449943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:05.450153 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.450131    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:16:05.450215 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.450159    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:16:05.450215 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.450169    2582 projected.go:196] Error preparing data for projected volume kube-api-access-c9fq8 for pod openshift-network-diagnostics/network-check-target-drkm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:16:05.450286 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.450219    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8 podName:5f6cc199-d996-427d-bc8f-39adb7d6a4d6 nodeName:}" failed. No retries permitted until 2026-09-10 19:16:21.450205955 +0000 UTC m=+33.305760962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9fq8" (UniqueName: "kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8") pod "network-check-target-drkm5" (UID: "5f6cc199-d996-427d-bc8f-39adb7d6a4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:16:05.663079 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:05.662997    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:05.663079 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:05.663054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:05.663282 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.663137    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:05.663381 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:05.663289    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:06.662914 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:06.662883    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:06.663096 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:06.662993    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:07.662572 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:07.662534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:07.662960 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:07.662651    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:07.662960 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:07.662707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:07.662960 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:07.662808    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:08.663063 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:08.663028    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:08.663558 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:08.663525    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:09.663219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:09.663196    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:09.663532 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:09.663199    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:09.663532 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:09.663299    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:09.663532 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:09.663399    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:09.942761 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:09.942257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwq9b" event={"ID":"28c1a812-4250-459c-b182-899b0cb7d1e3","Type":"ContainerStarted","Data":"696e193a8cd58c2012ced1ef06627f5fc2e06775393406ba80f6acf2fc54bf0b"}
Sep 10 19:16:09.952459 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:09.952404    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" event={"ID":"b0b12b2fbd9460cffd368b1bb1ef73f5","Type":"ContainerStarted","Data":"8378fcd156379ed431410ca236a1e0f30aca3d88e09f24dccc46d7a071b101d2"}
Sep 10 19:16:09.958936 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:09.958902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" event={"ID":"1cc866ad-d504-4217-96d6-877ba5ef6153","Type":"ContainerStarted","Data":"57f09d0a3e9d4fac79e42e93a9d478d9817b32be4196423195b7eb2f422448f3"}
Sep 10 19:16:09.962375 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:09.962321    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cwq9b" podStartSLOduration=1.1236976379999999 podStartE2EDuration="20.962307621s" totalImagesPullingTime="19.838609983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:09.961476975 +0000 UTC m=+21.817032018" watchObservedRunningTime="2026-09-10 19:16:09.962307621 +0000 UTC m=+21.817862650"
Sep 10 19:16:09.977324 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:09.976544    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" podStartSLOduration=19.976523158 podStartE2EDuration="19.976523158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:09.975657662 +0000 UTC m=+21.831212713" watchObservedRunningTime="2026-09-10 19:16:09.976523158 +0000 UTC m=+21.832078187"
Sep 10 19:16:10.663036 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.662751    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:10.663172 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:10.663104    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:10.963435 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.963341    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f" event={"ID":"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952","Type":"ContainerStarted","Data":"e882af8b2d7fd6ebf16ee3f8d642daa580ead7a3a190d58a97420ed13b954c18"}
Sep 10 19:16:10.964913 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.964889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmmqh" event={"ID":"13c9f34d-129c-4305-afec-7e721ec05a79","Type":"ContainerStarted","Data":"a807cb912194351deb94ade25f1bbe2afa8e229de9a9482b30849f89b0d5c214"}
Sep 10 19:16:10.966552 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.966528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chrt4" event={"ID":"dc737961-c84b-467d-9627-dcbdfa1571d2","Type":"ContainerStarted","Data":"ba980b542e45b5563ee85877b792a86058be476ae1662b0a42c8efa89d07a279"}
Sep 10 19:16:10.968181 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.968149    2582 generic.go:356] "Generic (PLEG): container finished" podID="485070b7-9f4c-4d85-8253-89e4199f27a5" containerID="bf5be9ff6e07b55676f27fde4501208f7dcf39a5f9d60560d642ede867ccc282" exitCode=0
Sep 10 19:16:10.968344 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.968241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m8jt" event={"ID":"485070b7-9f4c-4d85-8253-89e4199f27a5","Type":"ContainerDied","Data":"bf5be9ff6e07b55676f27fde4501208f7dcf39a5f9d60560d642ede867ccc282"}
Sep 10 19:16:10.970252 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.970224    2582 generic.go:356] "Generic (PLEG): container finished" podID="dd5a51648b67abc20f8ee816314baeef" containerID="17eb253445fa68074499638ba39893c024c84919c5c5586de0d7155c47d8d668" exitCode=0
Sep 10 19:16:10.970323 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.970303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" event={"ID":"dd5a51648b67abc20f8ee816314baeef","Type":"ContainerDied","Data":"17eb253445fa68074499638ba39893c024c84919c5c5586de0d7155c47d8d668"}
Sep 10 19:16:10.973803 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.973780    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" event={"ID":"1cc866ad-d504-4217-96d6-877ba5ef6153","Type":"ContainerStarted","Data":"ca60e512a64a617724302ebf76aab92541109394aebe64e8a370aec018bc7c53"}
Sep 10 19:16:10.973892 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.973858    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" event={"ID":"1cc866ad-d504-4217-96d6-877ba5ef6153","Type":"ContainerStarted","Data":"a4bc48ea44946cbd356b329f6ef2a01ee8966f77630f4586275a533accc22e04"}
Sep 10 19:16:10.973954 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.973911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" event={"ID":"1cc866ad-d504-4217-96d6-877ba5ef6153","Type":"ContainerStarted","Data":"f3ed447ae030a812052250c060b62b7fd476d41ff437630576bba8701058a9a0"}
Sep 10 19:16:10.974009 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.973956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" event={"ID":"1cc866ad-d504-4217-96d6-877ba5ef6153","Type":"ContainerStarted","Data":"950146683f7384af62b886430de7e72e2aad9fbea1921044089b147be4efd9e1"}
Sep 10 19:16:10.974009 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.974002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" event={"ID":"1cc866ad-d504-4217-96d6-877ba5ef6153","Type":"ContainerStarted","Data":"40a98b504c6ee49b97d062c4fcfd8024a966a5ea047f9dc54df7ca9be571d1cd"}
Sep 10 19:16:10.975287 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.975263    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hxp26" event={"ID":"04db8de7-0543-4f84-b79b-58de660fd4d3","Type":"ContainerStarted","Data":"7e0b6a868eba3102c088fcd251f2bb05b80aaff48837ddfcbc0521ef5be53641"}
Sep 10 19:16:10.976845 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.976818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2cpxl" event={"ID":"91a99c79-d5ae-4757-b689-764bd57e3eea","Type":"ContainerStarted","Data":"de10b55a1266ee6e2a470d75d2f031b5aaa39d117d44776a1473deb8c22dc338"}
Sep 10 19:16:10.981026 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:10.980990    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zmmqh" podStartSLOduration=2.205426515 podStartE2EDuration="21.980974108s" totalImagesPullingTime="19.775547593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:10.980515959 +0000 UTC m=+22.836070988" watchObservedRunningTime="2026-09-10 19:16:10.980974108 +0000 UTC m=+22.836529138"
Sep 10 19:16:11.015441 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.015382    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-chrt4" podStartSLOduration=2.032134745 podStartE2EDuration="22.015364679s" totalImagesPullingTime="19.983229934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:11.014853544 +0000 UTC m=+22.870408607" watchObservedRunningTime="2026-09-10 19:16:11.015364679 +0000 UTC m=+22.870919713"
Sep 10 19:16:11.030293 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.030250    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2cpxl" podStartSLOduration=9.517834975 podStartE2EDuration="22.03023381s" totalImagesPullingTime="12.512398835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:11.029995086 +0000 UTC m=+22.885550126" watchObservedRunningTime="2026-09-10 19:16:11.03023381 +0000 UTC m=+22.885788841"
Sep 10 19:16:11.090659 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.090611    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hxp26" podStartSLOduration=6.283825756 podStartE2EDuration="22.090597052s" totalImagesPullingTime="15.806771296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:11.072057962 +0000 UTC m=+22.927612992" watchObservedRunningTime="2026-09-10 19:16:11.090597052 +0000 UTC m=+22.946152081"
Sep 10 19:16:11.198494 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.198468    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 19:16:11.570197 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.570041    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T19:16:11.198490136Z","UUID":"3d62facb-69c9-413a-b7ed-fb6d7dc55b35","Handler":null,"Name":"","Endpoint":""}
Sep 10 19:16:11.571762 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.571740    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 19:16:11.571890 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.571775    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 19:16:11.663032 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.662997    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:11.663208 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.663002    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:11.663208 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:11.663147    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:11.663335 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:11.663206    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:11.875583 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.875484    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:16:11.876384 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.876354    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:16:11.982767 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.982730    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" event={"ID":"dd5a51648b67abc20f8ee816314baeef","Type":"ContainerStarted","Data":"dcc1ac307ea8628cc5098247fea3292e2c50a3788bf3546a3a5c29b59725c052"}
Sep 10 19:16:11.984732 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.984653    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hstsm" event={"ID":"70eaf2fa-cb02-4833-9b86-02b4780ce3a7","Type":"ContainerStarted","Data":"a7962409cf3cd7280cda3a2dccbf066239fd455e976749227e81bc3207c262fe"}
Sep 10 19:16:11.986976 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.986903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f" event={"ID":"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952","Type":"ContainerStarted","Data":"4e0061075eb9630cb0db9674d1af838df1d41ec5b32aab8f652d9c03e3caa1b5"}
Sep 10 19:16:11.987550 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.987525    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:16:11.988027 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.988009    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zmmqh"
Sep 10 19:16:11.997928 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:11.997893    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" podStartSLOduration=21.997880756 podStartE2EDuration="21.997880756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:11.997608245 +0000 UTC m=+23.853163274" watchObservedRunningTime="2026-09-10 19:16:11.997880756 +0000 UTC m=+23.853435785"
Sep 10 19:16:12.028528 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:12.028488    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hstsm" podStartSLOduration=3.284404312 podStartE2EDuration="23.028473344s" totalImagesPullingTime="19.744069032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:12.028100019 +0000 UTC m=+23.883655048" watchObservedRunningTime="2026-09-10 19:16:12.028473344 +0000 UTC m=+23.884028372"
Sep 10 19:16:12.663685 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:12.663508    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:12.663843 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:12.663756    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:12.993828 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:12.993792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" event={"ID":"1cc866ad-d504-4217-96d6-877ba5ef6153","Type":"ContainerStarted","Data":"003f7bbf72cb3b213111a00b9ff2c774174e833b276d55bdb0d52084e0e90bcc"}
Sep 10 19:16:12.996321 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:12.996291    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f" event={"ID":"300c6d9d-1b78-46e9-a0f0-f9ba4baa8952","Type":"ContainerStarted","Data":"f8cf113edc1fb7fc2198c96bc233eeba9c4cb7f321866b478a604aa139cf84d5"}
Sep 10 19:16:13.016891 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:13.016836    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv48f" podStartSLOduration=2.5734036959999997 podStartE2EDuration="24.016816983s" totalImagesPullingTime="21.443413287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:13.01564088 +0000 UTC m=+24.871195911" watchObservedRunningTime="2026-09-10 19:16:13.016816983 +0000 UTC m=+24.872372013"
Sep 10 19:16:13.663077 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:13.663044    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:13.663273 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:13.663085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:13.663273 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:13.663173    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:13.663389 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:13.663305    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:14.666898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:14.666869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:14.667264 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:14.666982    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:15.663254 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:15.663020    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:15.663254 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:15.663020    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:15.663494 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:15.663298    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:15.663494 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:15.663342    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:16.005523 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:16.005444    2582 generic.go:356] "Generic (PLEG): container finished" podID="485070b7-9f4c-4d85-8253-89e4199f27a5" containerID="417a434b82490e8e737b06d8913ae7d41344ec40eb0c454663fb7a2f803e48f9" exitCode=0
Sep 10 19:16:16.005905 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:16.005526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m8jt" event={"ID":"485070b7-9f4c-4d85-8253-89e4199f27a5","Type":"ContainerDied","Data":"417a434b82490e8e737b06d8913ae7d41344ec40eb0c454663fb7a2f803e48f9"}
Sep 10 19:16:16.009565 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:16.009527    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" event={"ID":"1cc866ad-d504-4217-96d6-877ba5ef6153","Type":"ContainerStarted","Data":"4756194dc26e6df5608ac95d161384d7eee52929ffaa2003365ab4a984c878ae"}
Sep 10 19:16:16.009780 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:16.009766    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:16:16.009833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:16.009808    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:16:16.024913 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:16.024891    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:16:16.057801 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:16.057749    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5" podStartSLOduration=7.32387078 podStartE2EDuration="27.057734999s" totalImagesPullingTime="19.733864219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:16.055398189 +0000 UTC m=+27.910953233" watchObservedRunningTime="2026-09-10 19:16:16.057734999 +0000 UTC m=+27.913290028"
Sep 10 19:16:16.665844 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:16.665819    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:16.666039 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:16.665907    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:17.014370 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.014288    2582 generic.go:356] "Generic (PLEG): container finished" podID="485070b7-9f4c-4d85-8253-89e4199f27a5" containerID="b00756fb93fadfd540e472fff7f5d27960114541d1e20282dfa965569dfe4e9a" exitCode=0
Sep 10 19:16:17.015124 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.014362    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m8jt" event={"ID":"485070b7-9f4c-4d85-8253-89e4199f27a5","Type":"ContainerDied","Data":"b00756fb93fadfd540e472fff7f5d27960114541d1e20282dfa965569dfe4e9a"}
Sep 10 19:16:17.015124 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.014788    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:16:17.029500 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.029473    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:16:17.390859 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.390772    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-drkm5"]
Sep 10 19:16:17.391018 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.390883    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:17.391018 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:17.390982    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:17.391641 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.391621    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rh8j"]
Sep 10 19:16:17.391748 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.391709    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:17.391809 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:17.391786    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:17.392294 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.392272    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8fkk"]
Sep 10 19:16:17.392424 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:17.392393    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:17.392553 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:17.392528    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:18.019022 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:18.018756    2582 generic.go:356] "Generic (PLEG): container finished" podID="485070b7-9f4c-4d85-8253-89e4199f27a5" containerID="cae40c1a9cbae3d1ad8a3d3fde25c85ea5dde3e3e172f8cc7bcdc81b5e9d63d3" exitCode=0
Sep 10 19:16:18.019022 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:18.018838    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m8jt" event={"ID":"485070b7-9f4c-4d85-8253-89e4199f27a5","Type":"ContainerDied","Data":"cae40c1a9cbae3d1ad8a3d3fde25c85ea5dde3e3e172f8cc7bcdc81b5e9d63d3"}
Sep 10 19:16:18.666713 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:18.666686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:18.666807 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:18.666794    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:19.663495 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:19.663396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:19.663939 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:19.663532    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:19.663939 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:19.663405    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:19.663939 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:19.663624    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:20.666695 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:20.666667    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:20.667054 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:20.666782    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fkk" podUID="3211ac29-bc2c-4f3d-8d0d-d12b16845380"
Sep 10 19:16:21.274665 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:21.274627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:21.274840 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.274805    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:16:21.274901 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.274886    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs podName:3211ac29-bc2c-4f3d-8d0d-d12b16845380 nodeName:}" failed. No retries permitted until 2026-09-10 19:16:53.274867715 +0000 UTC m=+65.130422722 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs") pod "network-metrics-daemon-p8fkk" (UID: "3211ac29-bc2c-4f3d-8d0d-d12b16845380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:16:21.375293 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:21.375255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:21.375508 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.375382    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:16:21.375508 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.375471    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret podName:44581864-3e22-4509-ad4f-03e3ec946cd5 nodeName:}" failed. No retries permitted until 2026-09-10 19:16:53.375450745 +0000 UTC m=+65.231005972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret") pod "global-pull-secret-syncer-4rh8j" (UID: "44581864-3e22-4509-ad4f-03e3ec946cd5") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:16:21.475759 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:21.475715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:21.475939 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.475917    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:16:21.475989 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.475947    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:16:21.475989 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.475961    2582 projected.go:196] Error preparing data for projected volume kube-api-access-c9fq8 for pod openshift-network-diagnostics/network-check-target-drkm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:16:21.476072 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.476026    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8 podName:5f6cc199-d996-427d-bc8f-39adb7d6a4d6 nodeName:}" failed. No retries permitted until 2026-09-10 19:16:53.476007636 +0000 UTC m=+65.331562683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9fq8" (UniqueName: "kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8") pod "network-check-target-drkm5" (UID: "5f6cc199-d996-427d-bc8f-39adb7d6a4d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:16:21.662723 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:21.662636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:21.662876 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.662748    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drkm5" podUID="5f6cc199-d996-427d-bc8f-39adb7d6a4d6"
Sep 10 19:16:21.662876 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:21.662805    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:21.662988 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:21.662913    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rh8j" podUID="44581864-3e22-4509-ad4f-03e3ec946cd5"
Sep 10 19:16:22.415930 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.415843    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeReady"
Sep 10 19:16:22.416263 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.415963    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 19:16:22.467068 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.467035    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xwwll"]
Sep 10 19:16:22.476607 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.476579    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zkvnb"]
Sep 10 19:16:22.476804 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.476702    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.479162 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.479132    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wkm4c\""
Sep 10 19:16:22.479507 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.479132    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 19:16:22.479507 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.479132    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 19:16:22.487110 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.487091    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zkvnb"]
Sep 10 19:16:22.487208 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.487120    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xwwll"]
Sep 10 19:16:22.487208 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.487191    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zkvnb"
Sep 10 19:16:22.489673 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.489653    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 19:16:22.489673 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.489667    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 19:16:22.489894 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.489882    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 19:16:22.490013 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.489992    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rjc7l\""
Sep 10 19:16:22.581509 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.581442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c55461a6-a784-44eb-a1b6-6c8772f3b7a2-cert\") pod \"ingress-canary-zkvnb\" (UID: \"c55461a6-a784-44eb-a1b6-6c8772f3b7a2\") " pod="openshift-ingress-canary/ingress-canary-zkvnb"
Sep 10 19:16:22.581509 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.581477    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9d67ecc-7752-483c-a716-e603acbc782b-tmp-dir\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.581509 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.581498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d67ecc-7752-483c-a716-e603acbc782b-config-volume\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.581754 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.581516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwzf\" (UniqueName: \"kubernetes.io/projected/b9d67ecc-7752-483c-a716-e603acbc782b-kube-api-access-mxwzf\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.581754 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.581532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dql44\" (UniqueName: \"kubernetes.io/projected/c55461a6-a784-44eb-a1b6-6c8772f3b7a2-kube-api-access-dql44\") pod \"ingress-canary-zkvnb\" (UID: \"c55461a6-a784-44eb-a1b6-6c8772f3b7a2\") " pod="openshift-ingress-canary/ingress-canary-zkvnb"
Sep 10 19:16:22.581754 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.581573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.666336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.666311    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:22.668867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.668843    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 19:16:22.669009 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.668994    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gqr5m\""
Sep 10 19:16:22.682786 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.682763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c55461a6-a784-44eb-a1b6-6c8772f3b7a2-cert\") pod \"ingress-canary-zkvnb\" (UID: \"c55461a6-a784-44eb-a1b6-6c8772f3b7a2\") " pod="openshift-ingress-canary/ingress-canary-zkvnb"
Sep 10 19:16:22.682908 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.682792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9d67ecc-7752-483c-a716-e603acbc782b-tmp-dir\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.682908 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.682812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d67ecc-7752-483c-a716-e603acbc782b-config-volume\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.682908 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.682829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwzf\" (UniqueName: \"kubernetes.io/projected/b9d67ecc-7752-483c-a716-e603acbc782b-kube-api-access-mxwzf\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.683090 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.682960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dql44\" (UniqueName: \"kubernetes.io/projected/c55461a6-a784-44eb-a1b6-6c8772f3b7a2-kube-api-access-dql44\") pod \"ingress-canary-zkvnb\" (UID: \"c55461a6-a784-44eb-a1b6-6c8772f3b7a2\") " pod="openshift-ingress-canary/ingress-canary-zkvnb"
Sep 10 19:16:22.683090 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.683022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.683189 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.683132    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9d67ecc-7752-483c-a716-e603acbc782b-tmp-dir\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.683189 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:22.683144    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:16:22.683279 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:22.683195    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls podName:b9d67ecc-7752-483c-a716-e603acbc782b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:23.183180546 +0000 UTC m=+35.038735556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls") pod "dns-default-xwwll" (UID: "b9d67ecc-7752-483c-a716-e603acbc782b") : secret "dns-default-metrics-tls" not found
Sep 10 19:16:22.683432 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.683399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d67ecc-7752-483c-a716-e603acbc782b-config-volume\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.686807 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.686791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c55461a6-a784-44eb-a1b6-6c8772f3b7a2-cert\") pod \"ingress-canary-zkvnb\" (UID: \"c55461a6-a784-44eb-a1b6-6c8772f3b7a2\") " pod="openshift-ingress-canary/ingress-canary-zkvnb"
Sep 10 19:16:22.691764 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.691743    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwzf\" (UniqueName: \"kubernetes.io/projected/b9d67ecc-7752-483c-a716-e603acbc782b-kube-api-access-mxwzf\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:22.691872 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.691854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dql44\" (UniqueName: \"kubernetes.io/projected/c55461a6-a784-44eb-a1b6-6c8772f3b7a2-kube-api-access-dql44\") pod \"ingress-canary-zkvnb\" (UID: \"c55461a6-a784-44eb-a1b6-6c8772f3b7a2\") " pod="openshift-ingress-canary/ingress-canary-zkvnb"
Sep 10 19:16:22.795603 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:22.795568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zkvnb"
Sep 10 19:16:23.033398 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.033136    2582 generic.go:356] "Generic (PLEG): container finished" podID="485070b7-9f4c-4d85-8253-89e4199f27a5" containerID="92447c6efe41ca2985478ddc7ff196c08ef86260ae75e998437c959f2b301178" exitCode=0
Sep 10 19:16:23.033574 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.033220    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m8jt" event={"ID":"485070b7-9f4c-4d85-8253-89e4199f27a5","Type":"ContainerDied","Data":"92447c6efe41ca2985478ddc7ff196c08ef86260ae75e998437c959f2b301178"}
Sep 10 19:16:23.113384 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.113302    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zkvnb"]
Sep 10 19:16:23.122566 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:23.122543    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55461a6_a784_44eb_a1b6_6c8772f3b7a2.slice/crio-f184620756a957eea6ebc179f30b45f52340058500b77b5787a960dcb94c2745 WatchSource:0}: Error finding container f184620756a957eea6ebc179f30b45f52340058500b77b5787a960dcb94c2745: Status 404 returned error can't find the container with id f184620756a957eea6ebc179f30b45f52340058500b77b5787a960dcb94c2745
Sep 10 19:16:23.185721 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.185697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:23.185857 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:23.185841    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:16:23.185910 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:23.185902    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls podName:b9d67ecc-7752-483c-a716-e603acbc782b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:24.185884124 +0000 UTC m=+36.041439146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls") pod "dns-default-xwwll" (UID: "b9d67ecc-7752-483c-a716-e603acbc782b") : secret "dns-default-metrics-tls" not found
Sep 10 19:16:23.663000 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.662967    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:23.663660 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.662970    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:23.665674 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.665647    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 19:16:23.665789 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.665655    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 19:16:23.666384 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.666364    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8fmlh\""
Sep 10 19:16:23.666489 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:23.666399    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 19:16:24.037342 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:24.037303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zkvnb" event={"ID":"c55461a6-a784-44eb-a1b6-6c8772f3b7a2","Type":"ContainerStarted","Data":"f184620756a957eea6ebc179f30b45f52340058500b77b5787a960dcb94c2745"}
Sep 10 19:16:24.040796 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:24.040765    2582 generic.go:356] "Generic (PLEG): container finished" podID="485070b7-9f4c-4d85-8253-89e4199f27a5" containerID="62c0598305c1b44511cb6b6f04e2d6bec4ecc16a736fe796d2e064080cbe2d10" exitCode=0
Sep 10 19:16:24.040927 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:24.040812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m8jt" event={"ID":"485070b7-9f4c-4d85-8253-89e4199f27a5","Type":"ContainerDied","Data":"62c0598305c1b44511cb6b6f04e2d6bec4ecc16a736fe796d2e064080cbe2d10"}
Sep 10 19:16:24.193061 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:24.193034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:24.193174 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:24.193159    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:16:24.193224 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:24.193203    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls podName:b9d67ecc-7752-483c-a716-e603acbc782b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:26.193191245 +0000 UTC m=+38.048746266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls") pod "dns-default-xwwll" (UID: "b9d67ecc-7752-483c-a716-e603acbc782b") : secret "dns-default-metrics-tls" not found
Sep 10 19:16:25.047917 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:25.047876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m8jt" event={"ID":"485070b7-9f4c-4d85-8253-89e4199f27a5","Type":"ContainerStarted","Data":"ef2d1b109f5f66bef1257a5e548a2caa037709a2045c440294b7a971d53b39c5"}
Sep 10 19:16:25.074567 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:25.074517    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2m8jt" podStartSLOduration=6.327602707 podStartE2EDuration="36.074495816s" totalImagesPullingTime="29.746893109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:25.073152184 +0000 UTC m=+36.928707238" watchObservedRunningTime="2026-09-10 19:16:25.074495816 +0000 UTC m=+36.930050845"
Sep 10 19:16:26.051284 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:26.051236    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zkvnb" event={"ID":"c55461a6-a784-44eb-a1b6-6c8772f3b7a2","Type":"ContainerStarted","Data":"46481e2f00fa26253f06b9c2e633921b7e7683f7e1f41995ecfcc07e6015d920"}
Sep 10 19:16:26.068424 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:26.068369    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zkvnb" podStartSLOduration=1.446124278 podStartE2EDuration="4.068354824s" totalImagesPullingTime="2.622230546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:26.067906795 +0000 UTC m=+37.923461861" watchObservedRunningTime="2026-09-10 19:16:26.068354824 +0000 UTC m=+37.923909853"
Sep 10 19:16:26.208903 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:26.208860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:26.209087 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:26.209052    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:16:26.209307 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:26.209145    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls podName:b9d67ecc-7752-483c-a716-e603acbc782b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:30.209121631 +0000 UTC m=+42.064676638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls") pod "dns-default-xwwll" (UID: "b9d67ecc-7752-483c-a716-e603acbc782b") : secret "dns-default-metrics-tls" not found
Sep 10 19:16:27.624713 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.624680    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mlslf"]
Sep 10 19:16:27.647372 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.647343    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mlslf"]
Sep 10 19:16:27.647550 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.647489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.650262 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.650230    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 19:16:27.650262 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.650245    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mhsqp\""
Sep 10 19:16:27.650476 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.650230    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 19:16:27.650476 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.650250    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 19:16:27.650476 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.650391    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 19:16:27.720598 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.720562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-data-volume\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.720598 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.720598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.720820 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.720617    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-crio-socket\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.720820 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.720639    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.720820 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.720681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2snbv\" (UniqueName: \"kubernetes.io/projected/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-api-access-2snbv\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.821940 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.821900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-data-volume\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.821940 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.821938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.822174 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.821963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-crio-socket\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.822174 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.822001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.822174 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.822029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2snbv\" (UniqueName: \"kubernetes.io/projected/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-api-access-2snbv\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.822174 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:27.822075    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:27.822174 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:27.822131    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:16:27.822358 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:27.822180    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls podName:069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:28.322160082 +0000 UTC m=+40.177715102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlslf" (UID: "069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:27.822358 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:27.822214    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm podName:069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:28.322196748 +0000 UTC m=+40.177751778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mlslf" (UID: "069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b") : configmap "kube-rbac-proxy" not found
Sep 10 19:16:27.822358 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.822257    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-crio-socket\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.822358 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.822269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-data-volume\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:27.832539 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:27.832507    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2snbv\" (UniqueName: \"kubernetes.io/projected/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-api-access-2snbv\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:28.325929 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.325884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:28.326125 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.325937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:28.326125 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:28.326010    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:16:28.326125 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:28.326039    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:28.326125 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:28.326081    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm podName:069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:29.326061044 +0000 UTC m=+41.181616068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mlslf" (UID: "069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b") : configmap "kube-rbac-proxy" not found
Sep 10 19:16:28.326125 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:28.326097    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls podName:069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:29.326089488 +0000 UTC m=+41.181644495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlslf" (UID: "069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:28.517375 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.517344    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv"]
Sep 10 19:16:28.539331 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.539301    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv"]
Sep 10 19:16:28.539529 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.539449    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv"
Sep 10 19:16:28.542237 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.542217    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 10 19:16:28.543085 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.543067    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-c87gv\""
Sep 10 19:16:28.543170 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.543088    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 10 19:16:28.628078 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.627996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt7nq\" (UniqueName: \"kubernetes.io/projected/1027ec38-921f-439c-be4f-eb7882c5e2c4-kube-api-access-vt7nq\") pod \"migrator-fdbb8fdff-tlkxv\" (UID: \"1027ec38-921f-439c-be4f-eb7882c5e2c4\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv"
Sep 10 19:16:28.728955 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.728917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt7nq\" (UniqueName: \"kubernetes.io/projected/1027ec38-921f-439c-be4f-eb7882c5e2c4-kube-api-access-vt7nq\") pod \"migrator-fdbb8fdff-tlkxv\" (UID: \"1027ec38-921f-439c-be4f-eb7882c5e2c4\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv"
Sep 10 19:16:28.738432 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.738391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt7nq\" (UniqueName: \"kubernetes.io/projected/1027ec38-921f-439c-be4f-eb7882c5e2c4-kube-api-access-vt7nq\") pod \"migrator-fdbb8fdff-tlkxv\" (UID: \"1027ec38-921f-439c-be4f-eb7882c5e2c4\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv"
Sep 10 19:16:28.848851 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:28.848811    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv"
Sep 10 19:16:29.136777 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:29.136743    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv"]
Sep 10 19:16:29.140006 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:29.139984    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1027ec38_921f_439c_be4f_eb7882c5e2c4.slice/crio-383b7d99530481c69f2f2a884da0c1a5aba5c176473995ef25366d32c6518cef WatchSource:0}: Error finding container 383b7d99530481c69f2f2a884da0c1a5aba5c176473995ef25366d32c6518cef: Status 404 returned error can't find the container with id 383b7d99530481c69f2f2a884da0c1a5aba5c176473995ef25366d32c6518cef
Sep 10 19:16:29.333725 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:29.333690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:29.333910 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:29.333736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:29.333910 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:29.333807    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:16:29.333910 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:29.333853    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:29.333910 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:29.333860    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm podName:069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:31.333847687 +0000 UTC m=+43.189402694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mlslf" (UID: "069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b") : configmap "kube-rbac-proxy" not found
Sep 10 19:16:29.334057 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:29.333920    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls podName:069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:31.333905326 +0000 UTC m=+43.189460333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlslf" (UID: "069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:29.578431 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:29.578384    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hxp26_04db8de7-0543-4f84-b79b-58de660fd4d3/dns-node-resolver/0.log"
Sep 10 19:16:30.062058 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.062019    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv" event={"ID":"1027ec38-921f-439c-be4f-eb7882c5e2c4","Type":"ContainerStarted","Data":"383b7d99530481c69f2f2a884da0c1a5aba5c176473995ef25366d32c6518cef"}
Sep 10 19:16:30.240094 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.240053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:30.240272 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:30.240206    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:16:30.240315 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:30.240285    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls podName:b9d67ecc-7752-483c-a716-e603acbc782b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:38.240270118 +0000 UTC m=+50.095825125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls") pod "dns-default-xwwll" (UID: "b9d67ecc-7752-483c-a716-e603acbc782b") : secret "dns-default-metrics-tls" not found
Sep 10 19:16:30.301400 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.301366    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-p7qtd"]
Sep 10 19:16:30.320576 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.320507    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-p7qtd"]
Sep 10 19:16:30.320727 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.320610    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.323100 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.323072    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 19:16:30.323100 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.323097    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fkq6t\""
Sep 10 19:16:30.323274 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.323076    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 19:16:30.324018 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.323995    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 19:16:30.324132 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.324000    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 19:16:30.378475 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.378448    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2cpxl_91a99c79-d5ae-4757-b689-764bd57e3eea/node-ca/0.log"
Sep 10 19:16:30.441798 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.441767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czxx5\" (UniqueName: \"kubernetes.io/projected/f39c25bf-5609-4fe8-9301-cd575d2b9eb9-kube-api-access-czxx5\") pod \"service-ca-75d99c484-p7qtd\" (UID: \"f39c25bf-5609-4fe8-9301-cd575d2b9eb9\") " pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.441952 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.441821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f39c25bf-5609-4fe8-9301-cd575d2b9eb9-signing-cabundle\") pod \"service-ca-75d99c484-p7qtd\" (UID: \"f39c25bf-5609-4fe8-9301-cd575d2b9eb9\") " pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.441952 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.441906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f39c25bf-5609-4fe8-9301-cd575d2b9eb9-signing-key\") pod \"service-ca-75d99c484-p7qtd\" (UID: \"f39c25bf-5609-4fe8-9301-cd575d2b9eb9\") " pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.542570 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.542526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f39c25bf-5609-4fe8-9301-cd575d2b9eb9-signing-cabundle\") pod \"service-ca-75d99c484-p7qtd\" (UID: \"f39c25bf-5609-4fe8-9301-cd575d2b9eb9\") " pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.542758 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.542721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f39c25bf-5609-4fe8-9301-cd575d2b9eb9-signing-key\") pod \"service-ca-75d99c484-p7qtd\" (UID: \"f39c25bf-5609-4fe8-9301-cd575d2b9eb9\") " pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.542824 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.542801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czxx5\" (UniqueName: \"kubernetes.io/projected/f39c25bf-5609-4fe8-9301-cd575d2b9eb9-kube-api-access-czxx5\") pod \"service-ca-75d99c484-p7qtd\" (UID: \"f39c25bf-5609-4fe8-9301-cd575d2b9eb9\") " pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.543447 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.543397    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f39c25bf-5609-4fe8-9301-cd575d2b9eb9-signing-cabundle\") pod \"service-ca-75d99c484-p7qtd\" (UID: \"f39c25bf-5609-4fe8-9301-cd575d2b9eb9\") " pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.545390 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.545364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f39c25bf-5609-4fe8-9301-cd575d2b9eb9-signing-key\") pod \"service-ca-75d99c484-p7qtd\" (UID: \"f39c25bf-5609-4fe8-9301-cd575d2b9eb9\") " pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.551543 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.551525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czxx5\" (UniqueName: \"kubernetes.io/projected/f39c25bf-5609-4fe8-9301-cd575d2b9eb9-kube-api-access-czxx5\") pod \"service-ca-75d99c484-p7qtd\" (UID: \"f39c25bf-5609-4fe8-9301-cd575d2b9eb9\") " pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.630109 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.630017    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-p7qtd"
Sep 10 19:16:30.947491 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:30.947382    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-p7qtd"]
Sep 10 19:16:30.950343 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:30.950317    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39c25bf_5609_4fe8_9301_cd575d2b9eb9.slice/crio-71f33d26df328b4d36dee033850754364037753d39ac697a410908f5055d1e00 WatchSource:0}: Error finding container 71f33d26df328b4d36dee033850754364037753d39ac697a410908f5055d1e00: Status 404 returned error can't find the container with id 71f33d26df328b4d36dee033850754364037753d39ac697a410908f5055d1e00
Sep 10 19:16:31.066660 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:31.066626    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-p7qtd" event={"ID":"f39c25bf-5609-4fe8-9301-cd575d2b9eb9","Type":"ContainerStarted","Data":"71f33d26df328b4d36dee033850754364037753d39ac697a410908f5055d1e00"}
Sep 10 19:16:31.348905 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:31.348867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:31.349090 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:31.348917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:31.349090 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:31.349019    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:31.349090 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:31.349036    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:16:31.349090 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:31.349086    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls podName:069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:35.349071397 +0000 UTC m=+47.204626404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlslf" (UID: "069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:31.349314 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:31.349111    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm podName:069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:35.349095722 +0000 UTC m=+47.204650729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mlslf" (UID: "069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b") : configmap "kube-rbac-proxy" not found
Sep 10 19:16:31.578456 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:31.578432    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zkvnb_c55461a6-a784-44eb-a1b6-6c8772f3b7a2/serve-healthcheck-canary/0.log"
Sep 10 19:16:32.072033 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:32.071987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv" event={"ID":"1027ec38-921f-439c-be4f-eb7882c5e2c4","Type":"ContainerStarted","Data":"57bd1b503d817301c0f45fc856fc45965bd935a684890f791e6bb19da13bcbd4"}
Sep 10 19:16:32.072503 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:32.072085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv" event={"ID":"1027ec38-921f-439c-be4f-eb7882c5e2c4","Type":"ContainerStarted","Data":"e41d7c6cd81f4ed8037287528dbed5e86853700c75ea2b32bbcb4448896269a4"}
Sep 10 19:16:32.094519 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:32.094469    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tlkxv" podStartSLOduration=2.2662563909999998 podStartE2EDuration="4.094452449s" totalImagesPullingTime="1.828196058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:32.092823293 +0000 UTC m=+43.948378334" watchObservedRunningTime="2026-09-10 19:16:32.094452449 +0000 UTC m=+43.950007477"
Sep 10 19:16:34.078503 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:34.078471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-p7qtd" event={"ID":"f39c25bf-5609-4fe8-9301-cd575d2b9eb9","Type":"ContainerStarted","Data":"c07732b11f9485aa6aa56131255ee1e2f02baf7e8f12b5f3b870c857d500c7f0"}
Sep 10 19:16:34.094394 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:34.094342    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-p7qtd" podStartSLOduration=1.466746662 podStartE2EDuration="4.094326058s" totalImagesPullingTime="2.627579396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:34.093692658 +0000 UTC m=+45.949247688" watchObservedRunningTime="2026-09-10 19:16:34.094326058 +0000 UTC m=+45.949881086"
Sep 10 19:16:35.378252 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:35.378212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:35.378751 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:35.378272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:35.378751 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:35.378375    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:35.378751 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:35.378469    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls podName:069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:43.378446371 +0000 UTC m=+55.234001380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlslf" (UID: "069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:16:35.378939 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:35.378891    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:38.299969 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:38.299926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:38.300377 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:38.300086    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:16:38.300377 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:16:38.300152    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls podName:b9d67ecc-7752-483c-a716-e603acbc782b nodeName:}" failed. No retries permitted until 2026-09-10 19:16:54.300136707 +0000 UTC m=+66.155691714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls") pod "dns-default-xwwll" (UID: "b9d67ecc-7752-483c-a716-e603acbc782b") : secret "dns-default-metrics-tls" not found
Sep 10 19:16:43.441159 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:43.441119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:43.443407 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:43.443382    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlslf\" (UID: \"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b\") " pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:43.556362 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:43.556326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mlslf"
Sep 10 19:16:43.826613 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:43.826471    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mlslf"]
Sep 10 19:16:43.829154 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:43.829126    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069e53c9_9a5f_4d9f_bb2d_87c14eb09b6b.slice/crio-f16e9f57ba91cb7ada9b51ffc965f8eba9c2e32e6e038437f4fef55abb69291b WatchSource:0}: Error finding container f16e9f57ba91cb7ada9b51ffc965f8eba9c2e32e6e038437f4fef55abb69291b: Status 404 returned error can't find the container with id f16e9f57ba91cb7ada9b51ffc965f8eba9c2e32e6e038437f4fef55abb69291b
Sep 10 19:16:44.104295 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:44.104212    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlslf" event={"ID":"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b","Type":"ContainerStarted","Data":"c92e0d6cab3bc755a69a25ec6f453f975a0012fc6cd5e1b3a59fb07937305cf1"}
Sep 10 19:16:44.104295 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:44.104264    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlslf" event={"ID":"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b","Type":"ContainerStarted","Data":"f16e9f57ba91cb7ada9b51ffc965f8eba9c2e32e6e038437f4fef55abb69291b"}
Sep 10 19:16:45.108906 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:45.108876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlslf" event={"ID":"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b","Type":"ContainerStarted","Data":"4a462fe438b3f23925a855760450f638793db19c3eb513c4c8b3061bc1223338"}
Sep 10 19:16:47.117598 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:47.117552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlslf" event={"ID":"069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b","Type":"ContainerStarted","Data":"9e2ec9383e2c1e3e2ae0808a17d4a139b14f17d6c10cd33109ff0dfed20f250a"}
Sep 10 19:16:47.144394 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:47.144342    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mlslf" podStartSLOduration=17.348702082 podStartE2EDuration="20.144325517s" totalImagesPullingTime="2.795623435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:16:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:47.144155505 +0000 UTC m=+58.999710563" watchObservedRunningTime="2026-09-10 19:16:47.144325517 +0000 UTC m=+58.999880547"
Sep 10 19:16:49.031889 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:49.031861    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmhz5"
Sep 10 19:16:53.027662 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.027629    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"]
Sep 10 19:16:53.049720 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.049696    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"]
Sep 10 19:16:53.049871 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.049818    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.052122 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.052101    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 19:16:53.052248 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.052105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 19:16:53.052881 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.052859    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 19:16:53.052973 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.052859    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 19:16:53.063461 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.063443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"]
Sep 10 19:16:53.063557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.063473    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"]
Sep 10 19:16:53.063557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.063552    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.065812 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.065786    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 19:16:53.065916 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.065814    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 19:16:53.065916 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.065825    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 19:16:53.065916 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.065858    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 19:16:53.120293 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.120270    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e8c99a2c-cb78-4703-8d2a-b79c5dcc1552-klusterlet-config\") pod \"klusterlet-addon-workmgr-54649bd75b-9s6nr\" (UID: \"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.120433 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.120305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg9gp\" (UniqueName: \"kubernetes.io/projected/e8c99a2c-cb78-4703-8d2a-b79c5dcc1552-kube-api-access-sg9gp\") pod \"klusterlet-addon-workmgr-54649bd75b-9s6nr\" (UID: \"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.120433 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.120325    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.120433 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.120347    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvqns\" (UniqueName: \"kubernetes.io/projected/65f99523-7bb6-490a-9816-27f320664996-kube-api-access-xvqns\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.120433 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.120425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.120590 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.120464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65f99523-7bb6-490a-9816-27f320664996-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.120590 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.120489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-hub\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.120590 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.120507    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8c99a2c-cb78-4703-8d2a-b79c5dcc1552-tmp\") pod \"klusterlet-addon-workmgr-54649bd75b-9s6nr\" (UID: \"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.120590 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.120530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-ca\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.221809 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.221781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg9gp\" (UniqueName: \"kubernetes.io/projected/e8c99a2c-cb78-4703-8d2a-b79c5dcc1552-kube-api-access-sg9gp\") pod \"klusterlet-addon-workmgr-54649bd75b-9s6nr\" (UID: \"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.221809 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.221813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.222017 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.221834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvqns\" (UniqueName: \"kubernetes.io/projected/65f99523-7bb6-490a-9816-27f320664996-kube-api-access-xvqns\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.222017 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.221856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.222017 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.221884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65f99523-7bb6-490a-9816-27f320664996-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.222017 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.221909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-hub\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.222017 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.221934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8c99a2c-cb78-4703-8d2a-b79c5dcc1552-tmp\") pod \"klusterlet-addon-workmgr-54649bd75b-9s6nr\" (UID: \"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.222017 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.221954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-ca\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.222301 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.222036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e8c99a2c-cb78-4703-8d2a-b79c5dcc1552-klusterlet-config\") pod \"klusterlet-addon-workmgr-54649bd75b-9s6nr\" (UID: \"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.222630 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.222555    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8c99a2c-cb78-4703-8d2a-b79c5dcc1552-tmp\") pod \"klusterlet-addon-workmgr-54649bd75b-9s6nr\" (UID: \"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.222757 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.222731    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65f99523-7bb6-490a-9816-27f320664996-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.224698 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.224668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.224793 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.224755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.224954 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.224935    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-ca\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.225019 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.224938    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e8c99a2c-cb78-4703-8d2a-b79c5dcc1552-klusterlet-config\") pod \"klusterlet-addon-workmgr-54649bd75b-9s6nr\" (UID: \"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.225081 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.225064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65f99523-7bb6-490a-9816-27f320664996-hub\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.234553 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.234532    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvqns\" (UniqueName: \"kubernetes.io/projected/65f99523-7bb6-490a-9816-27f320664996-kube-api-access-xvqns\") pod \"cluster-proxy-proxy-agent-5d4d9cc65c-45nxx\" (UID: \"65f99523-7bb6-490a-9816-27f320664996\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.234699 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.234682    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg9gp\" (UniqueName: \"kubernetes.io/projected/e8c99a2c-cb78-4703-8d2a-b79c5dcc1552-kube-api-access-sg9gp\") pod \"klusterlet-addon-workmgr-54649bd75b-9s6nr\" (UID: \"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.322829 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.322746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:53.325224 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.325201    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 19:16:53.335635 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.335610    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3211ac29-bc2c-4f3d-8d0d-d12b16845380-metrics-certs\") pod \"network-metrics-daemon-p8fkk\" (UID: \"3211ac29-bc2c-4f3d-8d0d-d12b16845380\") " pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:53.358740 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.358713    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:16:53.379057 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.379032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"
Sep 10 19:16:53.423346 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.423316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:53.425646 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.425621    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 19:16:53.436780 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.436751    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44581864-3e22-4509-ad4f-03e3ec946cd5-original-pull-secret\") pod \"global-pull-secret-syncer-4rh8j\" (UID: \"44581864-3e22-4509-ad4f-03e3ec946cd5\") " pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:53.524089 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.524056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:53.526827 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.526810    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 19:16:53.536737 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.536719    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 19:16:53.546975 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.546951    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9fq8\" (UniqueName: \"kubernetes.io/projected/5f6cc199-d996-427d-bc8f-39adb7d6a4d6-kube-api-access-c9fq8\") pod \"network-check-target-drkm5\" (UID: \"5f6cc199-d996-427d-bc8f-39adb7d6a4d6\") " pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:53.576627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.576583    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gqr5m\""
Sep 10 19:16:53.584698 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.584674    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fkk"
Sep 10 19:16:53.653922 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.653892    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"]
Sep 10 19:16:53.657475 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:53.657440    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c99a2c_cb78_4703_8d2a_b79c5dcc1552.slice/crio-a4b0dda2437a423e830b6e5780c2a3f1145afa93a3065b5a011d5ef3a13005c6 WatchSource:0}: Error finding container a4b0dda2437a423e830b6e5780c2a3f1145afa93a3065b5a011d5ef3a13005c6: Status 404 returned error can't find the container with id a4b0dda2437a423e830b6e5780c2a3f1145afa93a3065b5a011d5ef3a13005c6
Sep 10 19:16:53.674407 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.674384    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8fmlh\""
Sep 10 19:16:53.676583 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.676549    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rh8j"
Sep 10 19:16:53.678229 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.678212    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx"]
Sep 10 19:16:53.680722 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:53.680700    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65f99523_7bb6_490a_9816_27f320664996.slice/crio-23c54e888c3e5e140c70f0c13964191410bab8576a6cf5e000ad4b2b37b9d69d WatchSource:0}: Error finding container 23c54e888c3e5e140c70f0c13964191410bab8576a6cf5e000ad4b2b37b9d69d: Status 404 returned error can't find the container with id 23c54e888c3e5e140c70f0c13964191410bab8576a6cf5e000ad4b2b37b9d69d
Sep 10 19:16:53.682380 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.682365    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:16:53.885894 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.885822    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8fkk"]
Sep 10 19:16:53.896998 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:53.889635    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3211ac29_bc2c_4f3d_8d0d_d12b16845380.slice/crio-357d4cf682a302ff7c7fcca97000a4ccee148a2c93cce53402c91d9f7754b3f5 WatchSource:0}: Error finding container 357d4cf682a302ff7c7fcca97000a4ccee148a2c93cce53402c91d9f7754b3f5: Status 404 returned error can't find the container with id 357d4cf682a302ff7c7fcca97000a4ccee148a2c93cce53402c91d9f7754b3f5
Sep 10 19:16:53.975894 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.975865    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rh8j"]
Sep 10 19:16:53.978740 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:53.978714    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44581864_3e22_4509_ad4f_03e3ec946cd5.slice/crio-ab43bc1e530e33d42269505d1107c08985401585b3fc798bbdb06930ca5dd222 WatchSource:0}: Error finding container ab43bc1e530e33d42269505d1107c08985401585b3fc798bbdb06930ca5dd222: Status 404 returned error can't find the container with id ab43bc1e530e33d42269505d1107c08985401585b3fc798bbdb06930ca5dd222
Sep 10 19:16:53.997498 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:53.997340    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-drkm5"]
Sep 10 19:16:54.000765 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:54.000739    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6cc199_d996_427d_bc8f_39adb7d6a4d6.slice/crio-ed85dfdb83380fd809d6b62b53121667c4f0ae8066c2a2be09092e9782df02b3 WatchSource:0}: Error finding container ed85dfdb83380fd809d6b62b53121667c4f0ae8066c2a2be09092e9782df02b3: Status 404 returned error can't find the container with id ed85dfdb83380fd809d6b62b53121667c4f0ae8066c2a2be09092e9782df02b3
Sep 10 19:16:54.146787 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.146693    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rh8j" event={"ID":"44581864-3e22-4509-ad4f-03e3ec946cd5","Type":"ContainerStarted","Data":"ab43bc1e530e33d42269505d1107c08985401585b3fc798bbdb06930ca5dd222"}
Sep 10 19:16:54.148059 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.148033    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx" event={"ID":"65f99523-7bb6-490a-9816-27f320664996","Type":"ContainerStarted","Data":"23c54e888c3e5e140c70f0c13964191410bab8576a6cf5e000ad4b2b37b9d69d"}
Sep 10 19:16:54.149172 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.149151    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8fkk" event={"ID":"3211ac29-bc2c-4f3d-8d0d-d12b16845380","Type":"ContainerStarted","Data":"357d4cf682a302ff7c7fcca97000a4ccee148a2c93cce53402c91d9f7754b3f5"}
Sep 10 19:16:54.150176 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.150155    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr" event={"ID":"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552","Type":"ContainerStarted","Data":"a4b0dda2437a423e830b6e5780c2a3f1145afa93a3065b5a011d5ef3a13005c6"}
Sep 10 19:16:54.151131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.151114    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-drkm5" event={"ID":"5f6cc199-d996-427d-bc8f-39adb7d6a4d6","Type":"ContainerStarted","Data":"ed85dfdb83380fd809d6b62b53121667c4f0ae8066c2a2be09092e9782df02b3"}
Sep 10 19:16:54.332679 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.331393    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:54.335298 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.335272    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d67ecc-7752-483c-a716-e603acbc782b-metrics-tls\") pod \"dns-default-xwwll\" (UID: \"b9d67ecc-7752-483c-a716-e603acbc782b\") " pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:54.590799 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.590765    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wkm4c\""
Sep 10 19:16:54.599003 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.598973    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xwwll"
Sep 10 19:16:54.909644 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:54.909513    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xwwll"]
Sep 10 19:16:55.241362 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:16:55.240844    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d67ecc_7752_483c_a716_e603acbc782b.slice/crio-23ff32a750f58b9c8cbe36af14767121094f3a15f89cefaf994f8903a1571718 WatchSource:0}: Error finding container 23ff32a750f58b9c8cbe36af14767121094f3a15f89cefaf994f8903a1571718: Status 404 returned error can't find the container with id 23ff32a750f58b9c8cbe36af14767121094f3a15f89cefaf994f8903a1571718
Sep 10 19:16:56.167261 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:56.167206    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8fkk" event={"ID":"3211ac29-bc2c-4f3d-8d0d-d12b16845380","Type":"ContainerStarted","Data":"04a65428daa60e49c03c7418fca16915d9e64eea13eaf35ade747abe552ee9f2"}
Sep 10 19:16:56.167491 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:56.167283    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8fkk" event={"ID":"3211ac29-bc2c-4f3d-8d0d-d12b16845380","Type":"ContainerStarted","Data":"5364abbcf92b9c312c10aad45226262ffab610b1df968a914debb07a9d29f7b6"}
Sep 10 19:16:56.172656 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:16:56.172625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xwwll" event={"ID":"b9d67ecc-7752-483c-a716-e603acbc782b","Type":"ContainerStarted","Data":"23ff32a750f58b9c8cbe36af14767121094f3a15f89cefaf994f8903a1571718"}
Sep 10 19:17:02.686731 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.686346    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p8fkk" podStartSLOduration=72.292902814 podStartE2EDuration="1m13.686322047s" totalImagesPullingTime="1.393419233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:16:56.186277903 +0000 UTC m=+68.041832950" watchObservedRunningTime="2026-09-10 19:17:02.686322047 +0000 UTC m=+74.541877077"
Sep 10 19:17:02.687226 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.686737    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fzrrx"]
Sep 10 19:17:02.690355 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.690313    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.692642 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.692616    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 19:17:02.692934 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.692865    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 19:17:02.692934 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.692902    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 19:17:02.693612 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.693472    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zg7ls\""
Sep 10 19:17:02.693612 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.693486    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 19:17:02.693612 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.693536    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 19:17:02.693862 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.693845    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 19:17:02.798085 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.798027    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-textfile\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.798270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.798147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0daeaa12-8c68-455d-b723-8e2914964cdc-sys\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.798270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.798195    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-tls\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.798270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.798228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-wtmp\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.798270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.798257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.798499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.798307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0daeaa12-8c68-455d-b723-8e2914964cdc-metrics-client-ca\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.798499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.798361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.798499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.798391    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8nxg\" (UniqueName: \"kubernetes.io/projected/0daeaa12-8c68-455d-b723-8e2914964cdc-kube-api-access-d8nxg\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.798499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.798437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0daeaa12-8c68-455d-b723-8e2914964cdc-root\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899019 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.898972    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0daeaa12-8c68-455d-b723-8e2914964cdc-root\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-textfile\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899061    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0daeaa12-8c68-455d-b723-8e2914964cdc-root\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899075    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0daeaa12-8c68-455d-b723-8e2914964cdc-sys\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-tls\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0daeaa12-8c68-455d-b723-8e2914964cdc-sys\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-wtmp\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0daeaa12-8c68-455d-b723-8e2914964cdc-metrics-client-ca\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899629 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899629 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899244    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-wtmp\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899629 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8nxg\" (UniqueName: \"kubernetes.io/projected/0daeaa12-8c68-455d-b723-8e2914964cdc-kube-api-access-d8nxg\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.899629 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.899455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-textfile\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.900078 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.900050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0daeaa12-8c68-455d-b723-8e2914964cdc-metrics-client-ca\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.900214 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.900188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.902314 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.902292    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.902314 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.902306    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0daeaa12-8c68-455d-b723-8e2914964cdc-node-exporter-tls\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:02.908590 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:02.908547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8nxg\" (UniqueName: \"kubernetes.io/projected/0daeaa12-8c68-455d-b723-8e2914964cdc-kube-api-access-d8nxg\") pod \"node-exporter-fzrrx\" (UID: \"0daeaa12-8c68-455d-b723-8e2914964cdc\") " pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:03.002205 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:03.002116    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzrrx"
Sep 10 19:17:04.204108 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.204005    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rh8j" event={"ID":"44581864-3e22-4509-ad4f-03e3ec946cd5","Type":"ContainerStarted","Data":"ecdb94efa8010ed9586658aea349df4e8c7a30af8f9ec6155eccd7f79015ae49"}
Sep 10 19:17:04.206190 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.206160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx" event={"ID":"65f99523-7bb6-490a-9816-27f320664996","Type":"ContainerStarted","Data":"9841b366f5116e7be9bff78a6888a6ceb9b9e78aeb35780a005c96db9aa98c8e"}
Sep 10 19:17:04.206316 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.206204    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx" event={"ID":"65f99523-7bb6-490a-9816-27f320664996","Type":"ContainerStarted","Data":"150d6d5eda59d5b9177435d5886acff8a42b1c50050acef877b16e4030ae9c8f"}
Sep 10 19:17:04.206316 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.206224    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx" event={"ID":"65f99523-7bb6-490a-9816-27f320664996","Type":"ContainerStarted","Data":"42764b1e6ffea9b554378bd0b1b54a40a829c757c5a482d6399dcc1262351237"}
Sep 10 19:17:04.207704 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.207680    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr" event={"ID":"e8c99a2c-cb78-4703-8d2a-b79c5dcc1552","Type":"ContainerStarted","Data":"7ed816893abf61c9bc988c6e0ee37b56ff59cd503cd205ef530d8b424a874d36"}
Sep 10 19:17:04.207857 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.207827    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:17:04.209825 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.209738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xwwll" event={"ID":"b9d67ecc-7752-483c-a716-e603acbc782b","Type":"ContainerStarted","Data":"c1130768a7e4a73ae98342447e5b694913d01f175b997d1c006cb4a2c703b653"}
Sep 10 19:17:04.209825 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.209790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xwwll" event={"ID":"b9d67ecc-7752-483c-a716-e603acbc782b","Type":"ContainerStarted","Data":"9091f325f8b076d4d240392d62642dcc52112afd6c4fcfe50e6f20888ec4a491"}
Sep 10 19:17:04.209953 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.209888    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr"
Sep 10 19:17:04.209953 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.209922    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xwwll"
Sep 10 19:17:04.211165 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.211140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-drkm5" event={"ID":"5f6cc199-d996-427d-bc8f-39adb7d6a4d6","Type":"ContainerStarted","Data":"6e147cc30edef95cc0c2d49d71ce335786548e99764d8fc12f6fe8afe12f53a8"}
Sep 10 19:17:04.211274 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.211202    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:17:04.212247 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.212226    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzrrx" event={"ID":"0daeaa12-8c68-455d-b723-8e2914964cdc","Type":"ContainerStarted","Data":"2e8302042dafabcd7cc9b7285614105e96b02dbb00abc2c72a8204d2cca23c39"}
Sep 10 19:17:04.222665 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.222628    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4rh8j" podStartSLOduration=65.455177555 podStartE2EDuration="1m15.222615609s" totalImagesPullingTime="9.767438054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:17:04.221751066 +0000 UTC m=+76.077306096" watchObservedRunningTime="2026-09-10 19:17:04.222615609 +0000 UTC m=+76.078170681"
Sep 10 19:17:04.237006 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.236969    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-drkm5" podStartSLOduration=65.490913544 podStartE2EDuration="1m15.236956081s" totalImagesPullingTime="9.746042537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:17:04.236723726 +0000 UTC m=+76.092278779" watchObservedRunningTime="2026-09-10 19:17:04.236956081 +0000 UTC m=+76.092511110"
Sep 10 19:17:04.254690 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.254649    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54649bd75b-9s6nr" podStartSLOduration=1.166566159 podStartE2EDuration="11.254634049s" totalImagesPullingTime="10.08806789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:17:04.253607394 +0000 UTC m=+76.109162445" watchObservedRunningTime="2026-09-10 19:17:04.254634049 +0000 UTC m=+76.110189078"
Sep 10 19:17:04.274490 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.274448    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xwwll" podStartSLOduration=33.774385579 podStartE2EDuration="42.27443352s" totalImagesPullingTime="8.500047941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:17:04.273527429 +0000 UTC m=+76.129082470" watchObservedRunningTime="2026-09-10 19:17:04.27443352 +0000 UTC m=+76.129988541"
Sep 10 19:17:04.293700 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:04.293647    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4d9cc65c-45nxx" podStartSLOduration=1.220845304 podStartE2EDuration="11.293632454s" totalImagesPullingTime="10.07278715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:17:04.292600228 +0000 UTC m=+76.148155256" watchObservedRunningTime="2026-09-10 19:17:04.293632454 +0000 UTC m=+76.149187484"
Sep 10 19:17:05.217640 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:05.217556    2582 generic.go:356] "Generic (PLEG): container finished" podID="0daeaa12-8c68-455d-b723-8e2914964cdc" containerID="62761213ff23a18f90a8eab0f0439af650e9a879d4a8f815e68c180d856fce7b" exitCode=0
Sep 10 19:17:05.218064 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:05.217659    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzrrx" event={"ID":"0daeaa12-8c68-455d-b723-8e2914964cdc","Type":"ContainerDied","Data":"62761213ff23a18f90a8eab0f0439af650e9a879d4a8f815e68c180d856fce7b"}
Sep 10 19:17:06.223064 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:06.223021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzrrx" event={"ID":"0daeaa12-8c68-455d-b723-8e2914964cdc","Type":"ContainerStarted","Data":"e512ab5f1ba65a19d141311b3259f81c7ac0ac86af3d4a909ae43cd2464d404a"}
Sep 10 19:17:06.223471 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:06.223083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzrrx" event={"ID":"0daeaa12-8c68-455d-b723-8e2914964cdc","Type":"ContainerStarted","Data":"1540cd201a86e078b8d3d7eb5903aedeb645fcb20c008de03a5ab1a5a6791738"}
Sep 10 19:17:14.221102 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:14.220995    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xwwll"
Sep 10 19:17:14.242483 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:14.242428    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fzrrx" podStartSLOduration=11.108981748 podStartE2EDuration="12.242394034s" totalImagesPullingTime="1.070990733s" totalInitContainerRuntime="62.421553ms" isStatefulPod=true podCreationTimestamp="2026-09-10 19:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:17:06.258405557 +0000 UTC m=+78.113960607" watchObservedRunningTime="2026-09-10 19:17:14.242394034 +0000 UTC m=+86.097949063"
Sep 10 19:17:35.219791 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:17:35.219756    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-drkm5"
Sep 10 19:20:48.531507 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:20:48.526930    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 19:21:09.346393 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.346358    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"]
Sep 10 19:21:09.348195 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.348181    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.350551 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.350530    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 19:21:09.350681 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.350530    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 19:21:09.351212 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.351195    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5snlz\""
Sep 10 19:21:09.358111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.358088    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"]
Sep 10 19:21:09.478582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.478539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.478766 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.478601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlwqp\" (UniqueName: \"kubernetes.io/projected/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-kube-api-access-zlwqp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.478766 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.478649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.578999 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.578952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.579197 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.579028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlwqp\" (UniqueName: \"kubernetes.io/projected/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-kube-api-access-zlwqp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.579197 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.579077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.579359 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.579336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.579461 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.579391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.588493 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.588465    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlwqp\" (UniqueName: \"kubernetes.io/projected/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-kube-api-access-zlwqp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.657534 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.657449    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:09.926591 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.926372    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"]
Sep 10 19:21:09.928997 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:21:09.928973    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576c4714_e02d_4368_b08f_3dd1d7c5dbb2.slice/crio-4d50ba9e07d4b89b643961ad69c87837b823b347f842e3ce7f6fb5cf90771b7a WatchSource:0}: Error finding container 4d50ba9e07d4b89b643961ad69c87837b823b347f842e3ce7f6fb5cf90771b7a: Status 404 returned error can't find the container with id 4d50ba9e07d4b89b643961ad69c87837b823b347f842e3ce7f6fb5cf90771b7a
Sep 10 19:21:09.931013 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:09.930993    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:21:10.015707 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:10.015674    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb" event={"ID":"576c4714-e02d-4368-b08f-3dd1d7c5dbb2","Type":"ContainerStarted","Data":"4d50ba9e07d4b89b643961ad69c87837b823b347f842e3ce7f6fb5cf90771b7a"}
Sep 10 19:21:12.742951 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.742914    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"]
Sep 10 19:21:12.744884 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.744869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"
Sep 10 19:21:12.747587 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.747551    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fwv74\""
Sep 10 19:21:12.747587 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.747576    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 19:21:12.748143 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.748124    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 19:21:12.756346 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.756299    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"]
Sep 10 19:21:12.806241 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.806209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn7hf\" (UniqueName: \"kubernetes.io/projected/618f98e4-a608-45f6-8aa2-83ccb71dea83-kube-api-access-cn7hf\") pod \"cert-manager-cainjector-559cdd8c87-n5vnr\" (UID: \"618f98e4-a608-45f6-8aa2-83ccb71dea83\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"
Sep 10 19:21:12.806439 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.806250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/618f98e4-a608-45f6-8aa2-83ccb71dea83-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n5vnr\" (UID: \"618f98e4-a608-45f6-8aa2-83ccb71dea83\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"
Sep 10 19:21:12.907474 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.907443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn7hf\" (UniqueName: \"kubernetes.io/projected/618f98e4-a608-45f6-8aa2-83ccb71dea83-kube-api-access-cn7hf\") pod \"cert-manager-cainjector-559cdd8c87-n5vnr\" (UID: \"618f98e4-a608-45f6-8aa2-83ccb71dea83\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"
Sep 10 19:21:12.907651 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.907480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/618f98e4-a608-45f6-8aa2-83ccb71dea83-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n5vnr\" (UID: \"618f98e4-a608-45f6-8aa2-83ccb71dea83\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"
Sep 10 19:21:12.917258 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.917232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/618f98e4-a608-45f6-8aa2-83ccb71dea83-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n5vnr\" (UID: \"618f98e4-a608-45f6-8aa2-83ccb71dea83\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"
Sep 10 19:21:12.917498 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:12.917475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn7hf\" (UniqueName: \"kubernetes.io/projected/618f98e4-a608-45f6-8aa2-83ccb71dea83-kube-api-access-cn7hf\") pod \"cert-manager-cainjector-559cdd8c87-n5vnr\" (UID: \"618f98e4-a608-45f6-8aa2-83ccb71dea83\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"
Sep 10 19:21:13.055426 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:13.055379    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"
Sep 10 19:21:13.326807 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:13.326723    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr"]
Sep 10 19:21:13.330164 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:21:13.330128    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod618f98e4_a608_45f6_8aa2_83ccb71dea83.slice/crio-868abe2174337626d641be297b3e41955b88a5175cb974d564ca83a1cb663cb4 WatchSource:0}: Error finding container 868abe2174337626d641be297b3e41955b88a5175cb974d564ca83a1cb663cb4: Status 404 returned error can't find the container with id 868abe2174337626d641be297b3e41955b88a5175cb974d564ca83a1cb663cb4
Sep 10 19:21:14.031977 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:14.031909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr" event={"ID":"618f98e4-a608-45f6-8aa2-83ccb71dea83","Type":"ContainerStarted","Data":"868abe2174337626d641be297b3e41955b88a5175cb974d564ca83a1cb663cb4"}
Sep 10 19:21:19.053733 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:19.053698    2582 generic.go:356] "Generic (PLEG): container finished" podID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerID="7f62052bd3b5690fe8e78b73f6350140204365d81cb8e10b407cecb0dbdfdcda" exitCode=0
Sep 10 19:21:19.054150 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:19.053778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb" event={"ID":"576c4714-e02d-4368-b08f-3dd1d7c5dbb2","Type":"ContainerDied","Data":"7f62052bd3b5690fe8e78b73f6350140204365d81cb8e10b407cecb0dbdfdcda"}
Sep 10 19:21:19.055299 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:19.055274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr" event={"ID":"618f98e4-a608-45f6-8aa2-83ccb71dea83","Type":"ContainerStarted","Data":"2d08a0983fb3baa2c7c80c694cca8c9157ef854196253f5a9da166a5012ffa1a"}
Sep 10 19:21:21.065233 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:21.065196    2582 generic.go:356] "Generic (PLEG): container finished" podID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerID="3410044d06c28d216c9e08f35b9b46bdc8509c3c990bd28261733289270e3b5f" exitCode=0
Sep 10 19:21:21.065626 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:21.065239    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb" event={"ID":"576c4714-e02d-4368-b08f-3dd1d7c5dbb2","Type":"ContainerDied","Data":"3410044d06c28d216c9e08f35b9b46bdc8509c3c990bd28261733289270e3b5f"}
Sep 10 19:21:21.086353 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:21.086297    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n5vnr" podStartSLOduration=4.274728605 podStartE2EDuration="9.0862823s" totalImagesPullingTime="4.811553695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:19.110179185 +0000 UTC m=+330.965734215" watchObservedRunningTime="2026-09-10 19:21:21.0862823 +0000 UTC m=+332.941837328"
Sep 10 19:21:28.094722 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:28.094684    2582 generic.go:356] "Generic (PLEG): container finished" podID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerID="1e50ef189b066eeb9fc962caa5aedbebe6663b2698aee733f0f49739e2908218" exitCode=0
Sep 10 19:21:28.095104 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:28.094767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb" event={"ID":"576c4714-e02d-4368-b08f-3dd1d7c5dbb2","Type":"ContainerDied","Data":"1e50ef189b066eeb9fc962caa5aedbebe6663b2698aee733f0f49739e2908218"}
Sep 10 19:21:29.212115 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.212092    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:29.338993 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.338958    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlwqp\" (UniqueName: \"kubernetes.io/projected/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-kube-api-access-zlwqp\") pod \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") "
Sep 10 19:21:29.339144 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.339012    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-util\") pod \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") "
Sep 10 19:21:29.339144 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.339038    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-bundle\") pod \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\" (UID: \"576c4714-e02d-4368-b08f-3dd1d7c5dbb2\") "
Sep 10 19:21:29.339435 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.339382    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-bundle" (OuterVolumeSpecName: "bundle") pod "576c4714-e02d-4368-b08f-3dd1d7c5dbb2" (UID: "576c4714-e02d-4368-b08f-3dd1d7c5dbb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:21:29.341111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.341074    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-kube-api-access-zlwqp" (OuterVolumeSpecName: "kube-api-access-zlwqp") pod "576c4714-e02d-4368-b08f-3dd1d7c5dbb2" (UID: "576c4714-e02d-4368-b08f-3dd1d7c5dbb2"). InnerVolumeSpecName "kube-api-access-zlwqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:21:29.343609 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.343584    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-util" (OuterVolumeSpecName: "util") pod "576c4714-e02d-4368-b08f-3dd1d7c5dbb2" (UID: "576c4714-e02d-4368-b08f-3dd1d7c5dbb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:21:29.440127 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.440013    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-util\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:21:29.440127 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.440077    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-bundle\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:21:29.440127 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:29.440087    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlwqp\" (UniqueName: \"kubernetes.io/projected/576c4714-e02d-4368-b08f-3dd1d7c5dbb2-kube-api-access-zlwqp\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:21:30.102958 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:30.102928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb" event={"ID":"576c4714-e02d-4368-b08f-3dd1d7c5dbb2","Type":"ContainerDied","Data":"4d50ba9e07d4b89b643961ad69c87837b823b347f842e3ce7f6fb5cf90771b7a"}
Sep 10 19:21:30.103146 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:30.102980    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d50ba9e07d4b89b643961ad69c87837b823b347f842e3ce7f6fb5cf90771b7a"
Sep 10 19:21:30.103146 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:30.102941    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnblvb"
Sep 10 19:21:54.029901 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.029824    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"]
Sep 10 19:21:54.030333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.030092    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerName="util"
Sep 10 19:21:54.030333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.030105    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerName="util"
Sep 10 19:21:54.030333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.030114    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerName="pull"
Sep 10 19:21:54.030333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.030119    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerName="pull"
Sep 10 19:21:54.030333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.030134    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerName="extract"
Sep 10 19:21:54.030333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.030139    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerName="extract"
Sep 10 19:21:54.030333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.030183    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="576c4714-e02d-4368-b08f-3dd1d7c5dbb2" containerName="extract"
Sep 10 19:21:54.032555 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.032536    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.034962 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.034941    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 19:21:54.035260 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.035245    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4z6tt\""
Sep 10 19:21:54.035521 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.035495    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 19:21:54.035521 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.035515    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 19:21:54.035743 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.035730    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 19:21:54.053200 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.053180    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"]
Sep 10 19:21:54.216875 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.216844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc12735e-663e-44ad-8868-cc28476055ea-manifests\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.216875 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.216878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc12735e-663e-44ad-8868-cc28476055ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.217083 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.216901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc12735e-663e-44ad-8868-cc28476055ea-tmp\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.217083 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.216976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc12735e-663e-44ad-8868-cc28476055ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.217083 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.217023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cms8\" (UniqueName: \"kubernetes.io/projected/cc12735e-663e-44ad-8868-cc28476055ea-kube-api-access-7cms8\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.318251 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.318173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc12735e-663e-44ad-8868-cc28476055ea-manifests\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.318251 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.318208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc12735e-663e-44ad-8868-cc28476055ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.318251 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.318239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc12735e-663e-44ad-8868-cc28476055ea-tmp\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.318538 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.318274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc12735e-663e-44ad-8868-cc28476055ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.318538 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.318312    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cms8\" (UniqueName: \"kubernetes.io/projected/cc12735e-663e-44ad-8868-cc28476055ea-kube-api-access-7cms8\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.318662 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.318638    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc12735e-663e-44ad-8868-cc28476055ea-manifests\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.320663 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.320642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc12735e-663e-44ad-8868-cc28476055ea-tmp\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.320823 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.320802    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc12735e-663e-44ad-8868-cc28476055ea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.320909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.320894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc12735e-663e-44ad-8868-cc28476055ea-webhook-cert\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.333470 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.333450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cms8\" (UniqueName: \"kubernetes.io/projected/cc12735e-663e-44ad-8868-cc28476055ea-kube-api-access-7cms8\") pod \"opendatahub-operator-controller-manager-55556678b8-fqzcx\" (UID: \"cc12735e-663e-44ad-8868-cc28476055ea\") " pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.342303 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.342284    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:21:54.623718 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:54.623694    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"]
Sep 10 19:21:54.626343 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:21:54.626317    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc12735e_663e_44ad_8868_cc28476055ea.slice/crio-0c79d6a8487d7cf6d1d507027dec654ff0e4be36fb0a09bdcf7a0b0a1d22cdc4 WatchSource:0}: Error finding container 0c79d6a8487d7cf6d1d507027dec654ff0e4be36fb0a09bdcf7a0b0a1d22cdc4: Status 404 returned error can't find the container with id 0c79d6a8487d7cf6d1d507027dec654ff0e4be36fb0a09bdcf7a0b0a1d22cdc4
Sep 10 19:21:55.187790 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:55.187761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx" event={"ID":"cc12735e-663e-44ad-8868-cc28476055ea","Type":"ContainerStarted","Data":"0c79d6a8487d7cf6d1d507027dec654ff0e4be36fb0a09bdcf7a0b0a1d22cdc4"}
Sep 10 19:21:58.201962 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:58.201888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx" event={"ID":"cc12735e-663e-44ad-8868-cc28476055ea","Type":"ContainerStarted","Data":"8bc3b39f761881d44ea19418cbc52421202231f70ed61f538cb4d0e9de6b8d74"}
Sep 10 19:21:59.206556 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:59.206526    2582 generic.go:356] "Generic (PLEG): container finished" podID="cc12735e-663e-44ad-8868-cc28476055ea" containerID="8bc3b39f761881d44ea19418cbc52421202231f70ed61f538cb4d0e9de6b8d74" exitCode=0
Sep 10 19:21:59.206964 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:21:59.206568    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx" event={"ID":"cc12735e-663e-44ad-8868-cc28476055ea","Type":"ContainerDied","Data":"8bc3b39f761881d44ea19418cbc52421202231f70ed61f538cb4d0e9de6b8d74"}
Sep 10 19:22:00.212045 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:00.212010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx" event={"ID":"cc12735e-663e-44ad-8868-cc28476055ea","Type":"ContainerStarted","Data":"f46e6b5a393f313a9b78d75caf009abbad6074fe778248da889f0b96bd5a4a3a"}
Sep 10 19:22:00.212535 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:00.212166    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:22:00.240695 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:00.240640    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx" podStartSLOduration=1.4355198869999999 podStartE2EDuration="6.240623818s" totalImagesPullingTime="3.802192544s" totalInitContainerRuntime="1.002911387s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:22:00.238834057 +0000 UTC m=+372.094389110" watchObservedRunningTime="2026-09-10 19:22:00.240623818 +0000 UTC m=+372.096178894"
Sep 10 19:22:11.218707 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:11.218650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55556678b8-fqzcx"
Sep 10 19:22:12.603513 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.603480    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"]
Sep 10 19:22:12.605540 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.605520    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.608054 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.608030    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 19:22:12.609083 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.609066    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 19:22:12.609239 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.609213    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 19:22:12.609336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.609241    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5tpzd\""
Sep 10 19:22:12.609336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.609312    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 19:22:12.609457 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.609365    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 19:22:12.616867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.616843    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"]
Sep 10 19:22:12.650019 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.649984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ebb95c8-3b19-475c-abae-0953bd086eab-cert\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.650178 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.650024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8s7f\" (UniqueName: \"kubernetes.io/projected/4ebb95c8-3b19-475c-abae-0953bd086eab-kube-api-access-h8s7f\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.650178 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.650056    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ebb95c8-3b19-475c-abae-0953bd086eab-manager-config\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.650178 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.650123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ebb95c8-3b19-475c-abae-0953bd086eab-metrics-cert\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.751015 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.750965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ebb95c8-3b19-475c-abae-0953bd086eab-cert\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.751015 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.751009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8s7f\" (UniqueName: \"kubernetes.io/projected/4ebb95c8-3b19-475c-abae-0953bd086eab-kube-api-access-h8s7f\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.751219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.751034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ebb95c8-3b19-475c-abae-0953bd086eab-manager-config\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.751219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.751058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ebb95c8-3b19-475c-abae-0953bd086eab-metrics-cert\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.751671 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.751646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ebb95c8-3b19-475c-abae-0953bd086eab-manager-config\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.753563 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.753541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ebb95c8-3b19-475c-abae-0953bd086eab-metrics-cert\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.753657 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.753609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ebb95c8-3b19-475c-abae-0953bd086eab-cert\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.759918 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.759896    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8s7f\" (UniqueName: \"kubernetes.io/projected/4ebb95c8-3b19-475c-abae-0953bd086eab-kube-api-access-h8s7f\") pod \"lws-controller-manager-77f5df88d-z5ccs\" (UID: \"4ebb95c8-3b19-475c-abae-0953bd086eab\") " pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:12.914547 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:12.914445    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:13.200197 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:13.200067    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"]
Sep 10 19:22:13.204337 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:22:13.204305    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebb95c8_3b19_475c_abae_0953bd086eab.slice/crio-09478b214aa8273d1b6afe53605d1568b3f20ab6c27cedbb8c87ad6f3972498f WatchSource:0}: Error finding container 09478b214aa8273d1b6afe53605d1568b3f20ab6c27cedbb8c87ad6f3972498f: Status 404 returned error can't find the container with id 09478b214aa8273d1b6afe53605d1568b3f20ab6c27cedbb8c87ad6f3972498f
Sep 10 19:22:13.260278 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:13.260242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs" event={"ID":"4ebb95c8-3b19-475c-abae-0953bd086eab","Type":"ContainerStarted","Data":"09478b214aa8273d1b6afe53605d1568b3f20ab6c27cedbb8c87ad6f3972498f"}
Sep 10 19:22:15.274096 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:15.274059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs" event={"ID":"4ebb95c8-3b19-475c-abae-0953bd086eab","Type":"ContainerStarted","Data":"79a86ed88817aa496574100faa86e1b88aec2d759751ff2c42ba54be3ed9fe75"}
Sep 10 19:22:15.274507 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:15.274195    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:15.291535 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:15.291477    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs" podStartSLOduration=1.9173532720000002 podStartE2EDuration="3.291460713s" totalImagesPullingTime="1.374107441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:22:15.29033695 +0000 UTC m=+387.145892000" watchObservedRunningTime="2026-09-10 19:22:15.291460713 +0000 UTC m=+387.147015742"
Sep 10 19:22:26.280729 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:26.280696    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77f5df88d-z5ccs"
Sep 10 19:22:31.513367 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.513329    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"]
Sep 10 19:22:31.568533 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.568500    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"]
Sep 10 19:22:31.568687 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.568611    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.571768 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.571739    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 19:22:31.571908 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.571831    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 19:22:31.571971 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.571913    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 19:22:31.571971 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.571961    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c7zwg\""
Sep 10 19:22:31.572070 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.572002    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 19:22:31.572119 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.572081    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 19:22:31.572170 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.572116    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 19:22:31.690235 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.690197    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.690235 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.690234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.690457 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.690277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.690457 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.690299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.690457 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.690314    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.690457 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.690338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7j64\" (UniqueName: \"kubernetes.io/projected/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-kube-api-access-k7j64\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.690457 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.690357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.790824 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.790736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.790988 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.790834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.790988 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.790864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.790988 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.790893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.791144 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.791022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7j64\" (UniqueName: \"kubernetes.io/projected/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-kube-api-access-k7j64\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.791144 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.791072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.791144 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.791114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.791703 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.791673    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.793435 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.793393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.793561 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.793541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.793622 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.793541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.793676 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.793664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.806983 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.806064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.806983 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.806366    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7j64\" (UniqueName: \"kubernetes.io/projected/807bd2f5-c25b-4cad-a558-68f9e7f4eb1e-kube-api-access-k7j64\") pod \"istiod-openshift-gateway-5677ccb49b-2tcnh\" (UID: \"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:31.877250 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:31.877214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:32.197558 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:32.197483    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"]
Sep 10 19:22:32.200536 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:22:32.200509    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807bd2f5_c25b_4cad_a558_68f9e7f4eb1e.slice/crio-8baea27a18c9de233dc0034743fe8300831d1641b2ea6a71d17b39669266e272 WatchSource:0}: Error finding container 8baea27a18c9de233dc0034743fe8300831d1641b2ea6a71d17b39669266e272: Status 404 returned error can't find the container with id 8baea27a18c9de233dc0034743fe8300831d1641b2ea6a71d17b39669266e272
Sep 10 19:22:32.340815 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:32.340779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh" event={"ID":"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e","Type":"ContainerStarted","Data":"8baea27a18c9de233dc0034743fe8300831d1641b2ea6a71d17b39669266e272"}
Sep 10 19:22:34.645911 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:34.645853    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:22:34.646292 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:34.645940    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:22:35.356825 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:35.356783    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh" event={"ID":"807bd2f5-c25b-4cad-a558-68f9e7f4eb1e","Type":"ContainerStarted","Data":"49b9a680ca0d03d0bbd29fa4f83d89f2610f1bfe7f6bfef7132534bfd559637d"}
Sep 10 19:22:35.357014 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:35.356992    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:22:35.358533 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:35.358507    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-2tcnh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 19:22:35.358652 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:35.358554    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh" podUID="807bd2f5-c25b-4cad-a558-68f9e7f4eb1e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 19:22:35.395244 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:35.395191    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh" podStartSLOduration=1.952132226 podStartE2EDuration="4.395177109s" totalImagesPullingTime="2.443044883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:22:35.391376183 +0000 UTC m=+407.246931233" watchObservedRunningTime="2026-09-10 19:22:35.395177109 +0000 UTC m=+407.250732138"
Sep 10 19:22:36.362392 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:22:36.362361    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2tcnh"
Sep 10 19:23:28.706471 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.706431    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"]
Sep 10 19:23:28.708913 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.708888    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:28.711003 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.710983    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 19:23:28.711095 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.711000    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 19:23:28.711810 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.711779    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5snlz\""
Sep 10 19:23:28.718964 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.718943    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"]
Sep 10 19:23:28.827920 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.827883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:28.827920 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.827922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz5kc\" (UniqueName: \"kubernetes.io/projected/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-kube-api-access-gz5kc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:28.828115 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.827997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:28.900525 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.900490    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"]
Sep 10 19:23:28.902723 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.902707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:28.911923 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.911868    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"]
Sep 10 19:23:28.928579 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.928555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:28.928685 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.928586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skq5v\" (UniqueName: \"kubernetes.io/projected/86604a47-c583-4cc1-8b24-228687957ff6-kube-api-access-skq5v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:28.928685 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.928630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:28.928685 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.928661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:28.928803 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.928688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz5kc\" (UniqueName: \"kubernetes.io/projected/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-kube-api-access-gz5kc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:28.928803 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.928740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:28.928979 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.928963    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:28.929015 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.928993    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:28.936787 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:28.936760    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz5kc\" (UniqueName: \"kubernetes.io/projected/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-kube-api-access-gz5kc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:29.018459 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.018431    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:29.029174 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.029143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:29.029252 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.029183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skq5v\" (UniqueName: \"kubernetes.io/projected/86604a47-c583-4cc1-8b24-228687957ff6-kube-api-access-skq5v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:29.029252 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.029239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:29.029616 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.029595    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:29.029681 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.029607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:29.038466 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.038442    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skq5v\" (UniqueName: \"kubernetes.io/projected/86604a47-c583-4cc1-8b24-228687957ff6-kube-api-access-skq5v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:29.211835 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.211800    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:29.287289 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.287160    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"]
Sep 10 19:23:29.289902 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:23:29.289877    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d52fd8_44d9_4dd9_8cf1_4d3dae03bc91.slice/crio-391144a357976380aa3c7d50c4461dc0bb30c275f13c930b0369950a60983832 WatchSource:0}: Error finding container 391144a357976380aa3c7d50c4461dc0bb30c275f13c930b0369950a60983832: Status 404 returned error can't find the container with id 391144a357976380aa3c7d50c4461dc0bb30c275f13c930b0369950a60983832
Sep 10 19:23:29.480377 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.480325    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"]
Sep 10 19:23:29.482681 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:23:29.482654    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86604a47_c583_4cc1_8b24_228687957ff6.slice/crio-40f0532b7cbb7e83438eb39f095dfbe37f743208e87606b4710a578255fa4f40 WatchSource:0}: Error finding container 40f0532b7cbb7e83438eb39f095dfbe37f743208e87606b4710a578255fa4f40: Status 404 returned error can't find the container with id 40f0532b7cbb7e83438eb39f095dfbe37f743208e87606b4710a578255fa4f40
Sep 10 19:23:29.566987 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.566901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw" event={"ID":"86604a47-c583-4cc1-8b24-228687957ff6","Type":"ContainerStarted","Data":"067b3d20a63ebcb54a5d7b71c7581f01db280212d60e4f1dc8e3227778d34845"}
Sep 10 19:23:29.566987 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.566967    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw" event={"ID":"86604a47-c583-4cc1-8b24-228687957ff6","Type":"ContainerStarted","Data":"40f0532b7cbb7e83438eb39f095dfbe37f743208e87606b4710a578255fa4f40"}
Sep 10 19:23:29.568498 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.568469    2582 generic.go:356] "Generic (PLEG): container finished" podID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerID="709c00f09974f8112d662b6fae9f511229e75b04f77b4c2fc4f7e961c4ba388c" exitCode=0
Sep 10 19:23:29.568622 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.568528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl" event={"ID":"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91","Type":"ContainerDied","Data":"709c00f09974f8112d662b6fae9f511229e75b04f77b4c2fc4f7e961c4ba388c"}
Sep 10 19:23:29.568622 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:29.568564    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl" event={"ID":"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91","Type":"ContainerStarted","Data":"391144a357976380aa3c7d50c4461dc0bb30c275f13c930b0369950a60983832"}
Sep 10 19:23:29.592343 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:23:29.592314    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86604a47_c583_4cc1_8b24_228687957ff6.slice/crio-067b3d20a63ebcb54a5d7b71c7581f01db280212d60e4f1dc8e3227778d34845.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 19:23:30.573972 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:30.573874    2582 generic.go:356] "Generic (PLEG): container finished" podID="86604a47-c583-4cc1-8b24-228687957ff6" containerID="067b3d20a63ebcb54a5d7b71c7581f01db280212d60e4f1dc8e3227778d34845" exitCode=0
Sep 10 19:23:30.573972 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:30.573959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw" event={"ID":"86604a47-c583-4cc1-8b24-228687957ff6","Type":"ContainerDied","Data":"067b3d20a63ebcb54a5d7b71c7581f01db280212d60e4f1dc8e3227778d34845"}
Sep 10 19:23:30.576079 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:30.576052    2582 generic.go:356] "Generic (PLEG): container finished" podID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerID="9a23222743fa3da281b97ad2e99e2805a2d9fdffd912580fd6825cde395a0158" exitCode=0
Sep 10 19:23:30.576187 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:30.576120    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl" event={"ID":"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91","Type":"ContainerDied","Data":"9a23222743fa3da281b97ad2e99e2805a2d9fdffd912580fd6825cde395a0158"}
Sep 10 19:23:31.583720 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:31.583627    2582 generic.go:356] "Generic (PLEG): container finished" podID="86604a47-c583-4cc1-8b24-228687957ff6" containerID="c1d12cc451599b2b49229f4216c88e3ec9cb22e7f55d751b8b93c8b82f91aee1" exitCode=0
Sep 10 19:23:31.584128 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:31.583711    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw" event={"ID":"86604a47-c583-4cc1-8b24-228687957ff6","Type":"ContainerDied","Data":"c1d12cc451599b2b49229f4216c88e3ec9cb22e7f55d751b8b93c8b82f91aee1"}
Sep 10 19:23:31.586006 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:31.585984    2582 generic.go:356] "Generic (PLEG): container finished" podID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerID="ac702a68b1a313c183728d67a2f1f69910550bf67d378c9cfdf6f30b2fa8bac6" exitCode=0
Sep 10 19:23:31.586109 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:31.586040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl" event={"ID":"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91","Type":"ContainerDied","Data":"ac702a68b1a313c183728d67a2f1f69910550bf67d378c9cfdf6f30b2fa8bac6"}
Sep 10 19:23:32.596078 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.596036    2582 generic.go:356] "Generic (PLEG): container finished" podID="86604a47-c583-4cc1-8b24-228687957ff6" containerID="6b488dd7d1e2a2868a87c103b3bc426c240044cb94c5b7b62eae79896005c5b8" exitCode=0
Sep 10 19:23:32.596501 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.596120    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw" event={"ID":"86604a47-c583-4cc1-8b24-228687957ff6","Type":"ContainerDied","Data":"6b488dd7d1e2a2868a87c103b3bc426c240044cb94c5b7b62eae79896005c5b8"}
Sep 10 19:23:32.714850 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.714828    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:32.753800 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.753773    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz5kc\" (UniqueName: \"kubernetes.io/projected/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-kube-api-access-gz5kc\") pod \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") "
Sep 10 19:23:32.753968 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.753807    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-util\") pod \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") "
Sep 10 19:23:32.753968 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.753831    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-bundle\") pod \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\" (UID: \"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91\") "
Sep 10 19:23:32.754255 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.754233    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-bundle" (OuterVolumeSpecName: "bundle") pod "85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" (UID: "85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:23:32.755782 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.755750    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-kube-api-access-gz5kc" (OuterVolumeSpecName: "kube-api-access-gz5kc") pod "85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" (UID: "85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91"). InnerVolumeSpecName "kube-api-access-gz5kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:23:32.759216 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.759183    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-util" (OuterVolumeSpecName: "util") pod "85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" (UID: "85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:23:32.854491 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.854377    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-util\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:23:32.854491 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.854444    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-bundle\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:23:32.854491 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:32.854454    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz5kc\" (UniqueName: \"kubernetes.io/projected/85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91-kube-api-access-gz5kc\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:23:33.601506 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.601477    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl"
Sep 10 19:23:33.601506 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.601476    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67ntcl" event={"ID":"85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91","Type":"ContainerDied","Data":"391144a357976380aa3c7d50c4461dc0bb30c275f13c930b0369950a60983832"}
Sep 10 19:23:33.601922 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.601536    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="391144a357976380aa3c7d50c4461dc0bb30c275f13c930b0369950a60983832"
Sep 10 19:23:33.722792 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.722769    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:33.758471 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.758444    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-util\") pod \"86604a47-c583-4cc1-8b24-228687957ff6\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") "
Sep 10 19:23:33.758622 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.758486    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-bundle\") pod \"86604a47-c583-4cc1-8b24-228687957ff6\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") "
Sep 10 19:23:33.758622 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.758565    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skq5v\" (UniqueName: \"kubernetes.io/projected/86604a47-c583-4cc1-8b24-228687957ff6-kube-api-access-skq5v\") pod \"86604a47-c583-4cc1-8b24-228687957ff6\" (UID: \"86604a47-c583-4cc1-8b24-228687957ff6\") "
Sep 10 19:23:33.759069 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.759043    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-bundle" (OuterVolumeSpecName: "bundle") pod "86604a47-c583-4cc1-8b24-228687957ff6" (UID: "86604a47-c583-4cc1-8b24-228687957ff6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:23:33.760623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.760598    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86604a47-c583-4cc1-8b24-228687957ff6-kube-api-access-skq5v" (OuterVolumeSpecName: "kube-api-access-skq5v") pod "86604a47-c583-4cc1-8b24-228687957ff6" (UID: "86604a47-c583-4cc1-8b24-228687957ff6"). InnerVolumeSpecName "kube-api-access-skq5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:23:33.764013 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.763986    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-util" (OuterVolumeSpecName: "util") pod "86604a47-c583-4cc1-8b24-228687957ff6" (UID: "86604a47-c583-4cc1-8b24-228687957ff6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:23:33.859055 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.858958    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-bundle\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:23:33.859055 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.858994    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skq5v\" (UniqueName: \"kubernetes.io/projected/86604a47-c583-4cc1-8b24-228687957ff6-kube-api-access-skq5v\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:23:33.859055 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:33.859007    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86604a47-c583-4cc1-8b24-228687957ff6-util\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:23:34.607431 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:34.607393    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw"
Sep 10 19:23:34.607431 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:34.607403    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cr6xhw" event={"ID":"86604a47-c583-4cc1-8b24-228687957ff6","Type":"ContainerDied","Data":"40f0532b7cbb7e83438eb39f095dfbe37f743208e87606b4710a578255fa4f40"}
Sep 10 19:23:34.607856 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:23:34.607460    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40f0532b7cbb7e83438eb39f095dfbe37f743208e87606b4710a578255fa4f40"
Sep 10 19:24:51.568804 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.568720    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l2pbk"]
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569072    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerName="pull"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569089    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerName="pull"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569104    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerName="util"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569112    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerName="util"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569121    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86604a47-c583-4cc1-8b24-228687957ff6" containerName="pull"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569128    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="86604a47-c583-4cc1-8b24-228687957ff6" containerName="pull"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569157    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86604a47-c583-4cc1-8b24-228687957ff6" containerName="util"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569165    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="86604a47-c583-4cc1-8b24-228687957ff6" containerName="util"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569173    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86604a47-c583-4cc1-8b24-228687957ff6" containerName="extract"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569182    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="86604a47-c583-4cc1-8b24-228687957ff6" containerName="extract"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569195    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerName="extract"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569203    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerName="extract"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569273    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="86604a47-c583-4cc1-8b24-228687957ff6" containerName="extract"
Sep 10 19:24:51.569336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.569283    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d52fd8-44d9-4dd9-8cf1-4d3dae03bc91" containerName="extract"
Sep 10 19:24:51.571239 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.571220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:24:51.573506 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.573481    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 19:24:51.573608 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.573517    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k4gv2\""
Sep 10 19:24:51.573608 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.573573    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 19:24:51.574286 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.574273    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 19:24:51.582785 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.582764    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l2pbk"]
Sep 10 19:24:51.674381 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.674354    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l2pbk"]
Sep 10 19:24:51.733140 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.733100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17af349-097b-427f-b6bb-f2c731715adf-config-file\") pod \"limitador-limitador-8588749977-l2pbk\" (UID: \"a17af349-097b-427f-b6bb-f2c731715adf\") " pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:24:51.733311 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.733170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws9bq\" (UniqueName: \"kubernetes.io/projected/a17af349-097b-427f-b6bb-f2c731715adf-kube-api-access-ws9bq\") pod \"limitador-limitador-8588749977-l2pbk\" (UID: \"a17af349-097b-427f-b6bb-f2c731715adf\") " pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:24:51.833848 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.833773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws9bq\" (UniqueName: \"kubernetes.io/projected/a17af349-097b-427f-b6bb-f2c731715adf-kube-api-access-ws9bq\") pod \"limitador-limitador-8588749977-l2pbk\" (UID: \"a17af349-097b-427f-b6bb-f2c731715adf\") " pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:24:51.834030 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.834004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17af349-097b-427f-b6bb-f2c731715adf-config-file\") pod \"limitador-limitador-8588749977-l2pbk\" (UID: \"a17af349-097b-427f-b6bb-f2c731715adf\") " pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:24:51.834603 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.834578    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17af349-097b-427f-b6bb-f2c731715adf-config-file\") pod \"limitador-limitador-8588749977-l2pbk\" (UID: \"a17af349-097b-427f-b6bb-f2c731715adf\") " pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:24:51.843054 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.843030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws9bq\" (UniqueName: \"kubernetes.io/projected/a17af349-097b-427f-b6bb-f2c731715adf-kube-api-access-ws9bq\") pod \"limitador-limitador-8588749977-l2pbk\" (UID: \"a17af349-097b-427f-b6bb-f2c731715adf\") " pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:24:51.880673 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:51.880652    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:24:52.148602 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:52.148575    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l2pbk"]
Sep 10 19:24:52.150947 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:24:52.150913    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda17af349_097b_427f_b6bb_f2c731715adf.slice/crio-2e1691803f6221cb9393846f4709e5583dced31888571abf06557f19dd0542e5 WatchSource:0}: Error finding container 2e1691803f6221cb9393846f4709e5583dced31888571abf06557f19dd0542e5: Status 404 returned error can't find the container with id 2e1691803f6221cb9393846f4709e5583dced31888571abf06557f19dd0542e5
Sep 10 19:24:52.918812 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:52.918697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk" event={"ID":"a17af349-097b-427f-b6bb-f2c731715adf","Type":"ContainerStarted","Data":"2e1691803f6221cb9393846f4709e5583dced31888571abf06557f19dd0542e5"}
Sep 10 19:24:54.929256 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:54.929219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk" event={"ID":"a17af349-097b-427f-b6bb-f2c731715adf","Type":"ContainerStarted","Data":"a79c1f402200949f12ae45e0dc7b13bd517852e24a6bf1ee3d151f9202122210"}
Sep 10 19:24:54.929661 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:54.929300    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:24:54.948130 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:24:54.948083    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk" podStartSLOduration=1.707609645 podStartE2EDuration="3.94806766s" totalImagesPullingTime="2.240458015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:24:54.946278687 +0000 UTC m=+546.801833717" watchObservedRunningTime="2026-09-10 19:24:54.94806766 +0000 UTC m=+546.803622689"
Sep 10 19:25:05.934950 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:05.934918    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:25:07.614221 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:07.614180    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l2pbk"]
Sep 10 19:25:07.614682 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:07.614459    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk" podUID="a17af349-097b-427f-b6bb-f2c731715adf" containerName="limitador" containerID="cri-o://a79c1f402200949f12ae45e0dc7b13bd517852e24a6bf1ee3d151f9202122210" gracePeriod=30
Sep 10 19:25:07.984450 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:07.984401    2582 generic.go:356] "Generic (PLEG): container finished" podID="a17af349-097b-427f-b6bb-f2c731715adf" containerID="a79c1f402200949f12ae45e0dc7b13bd517852e24a6bf1ee3d151f9202122210" exitCode=0
Sep 10 19:25:07.984597 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:07.984474    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk" event={"ID":"a17af349-097b-427f-b6bb-f2c731715adf","Type":"ContainerDied","Data":"a79c1f402200949f12ae45e0dc7b13bd517852e24a6bf1ee3d151f9202122210"}
Sep 10 19:25:08.542643 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.542617    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:25:08.557717 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.557695    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17af349-097b-427f-b6bb-f2c731715adf-config-file\") pod \"a17af349-097b-427f-b6bb-f2c731715adf\" (UID: \"a17af349-097b-427f-b6bb-f2c731715adf\") "
Sep 10 19:25:08.557823 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.557769    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws9bq\" (UniqueName: \"kubernetes.io/projected/a17af349-097b-427f-b6bb-f2c731715adf-kube-api-access-ws9bq\") pod \"a17af349-097b-427f-b6bb-f2c731715adf\" (UID: \"a17af349-097b-427f-b6bb-f2c731715adf\") "
Sep 10 19:25:08.557999 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.557980    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a17af349-097b-427f-b6bb-f2c731715adf-config-file" (OuterVolumeSpecName: "config-file") pod "a17af349-097b-427f-b6bb-f2c731715adf" (UID: "a17af349-097b-427f-b6bb-f2c731715adf"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:25:08.559742 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.559722    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a17af349-097b-427f-b6bb-f2c731715adf-kube-api-access-ws9bq" (OuterVolumeSpecName: "kube-api-access-ws9bq") pod "a17af349-097b-427f-b6bb-f2c731715adf" (UID: "a17af349-097b-427f-b6bb-f2c731715adf"). InnerVolumeSpecName "kube-api-access-ws9bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:25:08.658726 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.658688    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws9bq\" (UniqueName: \"kubernetes.io/projected/a17af349-097b-427f-b6bb-f2c731715adf-kube-api-access-ws9bq\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:25:08.658726 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.658719    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a17af349-097b-427f-b6bb-f2c731715adf-config-file\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:25:08.990112 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.990074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk" event={"ID":"a17af349-097b-427f-b6bb-f2c731715adf","Type":"ContainerDied","Data":"2e1691803f6221cb9393846f4709e5583dced31888571abf06557f19dd0542e5"}
Sep 10 19:25:08.990112 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.990099    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l2pbk"
Sep 10 19:25:08.990369 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:08.990139    2582 scope.go:117] "RemoveContainer" containerID="a79c1f402200949f12ae45e0dc7b13bd517852e24a6bf1ee3d151f9202122210"
Sep 10 19:25:09.011243 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.011215    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l2pbk"]
Sep 10 19:25:09.013437 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.013401    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l2pbk"]
Sep 10 19:25:09.272467 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.272430    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"]
Sep 10 19:25:09.272843 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.272823    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a17af349-097b-427f-b6bb-f2c731715adf" containerName="limitador"
Sep 10 19:25:09.272892 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.272847    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a17af349-097b-427f-b6bb-f2c731715adf" containerName="limitador"
Sep 10 19:25:09.272937 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.272911    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a17af349-097b-427f-b6bb-f2c731715adf" containerName="limitador"
Sep 10 19:25:09.275481 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.275459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:09.277911 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.277892    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 19:25:09.278186 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.278162    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 19:25:09.278269 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.278239    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 19:25:09.278269 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.278260    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-gfvvm\""
Sep 10 19:25:09.285312 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.285291    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"]
Sep 10 19:25:09.363887 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.363858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cdb6504c-3a19-4582-be4a-db70638b0b1f-data\") pod \"postgres-69fb4594cf-p6r25\" (UID: \"cdb6504c-3a19-4582-be4a-db70638b0b1f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:09.364038 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.363917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ccrj\" (UniqueName: \"kubernetes.io/projected/cdb6504c-3a19-4582-be4a-db70638b0b1f-kube-api-access-8ccrj\") pod \"postgres-69fb4594cf-p6r25\" (UID: \"cdb6504c-3a19-4582-be4a-db70638b0b1f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:09.465229 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.465193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ccrj\" (UniqueName: \"kubernetes.io/projected/cdb6504c-3a19-4582-be4a-db70638b0b1f-kube-api-access-8ccrj\") pod \"postgres-69fb4594cf-p6r25\" (UID: \"cdb6504c-3a19-4582-be4a-db70638b0b1f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:09.465369 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.465239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cdb6504c-3a19-4582-be4a-db70638b0b1f-data\") pod \"postgres-69fb4594cf-p6r25\" (UID: \"cdb6504c-3a19-4582-be4a-db70638b0b1f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:09.465580 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.465560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cdb6504c-3a19-4582-be4a-db70638b0b1f-data\") pod \"postgres-69fb4594cf-p6r25\" (UID: \"cdb6504c-3a19-4582-be4a-db70638b0b1f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:09.474270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.474240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ccrj\" (UniqueName: \"kubernetes.io/projected/cdb6504c-3a19-4582-be4a-db70638b0b1f-kube-api-access-8ccrj\") pod \"postgres-69fb4594cf-p6r25\" (UID: \"cdb6504c-3a19-4582-be4a-db70638b0b1f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:09.586635 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.586551    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:09.860251 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.860226    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"]
Sep 10 19:25:09.862316 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:25:09.862275    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb6504c_3a19_4582_be4a_db70638b0b1f.slice/crio-dcba35377f170dcee013a4c5396bb5f62b4dd321cb8e108a70335e379e9f61fb WatchSource:0}: Error finding container dcba35377f170dcee013a4c5396bb5f62b4dd321cb8e108a70335e379e9f61fb: Status 404 returned error can't find the container with id dcba35377f170dcee013a4c5396bb5f62b4dd321cb8e108a70335e379e9f61fb
Sep 10 19:25:09.996478 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:09.996445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25" event={"ID":"cdb6504c-3a19-4582-be4a-db70638b0b1f","Type":"ContainerStarted","Data":"dcba35377f170dcee013a4c5396bb5f62b4dd321cb8e108a70335e379e9f61fb"}
Sep 10 19:25:10.670650 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:10.670616    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a17af349-097b-427f-b6bb-f2c731715adf" path="/var/lib/kubelet/pods/a17af349-097b-427f-b6bb-f2c731715adf/volumes"
Sep 10 19:25:15.023308 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:15.023267    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25" event={"ID":"cdb6504c-3a19-4582-be4a-db70638b0b1f","Type":"ContainerStarted","Data":"0568f9566d6ca38c20e8e9c6dfb5674136ca50fab00961462c21a03aacc55a7e"}
Sep 10 19:25:15.023745 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:15.023373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:15.041464 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:15.041401    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25" podStartSLOduration=1.624936887 podStartE2EDuration="6.04138717s" totalImagesPullingTime="4.416450283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:25:15.040198179 +0000 UTC m=+566.895753238" watchObservedRunningTime="2026-09-10 19:25:15.04138717 +0000 UTC m=+566.896942200"
Sep 10 19:25:21.057000 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:21.056972    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-p6r25"
Sep 10 19:25:28.860140 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.860104    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b647d647-8qfcp"]
Sep 10 19:25:28.863469 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.863448    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:28.865965 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.865939    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 19:25:28.867254 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.867234    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 19:25:28.867361 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.867296    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 19:25:28.867361 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.867306    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sn4np\""
Sep 10 19:25:28.874270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.874244    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b647d647-8qfcp"]
Sep 10 19:25:28.904461 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.904437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-webhook-cert\") pod \"maas-controller-5b647d647-8qfcp\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") " pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:28.904614 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.904476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c9td\" (UniqueName: \"kubernetes.io/projected/9740f761-dfd3-4034-b22c-899d0cb76189-kube-api-access-5c9td\") pod \"maas-controller-5b647d647-8qfcp\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") " pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:28.904614 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:28.904503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-metrics-certs\") pod \"maas-controller-5b647d647-8qfcp\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") " pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:29.005082 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:29.005057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-metrics-certs\") pod \"maas-controller-5b647d647-8qfcp\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") " pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:29.005188 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:29.005111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-webhook-cert\") pod \"maas-controller-5b647d647-8qfcp\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") " pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:29.005260 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:29.005228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c9td\" (UniqueName: \"kubernetes.io/projected/9740f761-dfd3-4034-b22c-899d0cb76189-kube-api-access-5c9td\") pod \"maas-controller-5b647d647-8qfcp\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") " pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:29.007534 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:29.007513    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-webhook-cert\") pod \"maas-controller-5b647d647-8qfcp\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") " pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:29.007618 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:29.007537    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-metrics-certs\") pod \"maas-controller-5b647d647-8qfcp\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") " pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:29.013903 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:29.013882    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c9td\" (UniqueName: \"kubernetes.io/projected/9740f761-dfd3-4034-b22c-899d0cb76189-kube-api-access-5c9td\") pod \"maas-controller-5b647d647-8qfcp\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") " pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:29.174158 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:29.174088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:29.446351 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:29.446287    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b647d647-8qfcp"]
Sep 10 19:25:29.448500 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:25:29.448473    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9740f761_dfd3_4034_b22c_899d0cb76189.slice/crio-774e29bf8a45f1f96e0b0b50c4a6d1556b20d50349df0551b47efa2449e48f41 WatchSource:0}: Error finding container 774e29bf8a45f1f96e0b0b50c4a6d1556b20d50349df0551b47efa2449e48f41: Status 404 returned error can't find the container with id 774e29bf8a45f1f96e0b0b50c4a6d1556b20d50349df0551b47efa2449e48f41
Sep 10 19:25:30.087663 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:30.087622    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-8qfcp" event={"ID":"9740f761-dfd3-4034-b22c-899d0cb76189","Type":"ContainerStarted","Data":"774e29bf8a45f1f96e0b0b50c4a6d1556b20d50349df0551b47efa2449e48f41"}
Sep 10 19:25:32.104708 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:32.104671    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-8qfcp" event={"ID":"9740f761-dfd3-4034-b22c-899d0cb76189","Type":"ContainerStarted","Data":"644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543"}
Sep 10 19:25:32.105160 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:32.104788    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:25:32.128907 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:32.128858    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b647d647-8qfcp" podStartSLOduration=1.9116467419999998 podStartE2EDuration="4.128841468s" totalImagesPullingTime="2.217194726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:25:32.128017155 +0000 UTC m=+583.983572207" watchObservedRunningTime="2026-09-10 19:25:32.128841468 +0000 UTC m=+583.984396496"
Sep 10 19:25:43.111045 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:25:43.111015    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:26:05.097631 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.097596    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"]
Sep 10 19:26:05.121545 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.121514    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"]
Sep 10 19:26:05.121693 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.121604    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.124182 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.124158    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 19:26:05.124904 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.124888    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gr54c\""
Sep 10 19:26:05.124965 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.124910    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 19:26:05.188478 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.188448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cr7z\" (UniqueName: \"kubernetes.io/projected/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-kube-api-access-4cr7z\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.188615 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.188490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-openshift-service-ca\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.188615 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.188524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-maas-api-tls\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.188615 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.188578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-metrics-certs\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.289860 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.289830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-metrics-certs\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.289977 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.289880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr7z\" (UniqueName: \"kubernetes.io/projected/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-kube-api-access-4cr7z\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.289977 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.289901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-openshift-service-ca\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.289977 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.289921    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-maas-api-tls\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.290641 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.290617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-openshift-service-ca\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.292220 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.292196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-maas-api-tls\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.292323 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.292310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-metrics-certs\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.298085 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.298063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cr7z\" (UniqueName: \"kubernetes.io/projected/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-kube-api-access-4cr7z\") pod \"maas-api-7d4dc54f4c-dcx52\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") " pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.431161 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.431096    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:05.709311 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:05.709286    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"]
Sep 10 19:26:05.711952 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:26:05.711921    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdd401b_6ef0_42e4_b6f3_cfefbf1a980f.slice/crio-a866676421b84464706f3c07d921b5599f502d84b64bbf7bca6e95367d3e55d5 WatchSource:0}: Error finding container a866676421b84464706f3c07d921b5599f502d84b64bbf7bca6e95367d3e55d5: Status 404 returned error can't find the container with id a866676421b84464706f3c07d921b5599f502d84b64bbf7bca6e95367d3e55d5
Sep 10 19:26:06.247589 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:06.247550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52" event={"ID":"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f","Type":"ContainerStarted","Data":"a866676421b84464706f3c07d921b5599f502d84b64bbf7bca6e95367d3e55d5"}
Sep 10 19:26:08.260764 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:08.260731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52" event={"ID":"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f","Type":"ContainerStarted","Data":"de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25"}
Sep 10 19:26:08.261124 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:08.260839    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:08.287022 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:08.286976    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52" podStartSLOduration=1.6559091609999999 podStartE2EDuration="3.286961508s" totalImagesPullingTime="1.631052347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:26:08.28625613 +0000 UTC m=+620.141811186" watchObservedRunningTime="2026-09-10 19:26:08.286961508 +0000 UTC m=+620.142516537"
Sep 10 19:26:14.269627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:14.269552    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:26:28.145697 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.145662    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"]
Sep 10 19:26:28.147845 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.147828    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.152042 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.152021    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 19:26:28.152167 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.152021    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 19:26:28.152797 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.152742    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-28lpp\""
Sep 10 19:26:28.152978 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.152965    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 19:26:28.162684 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.162665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.162780 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.162706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.162780 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.162734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.162780 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.162759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc6hq\" (UniqueName: \"kubernetes.io/projected/48760909-4c40-4775-82c6-75d8d664682e-kube-api-access-dc6hq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.162893 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.162798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48760909-4c40-4775-82c6-75d8d664682e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.162893 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.162821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.178098 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.178075    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"]
Sep 10 19:26:28.263154 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.263121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48760909-4c40-4775-82c6-75d8d664682e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.263154 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.263156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.263325 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.263209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.263325 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.263264    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.263452 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.263389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.263517 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.263471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc6hq\" (UniqueName: \"kubernetes.io/projected/48760909-4c40-4775-82c6-75d8d664682e-kube-api-access-dc6hq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.263755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.263688    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.263755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.263689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.263755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.263737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.265558 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.265540    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48760909-4c40-4775-82c6-75d8d664682e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.265873 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.265854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48760909-4c40-4775-82c6-75d8d664682e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.277486 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.277464    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc6hq\" (UniqueName: \"kubernetes.io/projected/48760909-4c40-4775-82c6-75d8d664682e-kube-api-access-dc6hq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm\" (UID: \"48760909-4c40-4775-82c6-75d8d664682e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.456941 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.456849    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:28.731038 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.730900    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"]
Sep 10 19:26:28.733362 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:26:28.733332    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48760909_4c40_4775_82c6_75d8d664682e.slice/crio-544efb7ef4e0d32c38c798f754d20922f11ff4a6efd33d58c83efd8fbc24fb72 WatchSource:0}: Error finding container 544efb7ef4e0d32c38c798f754d20922f11ff4a6efd33d58c83efd8fbc24fb72: Status 404 returned error can't find the container with id 544efb7ef4e0d32c38c798f754d20922f11ff4a6efd33d58c83efd8fbc24fb72
Sep 10 19:26:28.735344 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:28.735309    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:26:29.346552 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:29.346515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm" event={"ID":"48760909-4c40-4775-82c6-75d8d664682e","Type":"ContainerStarted","Data":"544efb7ef4e0d32c38c798f754d20922f11ff4a6efd33d58c83efd8fbc24fb72"}
Sep 10 19:26:30.352305 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:30.352268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm" event={"ID":"48760909-4c40-4775-82c6-75d8d664682e","Type":"ContainerStarted","Data":"a25ea4ab8204c748fc9231f01d00604f7cc64b3a9c8663a6756f96e58fecc410"}
Sep 10 19:26:30.375300 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:30.375249    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm" podStartSLOduration=1.423388904 podStartE2EDuration="2.375234705s" totalImagesPullingTime="951.845801ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:26:30.373200752 +0000 UTC m=+642.228755795" watchObservedRunningTime="2026-09-10 19:26:30.375234705 +0000 UTC m=+642.230789735"
Sep 10 19:26:38.457618 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:38.457574    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:38.458092 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:38.457649    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:38.469984 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:38.469955    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:39.402174 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:39.402142    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm"
Sep 10 19:26:51.811445 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.811394    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"]
Sep 10 19:26:51.813859 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.813825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.816670 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.816643    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 19:26:51.826468 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.826443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"]
Sep 10 19:26:51.829463 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.829441    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.829566 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.829471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.829566 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.829493    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.829566 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.829521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ftxw\" (UniqueName: \"kubernetes.io/projected/5026d492-1867-47b7-84f8-2cc293c65900-kube-api-access-5ftxw\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.829672 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.829626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.829706 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.829673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5026d492-1867-47b7-84f8-2cc293c65900-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.930800 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.930763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5026d492-1867-47b7-84f8-2cc293c65900-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.930955 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.930815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.930955 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.930832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.930955 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.930931    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.931058 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.930962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ftxw\" (UniqueName: \"kubernetes.io/projected/5026d492-1867-47b7-84f8-2cc293c65900-kube-api-access-5ftxw\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.931058 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.931015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.931235 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.931199    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.931235 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.931233    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.931451 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.931399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.933384 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.933350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5026d492-1867-47b7-84f8-2cc293c65900-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.933593 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.933573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5026d492-1867-47b7-84f8-2cc293c65900-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:51.941175 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:51.941155    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ftxw\" (UniqueName: \"kubernetes.io/projected/5026d492-1867-47b7-84f8-2cc293c65900-kube-api-access-5ftxw\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5\" (UID: \"5026d492-1867-47b7-84f8-2cc293c65900\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:52.124370 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:52.124280    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:26:52.393015 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:52.392928    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"]
Sep 10 19:26:52.396369 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:26:52.396339    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5026d492_1867_47b7_84f8_2cc293c65900.slice/crio-4df5bb7442ded4c7ba188c0b077557eca9b9a9250a07fda3985a27c4ae28778b WatchSource:0}: Error finding container 4df5bb7442ded4c7ba188c0b077557eca9b9a9250a07fda3985a27c4ae28778b: Status 404 returned error can't find the container with id 4df5bb7442ded4c7ba188c0b077557eca9b9a9250a07fda3985a27c4ae28778b
Sep 10 19:26:52.444785 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:52.444752    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5" event={"ID":"5026d492-1867-47b7-84f8-2cc293c65900","Type":"ContainerStarted","Data":"4df5bb7442ded4c7ba188c0b077557eca9b9a9250a07fda3985a27c4ae28778b"}
Sep 10 19:26:53.450702 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:53.450670    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5" event={"ID":"5026d492-1867-47b7-84f8-2cc293c65900","Type":"ContainerStarted","Data":"efe822df22bf4a184bd2f444d7b8d4b371aee3fce6b45d24d12716e77316c227"}
Sep 10 19:26:53.478433 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:26:53.478370    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5" podStartSLOduration=2.304308744 podStartE2EDuration="2.478353376s" totalImagesPullingTime="174.044632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:26:53.477342688 +0000 UTC m=+665.332897737" watchObservedRunningTime="2026-09-10 19:26:53.478353376 +0000 UTC m=+665.333908405"
Sep 10 19:27:02.125107 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:02.125066    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:27:02.125622 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:02.125168    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:27:02.137691 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:02.137659    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:27:02.502048 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:02.501960    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5"
Sep 10 19:27:11.527674 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.527647    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"]
Sep 10 19:27:11.532176 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.532155    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.534913 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.534891    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 19:27:11.543182 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.543159    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"]
Sep 10 19:27:11.588524 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.588499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.588664 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.588540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.588664 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.588556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55b1be60-b3f4-4013-80bf-8bbf91cffd79-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.588664 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.588631    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.588798 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.588665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg74m\" (UniqueName: \"kubernetes.io/projected/55b1be60-b3f4-4013-80bf-8bbf91cffd79-kube-api-access-qg74m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.588798 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.588692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.689957 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.689919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.689957 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.689964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.690208 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.689982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55b1be60-b3f4-4013-80bf-8bbf91cffd79-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.690208 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.690004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.690208 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.690023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg74m\" (UniqueName: \"kubernetes.io/projected/55b1be60-b3f4-4013-80bf-8bbf91cffd79-kube-api-access-qg74m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.690208 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.690050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.690459 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.690402    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.690514 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.690473    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.690550 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.690516    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.692599 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.692573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55b1be60-b3f4-4013-80bf-8bbf91cffd79-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.693479 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.693459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55b1be60-b3f4-4013-80bf-8bbf91cffd79-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.702090 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.702069    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg74m\" (UniqueName: \"kubernetes.io/projected/55b1be60-b3f4-4013-80bf-8bbf91cffd79-kube-api-access-qg74m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj\" (UID: \"55b1be60-b3f4-4013-80bf-8bbf91cffd79\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:11.843338 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:11.843241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:12.119493 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:12.119468    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"]
Sep 10 19:27:12.121684 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:27:12.121659    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b1be60_b3f4_4013_80bf_8bbf91cffd79.slice/crio-0bde86159765795c35d850c64eda23ee55d1c46e7f0afd5559a10d12bf0a8d2e WatchSource:0}: Error finding container 0bde86159765795c35d850c64eda23ee55d1c46e7f0afd5559a10d12bf0a8d2e: Status 404 returned error can't find the container with id 0bde86159765795c35d850c64eda23ee55d1c46e7f0afd5559a10d12bf0a8d2e
Sep 10 19:27:12.532320 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:12.532285    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj" event={"ID":"55b1be60-b3f4-4013-80bf-8bbf91cffd79","Type":"ContainerStarted","Data":"a7833c9bb5a0afa477e4b641a29f8b9a1e655e41a04ff9913f8b95b72a07a49f"}
Sep 10 19:27:12.532734 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:12.532334    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj" event={"ID":"55b1be60-b3f4-4013-80bf-8bbf91cffd79","Type":"ContainerStarted","Data":"0bde86159765795c35d850c64eda23ee55d1c46e7f0afd5559a10d12bf0a8d2e"}
Sep 10 19:27:12.553779 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:12.553732    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj" podStartSLOduration=1.3657338700000001 podStartE2EDuration="1.553716477s" totalImagesPullingTime="187.982607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:27:12.552037628 +0000 UTC m=+684.407592678" watchObservedRunningTime="2026-09-10 19:27:12.553716477 +0000 UTC m=+684.409271508"
Sep 10 19:27:21.844374 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:21.844329    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:21.844810 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:21.844450    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:21.856862 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:21.856837    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:27:22.590961 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:27:22.590932    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj"
Sep 10 19:29:22.969204 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:22.969171    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"]
Sep 10 19:29:22.972589 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:22.972569    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:22.975299 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:22.975276    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-173596-serving-cert\""
Sep 10 19:29:22.988026 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:22.988002    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"]
Sep 10 19:29:23.058065 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.058034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs82f\" (UniqueName: \"kubernetes.io/projected/59821bad-d9da-4dd8-9114-9c9b16358b9d-kube-api-access-zs82f\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.058209 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.058100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59821bad-d9da-4dd8-9114-9c9b16358b9d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.058209 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.058180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-metrics-certs\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.058301 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.058278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-maas-api-tls\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.158857 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.158823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs82f\" (UniqueName: \"kubernetes.io/projected/59821bad-d9da-4dd8-9114-9c9b16358b9d-kube-api-access-zs82f\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.159009 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.158870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59821bad-d9da-4dd8-9114-9c9b16358b9d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.159051 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.158997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-metrics-certs\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.159118 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.159102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-maas-api-tls\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.159232 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:29:23.159219    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-serving-cert: secret "maas-api-e2e-inf-a-173596-serving-cert" not found
Sep 10 19:29:23.159305 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:29:23.159295    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-maas-api-tls podName:59821bad-d9da-4dd8-9114-9c9b16358b9d nodeName:}" failed. No retries permitted until 2026-09-10 19:29:23.659272901 +0000 UTC m=+815.514827921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-maas-api-tls") pod "maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl" (UID: "59821bad-d9da-4dd8-9114-9c9b16358b9d") : secret "maas-api-e2e-inf-a-173596-serving-cert" not found
Sep 10 19:29:23.159753 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.159721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59821bad-d9da-4dd8-9114-9c9b16358b9d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.162070 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.162048    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-metrics-certs\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.168903 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.168881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs82f\" (UniqueName: \"kubernetes.io/projected/59821bad-d9da-4dd8-9114-9c9b16358b9d-kube-api-access-zs82f\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.664096 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.664057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-maas-api-tls\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.666377 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.666359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-maas-api-tls\") pod \"maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:23.888259 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:23.888226    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:24.157452 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:24.157426    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"]
Sep 10 19:29:25.103953 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:25.103917    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl" event={"ID":"59821bad-d9da-4dd8-9114-9c9b16358b9d","Type":"ContainerStarted","Data":"2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564"}
Sep 10 19:29:25.104146 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:25.103971    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl" event={"ID":"59821bad-d9da-4dd8-9114-9c9b16358b9d","Type":"ContainerStarted","Data":"e6c7c1fa96e936127d31ab2d118ff92025f3b50ea44ed809996f65ebd4cc14d2"}
Sep 10 19:29:25.104146 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:25.104047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:25.122406 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:25.122360    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl" podStartSLOduration=2.713848846 podStartE2EDuration="3.122345729s" totalImagesPullingTime="408.496883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:29:25.12177176 +0000 UTC m=+816.977326811" watchObservedRunningTime="2026-09-10 19:29:25.122345729 +0000 UTC m=+816.977900758"
Sep 10 19:29:30.920452 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:30.920405    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"]
Sep 10 19:29:30.924464 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:30.924439    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:30.927073 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:30.927046    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-5352fd-serving-cert\""
Sep 10 19:29:30.936973 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:30.936947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"]
Sep 10 19:29:31.026255 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.026212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-maas-api-tls\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.026445 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.026289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-openshift-service-ca\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.026445 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.026316    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-metrics-certs\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.026445 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.026358    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wnq8\" (UniqueName: \"kubernetes.io/projected/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-kube-api-access-8wnq8\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.113072 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.113047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:29:31.127466 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.127429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-maas-api-tls\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.127586 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:29:31.127512    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-serving-cert: secret "maas-api-e2e-autores-5352fd-serving-cert" not found
Sep 10 19:29:31.127586 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:29:31.127568    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-maas-api-tls podName:9f50c9bb-adbb-4242-8138-b9e4a8f599ce nodeName:}" failed. No retries permitted until 2026-09-10 19:29:31.627549808 +0000 UTC m=+823.483104828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-maas-api-tls") pod "maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth" (UID: "9f50c9bb-adbb-4242-8138-b9e4a8f599ce") : secret "maas-api-e2e-autores-5352fd-serving-cert" not found
Sep 10 19:29:31.127586 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.127511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-openshift-service-ca\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.127724 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.127602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-metrics-certs\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.127724 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.127649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wnq8\" (UniqueName: \"kubernetes.io/projected/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-kube-api-access-8wnq8\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.128152 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.128132    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-openshift-service-ca\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.130336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.130309    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-metrics-certs\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.142375 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.142351    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wnq8\" (UniqueName: \"kubernetes.io/projected/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-kube-api-access-8wnq8\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.631694 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.631660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-maas-api-tls\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.634048 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.634022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-maas-api-tls\") pod \"maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.836125 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.836089    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:31.926366 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.926228    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"]
Sep 10 19:29:31.930458 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.930433    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:31.932610 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.932587    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e7fa2c81-serving-cert\""
Sep 10 19:29:31.943237 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:31.943202    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"]
Sep 10 19:29:32.035567 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.035532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-metrics-certs\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.035567 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.035568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951e4a11-e582-4940-9641-0b4958916871-openshift-service-ca\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.035775 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.035628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmq2m\" (UniqueName: \"kubernetes.io/projected/951e4a11-e582-4940-9641-0b4958916871-kube-api-access-wmq2m\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.035775 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.035675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-maas-api-tls\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.112087 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.112060    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"]
Sep 10 19:29:32.114705 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:29:32.114682    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f50c9bb_adbb_4242_8138_b9e4a8f599ce.slice/crio-54e3fb4726095bc6c557d5c51ff0e28a93adfba4d986b2dbcb468afaca959046 WatchSource:0}: Error finding container 54e3fb4726095bc6c557d5c51ff0e28a93adfba4d986b2dbcb468afaca959046: Status 404 returned error can't find the container with id 54e3fb4726095bc6c557d5c51ff0e28a93adfba4d986b2dbcb468afaca959046
Sep 10 19:29:32.134185 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.134155    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth" event={"ID":"9f50c9bb-adbb-4242-8138-b9e4a8f599ce","Type":"ContainerStarted","Data":"54e3fb4726095bc6c557d5c51ff0e28a93adfba4d986b2dbcb468afaca959046"}
Sep 10 19:29:32.136708 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.136634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-metrics-certs\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.136708 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.136680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951e4a11-e582-4940-9641-0b4958916871-openshift-service-ca\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.137021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.136710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmq2m\" (UniqueName: \"kubernetes.io/projected/951e4a11-e582-4940-9641-0b4958916871-kube-api-access-wmq2m\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.137021 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.136753    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-maas-api-tls\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.137021 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:29:32.136953    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-serving-cert: secret "maas-api-e2e-ait-e7fa2c81-serving-cert" not found
Sep 10 19:29:32.137193 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:29:32.137028    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-maas-api-tls podName:951e4a11-e582-4940-9641-0b4958916871 nodeName:}" failed. No retries permitted until 2026-09-10 19:29:32.637005914 +0000 UTC m=+824.492560935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-maas-api-tls") pod "maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t" (UID: "951e4a11-e582-4940-9641-0b4958916871") : secret "maas-api-e2e-ait-e7fa2c81-serving-cert" not found
Sep 10 19:29:32.137369 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.137349    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951e4a11-e582-4940-9641-0b4958916871-openshift-service-ca\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.139093 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.139047    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-metrics-certs\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.149145 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.149127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmq2m\" (UniqueName: \"kubernetes.io/projected/951e4a11-e582-4940-9641-0b4958916871-kube-api-access-wmq2m\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.641541 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.641459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-maas-api-tls\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.643730 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.643697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-maas-api-tls\") pod \"maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:32.843244 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:32.843159    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:33.119550 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:33.119517    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"]
Sep 10 19:29:33.121725 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:29:33.121699    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951e4a11_e582_4940_9641_0b4958916871.slice/crio-edcf6ebc5fa760474009c204ffcbaec6c67343a6140fee31d6ff719bc2c0d3b1 WatchSource:0}: Error finding container edcf6ebc5fa760474009c204ffcbaec6c67343a6140fee31d6ff719bc2c0d3b1: Status 404 returned error can't find the container with id edcf6ebc5fa760474009c204ffcbaec6c67343a6140fee31d6ff719bc2c0d3b1
Sep 10 19:29:33.139966 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:33.139939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t" event={"ID":"951e4a11-e582-4940-9641-0b4958916871","Type":"ContainerStarted","Data":"edcf6ebc5fa760474009c204ffcbaec6c67343a6140fee31d6ff719bc2c0d3b1"}
Sep 10 19:29:33.141709 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:33.141685    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth" event={"ID":"9f50c9bb-adbb-4242-8138-b9e4a8f599ce","Type":"ContainerStarted","Data":"73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12"}
Sep 10 19:29:33.141831 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:33.141814    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:33.159611 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:33.159563    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth" podStartSLOduration=2.757249232 podStartE2EDuration="3.159548212s" totalImagesPullingTime="402.29898ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:29:33.158162187 +0000 UTC m=+825.013717235" watchObservedRunningTime="2026-09-10 19:29:33.159548212 +0000 UTC m=+825.015103241"
Sep 10 19:29:34.148672 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:34.148627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t" event={"ID":"951e4a11-e582-4940-9641-0b4958916871","Type":"ContainerStarted","Data":"2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22"}
Sep 10 19:29:34.149008 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:34.148814    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:34.165998 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:34.165936    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t" podStartSLOduration=2.235641091 podStartE2EDuration="3.165915799s" totalImagesPullingTime="930.274708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:29:34.165552719 +0000 UTC m=+826.021107773" watchObservedRunningTime="2026-09-10 19:29:34.165915799 +0000 UTC m=+826.021470826"
Sep 10 19:29:39.153892 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:39.153856    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:29:40.159042 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:40.159009    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:29:55.955024 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:55.954988    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"]
Sep 10 19:29:55.958898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:55.958874    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:55.961063 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:55.961045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e7e4c3-serving-cert\""
Sep 10 19:29:55.969926 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:55.969900    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"]
Sep 10 19:29:56.028299 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.028267    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-metrics-certs\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.028299 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.028302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-maas-api-tls\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.028513 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.028434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160ec50c-a433-44f1-a66c-555b3b203a49-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.028513 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.028491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rpkk\" (UniqueName: \"kubernetes.io/projected/160ec50c-a433-44f1-a66c-555b3b203a49-kube-api-access-4rpkk\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.129540 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.129508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rpkk\" (UniqueName: \"kubernetes.io/projected/160ec50c-a433-44f1-a66c-555b3b203a49-kube-api-access-4rpkk\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.129701 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.129547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-metrics-certs\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.129701 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.129566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-maas-api-tls\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.129701 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.129608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160ec50c-a433-44f1-a66c-555b3b203a49-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.130169 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.130146    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160ec50c-a433-44f1-a66c-555b3b203a49-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.131935 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.131914    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-maas-api-tls\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.132028 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.131977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-metrics-certs\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.138561 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.138542    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rpkk\" (UniqueName: \"kubernetes.io/projected/160ec50c-a433-44f1-a66c-555b3b203a49-kube-api-access-4rpkk\") pod \"maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.270899 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.270879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:56.544556 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:56.544487    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"]
Sep 10 19:29:56.547472 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:29:56.547439    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160ec50c_a433_44f1_a66c_555b3b203a49.slice/crio-739cc69966485c1a413d23943337fa8de65eae7518141c0ab8787b9b8f61ade0 WatchSource:0}: Error finding container 739cc69966485c1a413d23943337fa8de65eae7518141c0ab8787b9b8f61ade0: Status 404 returned error can't find the container with id 739cc69966485c1a413d23943337fa8de65eae7518141c0ab8787b9b8f61ade0
Sep 10 19:29:57.250607 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:57.250531    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b" event={"ID":"160ec50c-a433-44f1-a66c-555b3b203a49","Type":"ContainerStarted","Data":"7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431"}
Sep 10 19:29:57.250948 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:57.250608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b" event={"ID":"160ec50c-a433-44f1-a66c-555b3b203a49","Type":"ContainerStarted","Data":"739cc69966485c1a413d23943337fa8de65eae7518141c0ab8787b9b8f61ade0"}
Sep 10 19:29:57.250948 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:57.250650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:29:57.269359 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:29:57.269308    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b" podStartSLOduration=1.9055294219999999 podStartE2EDuration="2.269293189s" totalImagesPullingTime="363.763767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:29:57.26713429 +0000 UTC m=+849.122689347" watchObservedRunningTime="2026-09-10 19:29:57.269293189 +0000 UTC m=+849.124848217"
Sep 10 19:30:03.260013 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:03.259981    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:30:12.230956 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.230922    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"]
Sep 10 19:30:12.231384 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.231147    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t" podUID="951e4a11-e582-4940-9641-0b4958916871" containerName="maas-api" containerID="cri-o://2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22" gracePeriod=30
Sep 10 19:30:12.476211 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.476180    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:30:12.564146 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.564114    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-maas-api-tls\") pod \"951e4a11-e582-4940-9641-0b4958916871\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") "
Sep 10 19:30:12.564315 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.564158    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-metrics-certs\") pod \"951e4a11-e582-4940-9641-0b4958916871\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") "
Sep 10 19:30:12.564315 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.564177    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmq2m\" (UniqueName: \"kubernetes.io/projected/951e4a11-e582-4940-9641-0b4958916871-kube-api-access-wmq2m\") pod \"951e4a11-e582-4940-9641-0b4958916871\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") "
Sep 10 19:30:12.564315 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.564256    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951e4a11-e582-4940-9641-0b4958916871-openshift-service-ca\") pod \"951e4a11-e582-4940-9641-0b4958916871\" (UID: \"951e4a11-e582-4940-9641-0b4958916871\") "
Sep 10 19:30:12.564661 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.564634    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951e4a11-e582-4940-9641-0b4958916871-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "951e4a11-e582-4940-9641-0b4958916871" (UID: "951e4a11-e582-4940-9641-0b4958916871"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:30:12.566356 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.566332    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951e4a11-e582-4940-9641-0b4958916871-kube-api-access-wmq2m" (OuterVolumeSpecName: "kube-api-access-wmq2m") pod "951e4a11-e582-4940-9641-0b4958916871" (UID: "951e4a11-e582-4940-9641-0b4958916871"). InnerVolumeSpecName "kube-api-access-wmq2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:30:12.566483 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.566376    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "951e4a11-e582-4940-9641-0b4958916871" (UID: "951e4a11-e582-4940-9641-0b4958916871"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:30:12.566483 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.566444    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "951e4a11-e582-4940-9641-0b4958916871" (UID: "951e4a11-e582-4940-9641-0b4958916871"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:30:12.664909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.664881    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:12.664909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.664902    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmq2m\" (UniqueName: \"kubernetes.io/projected/951e4a11-e582-4940-9641-0b4958916871-kube-api-access-wmq2m\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:12.664909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.664913    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951e4a11-e582-4940-9641-0b4958916871-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:12.665135 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:12.664922    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951e4a11-e582-4940-9641-0b4958916871-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:13.329035 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:13.329000    2582 generic.go:356] "Generic (PLEG): container finished" podID="951e4a11-e582-4940-9641-0b4958916871" containerID="2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22" exitCode=0
Sep 10 19:30:13.329513 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:13.329052    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"
Sep 10 19:30:13.329513 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:13.329087    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t" event={"ID":"951e4a11-e582-4940-9641-0b4958916871","Type":"ContainerDied","Data":"2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22"}
Sep 10 19:30:13.329513 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:13.329191    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t" event={"ID":"951e4a11-e582-4940-9641-0b4958916871","Type":"ContainerDied","Data":"edcf6ebc5fa760474009c204ffcbaec6c67343a6140fee31d6ff719bc2c0d3b1"}
Sep 10 19:30:13.329513 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:13.329225    2582 scope.go:117] "RemoveContainer" containerID="2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22"
Sep 10 19:30:13.337888 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:13.337855    2582 scope.go:117] "RemoveContainer" containerID="2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22"
Sep 10 19:30:13.338224 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:30:13.338193    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22\": container with ID starting with 2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22 not found: ID does not exist" containerID="2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22"
Sep 10 19:30:13.338305 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:13.338240    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22"} err="failed to get container status \"2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22\": rpc error: code = NotFound desc = could not find container \"2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22\": container with ID starting with 2b681d81f657c510993e3b5a01fa3067ae978e390917231612c7f433f7cc1e22 not found: ID does not exist"
Sep 10 19:30:13.353140 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:13.353112    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"]
Sep 10 19:30:13.359663 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:13.359642    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fa2c81-86d995d7c-9q74t"]
Sep 10 19:30:14.669231 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:14.669199    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951e4a11-e582-4940-9641-0b4958916871" path="/var/lib/kubelet/pods/951e4a11-e582-4940-9641-0b4958916871/volumes"
Sep 10 19:30:16.831642 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.831599    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"]
Sep 10 19:30:16.832157 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.832082    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e4a11-e582-4940-9641-0b4958916871" containerName="maas-api"
Sep 10 19:30:16.832157 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.832101    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e4a11-e582-4940-9641-0b4958916871" containerName="maas-api"
Sep 10 19:30:16.832293 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.832216    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="951e4a11-e582-4940-9641-0b4958916871" containerName="maas-api"
Sep 10 19:30:16.835193 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.835174    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:16.837598 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.837578    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-ac5183cd-serving-cert\""
Sep 10 19:30:16.849916 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.849894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"]
Sep 10 19:30:16.903369 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.903340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-maas-api-tls\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:16.903482 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.903376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-metrics-certs\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:16.903482 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.903429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq9t6\" (UniqueName: \"kubernetes.io/projected/c05772e0-048d-4ec9-a94f-e8f24336a8bb-kube-api-access-sq9t6\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:16.903482 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:16.903473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05772e0-048d-4ec9-a94f-e8f24336a8bb-openshift-service-ca\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.004044 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.004005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-metrics-certs\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.004183 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.004053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq9t6\" (UniqueName: \"kubernetes.io/projected/c05772e0-048d-4ec9-a94f-e8f24336a8bb-kube-api-access-sq9t6\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.004183 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.004074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05772e0-048d-4ec9-a94f-e8f24336a8bb-openshift-service-ca\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.004276 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.004198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-maas-api-tls\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.004332 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:30:17.004315    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-serving-cert: secret "maas-api-e2e-migrate-ac5183cd-serving-cert" not found
Sep 10 19:30:17.004425 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:30:17.004400    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-maas-api-tls podName:c05772e0-048d-4ec9-a94f-e8f24336a8bb nodeName:}" failed. No retries permitted until 2026-09-10 19:30:17.50437907 +0000 UTC m=+869.359934081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-maas-api-tls") pod "maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5" (UID: "c05772e0-048d-4ec9-a94f-e8f24336a8bb") : secret "maas-api-e2e-migrate-ac5183cd-serving-cert" not found
Sep 10 19:30:17.004834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.004816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05772e0-048d-4ec9-a94f-e8f24336a8bb-openshift-service-ca\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.006602 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.006580    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-metrics-certs\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.017891 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.017870    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq9t6\" (UniqueName: \"kubernetes.io/projected/c05772e0-048d-4ec9-a94f-e8f24336a8bb-kube-api-access-sq9t6\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.508561 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.508518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-maas-api-tls\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.511010 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.510986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-maas-api-tls\") pod \"maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.648931 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.648895    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"]
Sep 10 19:30:17.652520 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.652498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:17.654704 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.654684    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-ac5183cd\""
Sep 10 19:30:17.654855 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.654840    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-ac5183cd-dockercfg-9bnsj\""
Sep 10 19:30:17.665075 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.665056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"]
Sep 10 19:30:17.710334 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.710303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72181d18-aa39-4ac7-90be-5533eeed0c9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6\" (UID: \"72181d18-aa39-4ac7-90be-5533eeed0c9a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:17.710481 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.710468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g8nt\" (UniqueName: \"kubernetes.io/projected/72181d18-aa39-4ac7-90be-5533eeed0c9a-kube-api-access-7g8nt\") pod \"payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6\" (UID: \"72181d18-aa39-4ac7-90be-5533eeed0c9a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:17.748173 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.748145    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:17.811034 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.810996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g8nt\" (UniqueName: \"kubernetes.io/projected/72181d18-aa39-4ac7-90be-5533eeed0c9a-kube-api-access-7g8nt\") pod \"payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6\" (UID: \"72181d18-aa39-4ac7-90be-5533eeed0c9a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:17.811340 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.811319    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72181d18-aa39-4ac7-90be-5533eeed0c9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6\" (UID: \"72181d18-aa39-4ac7-90be-5533eeed0c9a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:17.812724 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.812559    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72181d18-aa39-4ac7-90be-5533eeed0c9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6\" (UID: \"72181d18-aa39-4ac7-90be-5533eeed0c9a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:17.823058 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.823032    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g8nt\" (UniqueName: \"kubernetes.io/projected/72181d18-aa39-4ac7-90be-5533eeed0c9a-kube-api-access-7g8nt\") pod \"payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6\" (UID: \"72181d18-aa39-4ac7-90be-5533eeed0c9a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:17.962326 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:17.962294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:18.038435 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:18.035337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"]
Sep 10 19:30:18.237308 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:18.237282    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"]
Sep 10 19:30:18.239709 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:30:18.239679    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72181d18_aa39_4ac7_90be_5533eeed0c9a.slice/crio-8bedc68f4fb5169b0cf8f640f57462c3799ff9ca9b3d4529f9e33b880f7c75d6 WatchSource:0}: Error finding container 8bedc68f4fb5169b0cf8f640f57462c3799ff9ca9b3d4529f9e33b880f7c75d6: Status 404 returned error can't find the container with id 8bedc68f4fb5169b0cf8f640f57462c3799ff9ca9b3d4529f9e33b880f7c75d6
Sep 10 19:30:18.357921 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:18.357879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5" event={"ID":"c05772e0-048d-4ec9-a94f-e8f24336a8bb","Type":"ContainerStarted","Data":"d6bc43dc82cca231181d72f433772b81168c56b771fef9a67a46933702778f43"}
Sep 10 19:30:18.359261 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:18.359219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6" event={"ID":"72181d18-aa39-4ac7-90be-5533eeed0c9a","Type":"ContainerStarted","Data":"8bedc68f4fb5169b0cf8f640f57462c3799ff9ca9b3d4529f9e33b880f7c75d6"}
Sep 10 19:30:19.366009 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:19.365966    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5" event={"ID":"c05772e0-048d-4ec9-a94f-e8f24336a8bb","Type":"ContainerStarted","Data":"caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5"}
Sep 10 19:30:19.366543 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:19.366139    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:19.386391 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:19.386338    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5" podStartSLOduration=2.996304572 podStartE2EDuration="3.386319204s" totalImagesPullingTime="390.014632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:30:19.383811792 +0000 UTC m=+871.239366844" watchObservedRunningTime="2026-09-10 19:30:19.386319204 +0000 UTC m=+871.241874234"
Sep 10 19:30:20.372782 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:20.372749    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6" event={"ID":"72181d18-aa39-4ac7-90be-5533eeed0c9a","Type":"ContainerStarted","Data":"a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254"}
Sep 10 19:30:20.373222 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:20.373071    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:20.390733 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:20.390684    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6" podStartSLOduration=1.829409667 podStartE2EDuration="3.3906701s" totalImagesPullingTime="1.561260433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:30:20.389289423 +0000 UTC m=+872.244844463" watchObservedRunningTime="2026-09-10 19:30:20.3906701 +0000 UTC m=+872.246225128"
Sep 10 19:30:25.378846 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:25.378812    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:32.384371 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:32.384338    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:47.495836 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.494530    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"]
Sep 10 19:30:47.495836 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.494774    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5" podUID="c05772e0-048d-4ec9-a94f-e8f24336a8bb" containerName="maas-api" containerID="cri-o://caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5" gracePeriod=30
Sep 10 19:30:47.571077 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.571039    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"]
Sep 10 19:30:47.571355 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.571308    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6" podUID="72181d18-aa39-4ac7-90be-5533eeed0c9a" containerName="payload-pre-processing" containerID="cri-o://a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254" gracePeriod=30
Sep 10 19:30:47.810042 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.810014    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:47.833702 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.833458    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:47.876557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.876525    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-metrics-certs\") pod \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") "
Sep 10 19:30:47.876746 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.876583    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq9t6\" (UniqueName: \"kubernetes.io/projected/c05772e0-048d-4ec9-a94f-e8f24336a8bb-kube-api-access-sq9t6\") pod \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") "
Sep 10 19:30:47.876746 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.876644    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72181d18-aa39-4ac7-90be-5533eeed0c9a-plugins-config-volume\") pod \"72181d18-aa39-4ac7-90be-5533eeed0c9a\" (UID: \"72181d18-aa39-4ac7-90be-5533eeed0c9a\") "
Sep 10 19:30:47.876746 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.876689    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g8nt\" (UniqueName: \"kubernetes.io/projected/72181d18-aa39-4ac7-90be-5533eeed0c9a-kube-api-access-7g8nt\") pod \"72181d18-aa39-4ac7-90be-5533eeed0c9a\" (UID: \"72181d18-aa39-4ac7-90be-5533eeed0c9a\") "
Sep 10 19:30:47.876746 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.876718    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05772e0-048d-4ec9-a94f-e8f24336a8bb-openshift-service-ca\") pod \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") "
Sep 10 19:30:47.876746 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.876742    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-maas-api-tls\") pod \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\" (UID: \"c05772e0-048d-4ec9-a94f-e8f24336a8bb\") "
Sep 10 19:30:47.877403 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.877349    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c05772e0-048d-4ec9-a94f-e8f24336a8bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c05772e0-048d-4ec9-a94f-e8f24336a8bb" (UID: "c05772e0-048d-4ec9-a94f-e8f24336a8bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:30:47.877753 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.877716    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72181d18-aa39-4ac7-90be-5533eeed0c9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72181d18-aa39-4ac7-90be-5533eeed0c9a" (UID: "72181d18-aa39-4ac7-90be-5533eeed0c9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:30:47.880739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.880709    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c05772e0-048d-4ec9-a94f-e8f24336a8bb" (UID: "c05772e0-048d-4ec9-a94f-e8f24336a8bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:30:47.882939 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.882908    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05772e0-048d-4ec9-a94f-e8f24336a8bb-kube-api-access-sq9t6" (OuterVolumeSpecName: "kube-api-access-sq9t6") pod "c05772e0-048d-4ec9-a94f-e8f24336a8bb" (UID: "c05772e0-048d-4ec9-a94f-e8f24336a8bb"). InnerVolumeSpecName "kube-api-access-sq9t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:30:47.883045 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.882980    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72181d18-aa39-4ac7-90be-5533eeed0c9a-kube-api-access-7g8nt" (OuterVolumeSpecName: "kube-api-access-7g8nt") pod "72181d18-aa39-4ac7-90be-5533eeed0c9a" (UID: "72181d18-aa39-4ac7-90be-5533eeed0c9a"). InnerVolumeSpecName "kube-api-access-7g8nt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:30:47.883428 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.883379    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c05772e0-048d-4ec9-a94f-e8f24336a8bb" (UID: "c05772e0-048d-4ec9-a94f-e8f24336a8bb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:30:47.977483 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.977446    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq9t6\" (UniqueName: \"kubernetes.io/projected/c05772e0-048d-4ec9-a94f-e8f24336a8bb-kube-api-access-sq9t6\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:47.977653 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.977476    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72181d18-aa39-4ac7-90be-5533eeed0c9a-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:47.977653 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.977511    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g8nt\" (UniqueName: \"kubernetes.io/projected/72181d18-aa39-4ac7-90be-5533eeed0c9a-kube-api-access-7g8nt\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:47.977653 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.977522    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05772e0-048d-4ec9-a94f-e8f24336a8bb-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:47.977653 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.977530    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:47.977653 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:47.977539    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05772e0-048d-4ec9-a94f-e8f24336a8bb-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:30:48.502501 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.502454    2582 generic.go:356] "Generic (PLEG): container finished" podID="c05772e0-048d-4ec9-a94f-e8f24336a8bb" containerID="caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5" exitCode=0
Sep 10 19:30:48.502501 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.502490    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"
Sep 10 19:30:48.503044 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.502534    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5" event={"ID":"c05772e0-048d-4ec9-a94f-e8f24336a8bb","Type":"ContainerDied","Data":"caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5"}
Sep 10 19:30:48.503044 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.502591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5" event={"ID":"c05772e0-048d-4ec9-a94f-e8f24336a8bb","Type":"ContainerDied","Data":"d6bc43dc82cca231181d72f433772b81168c56b771fef9a67a46933702778f43"}
Sep 10 19:30:48.503044 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.502627    2582 scope.go:117] "RemoveContainer" containerID="caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5"
Sep 10 19:30:48.504011 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.503992    2582 generic.go:356] "Generic (PLEG): container finished" podID="72181d18-aa39-4ac7-90be-5533eeed0c9a" containerID="a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254" exitCode=0
Sep 10 19:30:48.504093 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.504047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6" event={"ID":"72181d18-aa39-4ac7-90be-5533eeed0c9a","Type":"ContainerDied","Data":"a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254"}
Sep 10 19:30:48.504093 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.504085    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"
Sep 10 19:30:48.504187 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.504086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6" event={"ID":"72181d18-aa39-4ac7-90be-5533eeed0c9a","Type":"ContainerDied","Data":"8bedc68f4fb5169b0cf8f640f57462c3799ff9ca9b3d4529f9e33b880f7c75d6"}
Sep 10 19:30:48.519510 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.519494    2582 scope.go:117] "RemoveContainer" containerID="caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5"
Sep 10 19:30:48.519764 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:30:48.519748    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5\": container with ID starting with caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5 not found: ID does not exist" containerID="caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5"
Sep 10 19:30:48.519817 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.519772    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5"} err="failed to get container status \"caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5\": rpc error: code = NotFound desc = could not find container \"caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5\": container with ID starting with caccf1489dde8313f53d4c451ac7917a9e23ab221e56006b511b382bf6d21bd5 not found: ID does not exist"
Sep 10 19:30:48.519817 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.519787    2582 scope.go:117] "RemoveContainer" containerID="a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254"
Sep 10 19:30:48.531559 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.531535    2582 scope.go:117] "RemoveContainer" containerID="a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254"
Sep 10 19:30:48.532075 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:30:48.532053    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254\": container with ID starting with a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254 not found: ID does not exist" containerID="a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254"
Sep 10 19:30:48.532172 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.532081    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254"} err="failed to get container status \"a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254\": rpc error: code = NotFound desc = could not find container \"a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254\": container with ID starting with a54c8cbf26ea555c11c004e3249748bae012613d6a8237f4b8ae748406ddf254 not found: ID does not exist"
Sep 10 19:30:48.539297 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.539277    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"]
Sep 10 19:30:48.544164 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.544145    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ac5183cd-6fb4dd8978-spsw6"]
Sep 10 19:30:48.564282 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.564256    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"]
Sep 10 19:30:48.567777 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.567752    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac5183cd-784bb587f5-mklb5"]
Sep 10 19:30:48.669734 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.669699    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72181d18-aa39-4ac7-90be-5533eeed0c9a" path="/var/lib/kubelet/pods/72181d18-aa39-4ac7-90be-5533eeed0c9a/volumes"
Sep 10 19:30:48.670150 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:48.670130    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c05772e0-048d-4ec9-a94f-e8f24336a8bb" path="/var/lib/kubelet/pods/c05772e0-048d-4ec9-a94f-e8f24336a8bb/volumes"
Sep 10 19:30:52.939286 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.939249    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"]
Sep 10 19:30:52.939786 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.939726    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72181d18-aa39-4ac7-90be-5533eeed0c9a" containerName="payload-pre-processing"
Sep 10 19:30:52.939786 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.939743    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="72181d18-aa39-4ac7-90be-5533eeed0c9a" containerName="payload-pre-processing"
Sep 10 19:30:52.939786 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.939758    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05772e0-048d-4ec9-a94f-e8f24336a8bb" containerName="maas-api"
Sep 10 19:30:52.939786 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.939768    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05772e0-048d-4ec9-a94f-e8f24336a8bb" containerName="maas-api"
Sep 10 19:30:52.940006 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.939890    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c05772e0-048d-4ec9-a94f-e8f24336a8bb" containerName="maas-api"
Sep 10 19:30:52.940006 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.939903    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="72181d18-aa39-4ac7-90be-5533eeed0c9a" containerName="payload-pre-processing"
Sep 10 19:30:52.943324 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.943304    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:52.945565 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.945544    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-30f2651a-serving-cert\""
Sep 10 19:30:52.953704 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:52.953674    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"]
Sep 10 19:30:53.016644 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.016609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-maas-api-tls\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.016846 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.016673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0445768-ac1f-420e-8085-4a4d76bc464c-openshift-service-ca\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.016846 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.016727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-metrics-certs\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.016846 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.016802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92f6p\" (UniqueName: \"kubernetes.io/projected/d0445768-ac1f-420e-8085-4a4d76bc464c-kube-api-access-92f6p\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.117433 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.117375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0445768-ac1f-420e-8085-4a4d76bc464c-openshift-service-ca\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.117623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.117444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-metrics-certs\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.117623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.117530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92f6p\" (UniqueName: \"kubernetes.io/projected/d0445768-ac1f-420e-8085-4a4d76bc464c-kube-api-access-92f6p\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.117623 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.117584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-maas-api-tls\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.118237 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.118208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0445768-ac1f-420e-8085-4a4d76bc464c-openshift-service-ca\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.121226 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.121200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-metrics-certs\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.121337 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.121200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-maas-api-tls\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.126928 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.126908    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92f6p\" (UniqueName: \"kubernetes.io/projected/d0445768-ac1f-420e-8085-4a4d76bc464c-kube-api-access-92f6p\") pod \"maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.255887 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.255804    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:53.532826 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:53.532764    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"]
Sep 10 19:30:53.535058 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:30:53.535015    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0445768_ac1f_420e_8085_4a4d76bc464c.slice/crio-20d9bc258d20ed06f6b8f5d153e10af6546e7ccf79eae4cefbbe2af808aa75a8 WatchSource:0}: Error finding container 20d9bc258d20ed06f6b8f5d153e10af6546e7ccf79eae4cefbbe2af808aa75a8: Status 404 returned error can't find the container with id 20d9bc258d20ed06f6b8f5d153e10af6546e7ccf79eae4cefbbe2af808aa75a8
Sep 10 19:30:54.536611 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:54.536572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm" event={"ID":"d0445768-ac1f-420e-8085-4a4d76bc464c","Type":"ContainerStarted","Data":"ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884"}
Sep 10 19:30:54.537071 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:54.536633    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm" event={"ID":"d0445768-ac1f-420e-8085-4a4d76bc464c","Type":"ContainerStarted","Data":"20d9bc258d20ed06f6b8f5d153e10af6546e7ccf79eae4cefbbe2af808aa75a8"}
Sep 10 19:30:54.537071 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:54.536673    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:30:54.555161 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:30:54.555104    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm" podStartSLOduration=2.208436419 podStartE2EDuration="2.555083626s" totalImagesPullingTime="346.647207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:30:54.554925061 +0000 UTC m=+906.410480118" watchObservedRunningTime="2026-09-10 19:30:54.555083626 +0000 UTC m=+906.410638656"
Sep 10 19:31:00.547093 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:00.547061    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:31:07.618716 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.618685    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"]
Sep 10 19:31:07.619233 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.618889    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth" podUID="9f50c9bb-adbb-4242-8138-b9e4a8f599ce" containerName="maas-api" containerID="cri-o://73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12" gracePeriod=30
Sep 10 19:31:07.854830 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.854801    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:31:07.949803 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.949718    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-maas-api-tls\") pod \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") "
Sep 10 19:31:07.949803 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.949764    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-metrics-certs\") pod \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") "
Sep 10 19:31:07.949803 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.949781    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wnq8\" (UniqueName: \"kubernetes.io/projected/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-kube-api-access-8wnq8\") pod \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") "
Sep 10 19:31:07.950077 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.949813    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-openshift-service-ca\") pod \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\" (UID: \"9f50c9bb-adbb-4242-8138-b9e4a8f599ce\") "
Sep 10 19:31:07.950189 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.950160    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9f50c9bb-adbb-4242-8138-b9e4a8f599ce" (UID: "9f50c9bb-adbb-4242-8138-b9e4a8f599ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:31:07.951869 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.951842    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-kube-api-access-8wnq8" (OuterVolumeSpecName: "kube-api-access-8wnq8") pod "9f50c9bb-adbb-4242-8138-b9e4a8f599ce" (UID: "9f50c9bb-adbb-4242-8138-b9e4a8f599ce"). InnerVolumeSpecName "kube-api-access-8wnq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:31:07.951972 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.951957    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f50c9bb-adbb-4242-8138-b9e4a8f599ce" (UID: "9f50c9bb-adbb-4242-8138-b9e4a8f599ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:31:07.952019 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:07.951983    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9f50c9bb-adbb-4242-8138-b9e4a8f599ce" (UID: "9f50c9bb-adbb-4242-8138-b9e4a8f599ce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:31:08.051386 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.051351    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:31:08.051386 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.051379    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:31:08.051386 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.051389    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wnq8\" (UniqueName: \"kubernetes.io/projected/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-kube-api-access-8wnq8\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:31:08.051678 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.051399    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50c9bb-adbb-4242-8138-b9e4a8f599ce-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:31:08.596619 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.596587    2582 generic.go:356] "Generic (PLEG): container finished" podID="9f50c9bb-adbb-4242-8138-b9e4a8f599ce" containerID="73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12" exitCode=0
Sep 10 19:31:08.596791 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.596634    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"
Sep 10 19:31:08.596791 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.596668    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth" event={"ID":"9f50c9bb-adbb-4242-8138-b9e4a8f599ce","Type":"ContainerDied","Data":"73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12"}
Sep 10 19:31:08.596791 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.596719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth" event={"ID":"9f50c9bb-adbb-4242-8138-b9e4a8f599ce","Type":"ContainerDied","Data":"54e3fb4726095bc6c557d5c51ff0e28a93adfba4d986b2dbcb468afaca959046"}
Sep 10 19:31:08.596791 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.596741    2582 scope.go:117] "RemoveContainer" containerID="73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12"
Sep 10 19:31:08.605988 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.605971    2582 scope.go:117] "RemoveContainer" containerID="73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12"
Sep 10 19:31:08.606283 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:31:08.606258    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12\": container with ID starting with 73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12 not found: ID does not exist" containerID="73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12"
Sep 10 19:31:08.606329 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.606291    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12"} err="failed to get container status \"73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12\": rpc error: code = NotFound desc = could not find container \"73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12\": container with ID starting with 73735205b48cda8b363c946978fe96dba84db59e13e9032b235d86503179fb12 not found: ID does not exist"
Sep 10 19:31:08.618572 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.618546    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"]
Sep 10 19:31:08.623229 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.623210    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5352fd-68fbdbbdfb-xvdth"]
Sep 10 19:31:08.668537 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:08.668514    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f50c9bb-adbb-4242-8138-b9e4a8f599ce" path="/var/lib/kubelet/pods/9f50c9bb-adbb-4242-8138-b9e4a8f599ce/volumes"
Sep 10 19:31:23.418292 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.418257    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"]
Sep 10 19:31:23.420666 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.418594    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm" podUID="d0445768-ac1f-420e-8085-4a4d76bc464c" containerName="maas-api" containerID="cri-o://ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884" gracePeriod=30
Sep 10 19:31:23.663667 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.663645    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:31:23.669695 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.669648    2582 generic.go:356] "Generic (PLEG): container finished" podID="d0445768-ac1f-420e-8085-4a4d76bc464c" containerID="ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884" exitCode=0
Sep 10 19:31:23.669695 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.669685    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"
Sep 10 19:31:23.669834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.669738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm" event={"ID":"d0445768-ac1f-420e-8085-4a4d76bc464c","Type":"ContainerDied","Data":"ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884"}
Sep 10 19:31:23.669834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.669781    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm" event={"ID":"d0445768-ac1f-420e-8085-4a4d76bc464c","Type":"ContainerDied","Data":"20d9bc258d20ed06f6b8f5d153e10af6546e7ccf79eae4cefbbe2af808aa75a8"}
Sep 10 19:31:23.669834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.669802    2582 scope.go:117] "RemoveContainer" containerID="ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884"
Sep 10 19:31:23.677739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.677717    2582 scope.go:117] "RemoveContainer" containerID="ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884"
Sep 10 19:31:23.677996 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:31:23.677969    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884\": container with ID starting with ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884 not found: ID does not exist" containerID="ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884"
Sep 10 19:31:23.678064 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.677998    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884"} err="failed to get container status \"ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884\": rpc error: code = NotFound desc = could not find container \"ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884\": container with ID starting with ab2421ec35a8c08f16e94fef5cd926fcb80c4722a2ac95eec15ba741aaa26884 not found: ID does not exist"
Sep 10 19:31:23.785664 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.785635    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92f6p\" (UniqueName: \"kubernetes.io/projected/d0445768-ac1f-420e-8085-4a4d76bc464c-kube-api-access-92f6p\") pod \"d0445768-ac1f-420e-8085-4a4d76bc464c\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") "
Sep 10 19:31:23.785823 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.785687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0445768-ac1f-420e-8085-4a4d76bc464c-openshift-service-ca\") pod \"d0445768-ac1f-420e-8085-4a4d76bc464c\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") "
Sep 10 19:31:23.785823 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.785709    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-maas-api-tls\") pod \"d0445768-ac1f-420e-8085-4a4d76bc464c\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") "
Sep 10 19:31:23.785935 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.785832    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-metrics-certs\") pod \"d0445768-ac1f-420e-8085-4a4d76bc464c\" (UID: \"d0445768-ac1f-420e-8085-4a4d76bc464c\") "
Sep 10 19:31:23.786038 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.786012    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0445768-ac1f-420e-8085-4a4d76bc464c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d0445768-ac1f-420e-8085-4a4d76bc464c" (UID: "d0445768-ac1f-420e-8085-4a4d76bc464c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:31:23.786226 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.786200    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0445768-ac1f-420e-8085-4a4d76bc464c-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:31:23.787849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.787817    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d0445768-ac1f-420e-8085-4a4d76bc464c" (UID: "d0445768-ac1f-420e-8085-4a4d76bc464c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:31:23.787849 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.787836    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d0445768-ac1f-420e-8085-4a4d76bc464c" (UID: "d0445768-ac1f-420e-8085-4a4d76bc464c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:31:23.787976 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.787851    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0445768-ac1f-420e-8085-4a4d76bc464c-kube-api-access-92f6p" (OuterVolumeSpecName: "kube-api-access-92f6p") pod "d0445768-ac1f-420e-8085-4a4d76bc464c" (UID: "d0445768-ac1f-420e-8085-4a4d76bc464c"). InnerVolumeSpecName "kube-api-access-92f6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:31:23.887425 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.887386    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92f6p\" (UniqueName: \"kubernetes.io/projected/d0445768-ac1f-420e-8085-4a4d76bc464c-kube-api-access-92f6p\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:31:23.887567 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.887430    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:31:23.887567 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.887442    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0445768-ac1f-420e-8085-4a4d76bc464c-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:31:23.992718 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.992681    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"]
Sep 10 19:31:23.997528 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:23.997502    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30f2651a-56c5f64d7d-8rskm"]
Sep 10 19:31:24.668740 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:24.668698    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0445768-ac1f-420e-8085-4a4d76bc464c" path="/var/lib/kubelet/pods/d0445768-ac1f-420e-8085-4a4d76bc464c/volumes"
Sep 10 19:31:25.566510 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.566471    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"]
Sep 10 19:31:25.566791 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.566778    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f50c9bb-adbb-4242-8138-b9e4a8f599ce" containerName="maas-api"
Sep 10 19:31:25.566791 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.566791    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f50c9bb-adbb-4242-8138-b9e4a8f599ce" containerName="maas-api"
Sep 10 19:31:25.566925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.566809    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0445768-ac1f-420e-8085-4a4d76bc464c" containerName="maas-api"
Sep 10 19:31:25.566925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.566814    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0445768-ac1f-420e-8085-4a4d76bc464c" containerName="maas-api"
Sep 10 19:31:25.566925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.566860    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f50c9bb-adbb-4242-8138-b9e4a8f599ce" containerName="maas-api"
Sep 10 19:31:25.566925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.566867    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0445768-ac1f-420e-8085-4a4d76bc464c" containerName="maas-api"
Sep 10 19:31:25.571190 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.571168    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.573449 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.573389    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-34de9e5b-openshift-default-dockercfg-4q296\""
Sep 10 19:31:25.581538 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.581513    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"]
Sep 10 19:31:25.702723 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.702688    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-credential-socket\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.702723 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.702725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-token\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.703219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.702745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-envoy\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.703219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.702825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-podinfo\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.703219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.702850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j28s\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-kube-api-access-4j28s\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.703219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.702870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-certs\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.703219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.702924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-socket\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.703219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.702957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4819f0aa-cebb-420e-b75b-9472d4d9563f-istiod-ca-cert\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.703219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.703001    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-data\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-data\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804668 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-credential-socket\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804668 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-token\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804668 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-envoy\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-podinfo\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j28s\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-kube-api-access-4j28s\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-certs\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-socket\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4819f0aa-cebb-420e-b75b-9472d4d9563f-istiod-ca-cert\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.804982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.804886    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-data\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.805209 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.805001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-credential-socket\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.805209 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.805164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-certs\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.805209 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.805163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-socket\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.805589 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.805567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4819f0aa-cebb-420e-b75b-9472d4d9563f-istiod-ca-cert\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.807220 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.807201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-envoy\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.807220 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.807209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-podinfo\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.813903 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.813879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j28s\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-kube-api-access-4j28s\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.814078 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.814057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-token\") pod \"e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") " pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:25.882042 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:25.881963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:26.160947 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:26.160922    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"]
Sep 10 19:31:26.163392 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:31:26.163363    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4819f0aa_cebb_420e_b75b_9472d4d9563f.slice/crio-be7fad78a8843cde4c2b86317309fcd4df006e7ef53d4ab783d4c85279bd0f28 WatchSource:0}: Error finding container be7fad78a8843cde4c2b86317309fcd4df006e7ef53d4ab783d4c85279bd0f28: Status 404 returned error can't find the container with id be7fad78a8843cde4c2b86317309fcd4df006e7ef53d4ab783d4c85279bd0f28
Sep 10 19:31:26.683296 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:26.683260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" event={"ID":"4819f0aa-cebb-420e-b75b-9472d4d9563f","Type":"ContainerStarted","Data":"be7fad78a8843cde4c2b86317309fcd4df006e7ef53d4ab783d4c85279bd0f28"}
Sep 10 19:31:30.445168 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:30.445124    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:31:30.445445 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:30.445208    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:31:30.445445 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:30.445266    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:31:30.705772 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:30.705677    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" event={"ID":"4819f0aa-cebb-420e-b75b-9472d4d9563f","Type":"ContainerStarted","Data":"3e30956cff4b0994e615800005cd5bb1637ab61012bb4061eaeb49722601b237"}
Sep 10 19:31:30.727947 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:30.727887    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" podStartSLOduration=1.448423425 podStartE2EDuration="5.727871387s" totalImagesPullingTime="4.279447962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:31:30.726080743 +0000 UTC m=+942.581635799" watchObservedRunningTime="2026-09-10 19:31:30.727871387 +0000 UTC m=+942.583426416"
Sep 10 19:31:30.882709 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:30.882672    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:31.887695 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:31.887665    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:32.716259 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:32.716227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:32.717312 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:32.717289    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:33.294950 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.294920    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"]
Sep 10 19:31:33.298682 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.298655    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.301010 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.300989    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-34de9e5b-serving-cert\""
Sep 10 19:31:33.309227 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.309200    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"]
Sep 10 19:31:33.479558 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.479523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrp7h\" (UniqueName: \"kubernetes.io/projected/a1582eae-c261-4bfb-a8cc-1ae012c202dc-kube-api-access-zrp7h\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.479755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.479628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-maas-api-tls\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.479755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.479710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1582eae-c261-4bfb-a8cc-1ae012c202dc-openshift-service-ca\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.479857 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.479755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-metrics-certs\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.581019 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.580932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrp7h\" (UniqueName: \"kubernetes.io/projected/a1582eae-c261-4bfb-a8cc-1ae012c202dc-kube-api-access-zrp7h\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.581019 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.580994    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-maas-api-tls\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.581259 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.581038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1582eae-c261-4bfb-a8cc-1ae012c202dc-openshift-service-ca\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.581259 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.581062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-metrics-certs\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.581783 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.581755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1582eae-c261-4bfb-a8cc-1ae012c202dc-openshift-service-ca\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.583503 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.583478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-maas-api-tls\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.583606 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.583522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-metrics-certs\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.589339 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.589313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrp7h\" (UniqueName: \"kubernetes.io/projected/a1582eae-c261-4bfb-a8cc-1ae012c202dc-kube-api-access-zrp7h\") pod \"maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.612301 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.612277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:33.893126 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.893048    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"]
Sep 10 19:31:33.896369 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:31:33.896340    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1582eae_c261_4bfb_a8cc_1ae012c202dc.slice/crio-abf91a2dd4cf40322464892eab7a52c87d0c10e21496acc19b2971946bd88e1a WatchSource:0}: Error finding container abf91a2dd4cf40322464892eab7a52c87d0c10e21496acc19b2971946bd88e1a: Status 404 returned error can't find the container with id abf91a2dd4cf40322464892eab7a52c87d0c10e21496acc19b2971946bd88e1a
Sep 10 19:31:33.897942 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.897902    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:31:33.976582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.976549    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"]
Sep 10 19:31:33.981335 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.981314    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:33.983465 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.983442    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-34de9e5b\""
Sep 10 19:31:33.994525 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:33.994502    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"]
Sep 10 19:31:34.007730 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.007704    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"]
Sep 10 19:31:34.011591 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.011571    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:34.014289 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.014260    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-34de9e5b-dockercfg-chdtg\""
Sep 10 19:31:34.020565 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.020544    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"]
Sep 10 19:31:34.086105 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.086070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb943a65-be98-437a-99fe-deea2501840f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp\" (UID: \"cb943a65-be98-437a-99fe-deea2501840f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:34.086269 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.086124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmzhx\" (UniqueName: \"kubernetes.io/projected/cb943a65-be98-437a-99fe-deea2501840f-kube-api-access-pmzhx\") pod \"payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp\" (UID: \"cb943a65-be98-437a-99fe-deea2501840f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:34.186974 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.186885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb943a65-be98-437a-99fe-deea2501840f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp\" (UID: \"cb943a65-be98-437a-99fe-deea2501840f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:34.186974 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.186946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmzhx\" (UniqueName: \"kubernetes.io/projected/cb943a65-be98-437a-99fe-deea2501840f-kube-api-access-pmzhx\") pod \"payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp\" (UID: \"cb943a65-be98-437a-99fe-deea2501840f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:34.187188 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.186991    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-plugins-config-volume\") pod \"payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg\" (UID: \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\") " pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:34.187188 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.187042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsl4f\" (UniqueName: \"kubernetes.io/projected/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-kube-api-access-wsl4f\") pod \"payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg\" (UID: \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\") " pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:34.187865 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.187839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb943a65-be98-437a-99fe-deea2501840f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp\" (UID: \"cb943a65-be98-437a-99fe-deea2501840f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:34.195730 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.195702    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmzhx\" (UniqueName: \"kubernetes.io/projected/cb943a65-be98-437a-99fe-deea2501840f-kube-api-access-pmzhx\") pod \"payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp\" (UID: \"cb943a65-be98-437a-99fe-deea2501840f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:34.288592 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.288552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-plugins-config-volume\") pod \"payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg\" (UID: \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\") " pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:34.288704 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.288641    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsl4f\" (UniqueName: \"kubernetes.io/projected/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-kube-api-access-wsl4f\") pod \"payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg\" (UID: \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\") " pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:34.289322 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.289297    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-plugins-config-volume\") pod \"payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg\" (UID: \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\") " pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:34.292495 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.292476    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:34.299216 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.299195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsl4f\" (UniqueName: \"kubernetes.io/projected/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-kube-api-access-wsl4f\") pod \"payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg\" (UID: \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\") " pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:34.324191 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.324160    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:34.569280 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.569251    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"]
Sep 10 19:31:34.571779 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:31:34.571753    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb943a65_be98_437a_99fe_deea2501840f.slice/crio-cd93299c5bea84bcca5d3949a64a498c6f413298bf67ad239b996e0f88e30064 WatchSource:0}: Error finding container cd93299c5bea84bcca5d3949a64a498c6f413298bf67ad239b996e0f88e30064: Status 404 returned error can't find the container with id cd93299c5bea84bcca5d3949a64a498c6f413298bf67ad239b996e0f88e30064
Sep 10 19:31:34.611838 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.611810    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"]
Sep 10 19:31:34.619665 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:31:34.619634    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6f04f2_3dc0_4c60_bf22_9470f2a43af0.slice/crio-fab2bbf6e58bb25c4faa0b61b4f61a48efbc64b3d204f56954c6f5e78ac38cf8 WatchSource:0}: Error finding container fab2bbf6e58bb25c4faa0b61b4f61a48efbc64b3d204f56954c6f5e78ac38cf8: Status 404 returned error can't find the container with id fab2bbf6e58bb25c4faa0b61b4f61a48efbc64b3d204f56954c6f5e78ac38cf8
Sep 10 19:31:34.727593 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.727554    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k" event={"ID":"a1582eae-c261-4bfb-a8cc-1ae012c202dc","Type":"ContainerStarted","Data":"5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491"}
Sep 10 19:31:34.727758 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.727651    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k" event={"ID":"a1582eae-c261-4bfb-a8cc-1ae012c202dc","Type":"ContainerStarted","Data":"abf91a2dd4cf40322464892eab7a52c87d0c10e21496acc19b2971946bd88e1a"}
Sep 10 19:31:34.727758 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.727686    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:34.729324 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.729295    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg" event={"ID":"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0","Type":"ContainerStarted","Data":"bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4"}
Sep 10 19:31:34.729477 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.729355    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg" event={"ID":"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0","Type":"ContainerStarted","Data":"fab2bbf6e58bb25c4faa0b61b4f61a48efbc64b3d204f56954c6f5e78ac38cf8"}
Sep 10 19:31:34.729477 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.729446    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:34.730933 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.730906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp" event={"ID":"cb943a65-be98-437a-99fe-deea2501840f","Type":"ContainerStarted","Data":"1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d"}
Sep 10 19:31:34.731040 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.730952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp" event={"ID":"cb943a65-be98-437a-99fe-deea2501840f","Type":"ContainerStarted","Data":"cd93299c5bea84bcca5d3949a64a498c6f413298bf67ad239b996e0f88e30064"}
Sep 10 19:31:34.749050 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.749005    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k" podStartSLOduration=1.391581839 podStartE2EDuration="1.74899165s" totalImagesPullingTime="357.409811ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:31:34.74664836 +0000 UTC m=+946.602203405" watchObservedRunningTime="2026-09-10 19:31:34.74899165 +0000 UTC m=+946.604546679"
Sep 10 19:31:34.764315 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.764265    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp" podStartSLOduration=1.764249044 podStartE2EDuration="1.764249044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:31:34.763790904 +0000 UTC m=+946.619345958" watchObservedRunningTime="2026-09-10 19:31:34.764249044 +0000 UTC m=+946.619804090"
Sep 10 19:31:34.780831 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:34.780793    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg" podStartSLOduration=1.780779952 podStartE2EDuration="1.780779952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:31:34.779060791 +0000 UTC m=+946.634615821" watchObservedRunningTime="2026-09-10 19:31:34.780779952 +0000 UTC m=+946.636335005"
Sep 10 19:31:35.735475 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:35.735443    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:40.740276 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:40.740248    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:31:45.737875 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:45.737836    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:31:46.742333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:46.742301    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:31:48.073377 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:48.073343    2582 patch_prober.go:28] interesting pod/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:51098->10.134.0.34:15021: read: connection reset by peer" start-of-body=
Sep 10 19:31:48.073788 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:48.073548    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:51098->10.134.0.34:15021: read: connection reset by peer"
Sep 10 19:31:48.814438 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:48.814381    2582 generic.go:356] "Generic (PLEG): container finished" podID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerID="3e30956cff4b0994e615800005cd5bb1637ab61012bb4061eaeb49722601b237" exitCode=0
Sep 10 19:31:48.814607 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:48.814454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" event={"ID":"4819f0aa-cebb-420e-b75b-9472d4d9563f","Type":"ContainerDied","Data":"3e30956cff4b0994e615800005cd5bb1637ab61012bb4061eaeb49722601b237"}
Sep 10 19:31:48.814834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:48.814818    2582 scope.go:117] "RemoveContainer" containerID="3e30956cff4b0994e615800005cd5bb1637ab61012bb4061eaeb49722601b237"
Sep 10 19:31:48.815815 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:48.815787    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:31:48.815906 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:48.815853    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:31:48.815906 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:48.815884    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:31:49.820940 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:49.820902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" event={"ID":"4819f0aa-cebb-420e-b75b-9472d4d9563f","Type":"ContainerStarted","Data":"624c07780b144617a1f850ae6f6eb52f3f74c20e5c725b8b503e5f21fe2e8186"}
Sep 10 19:31:49.882434 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:49.882373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:49.883025 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:49.882996    2582 patch_prober.go:28] interesting pod/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 19:31:49.883221 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:49.883196    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 19:31:50.882958 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:50.882915    2582 patch_prober.go:28] interesting pod/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 19:31:50.883442 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:50.882984    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 19:31:51.882667 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:51.882622    2582 patch_prober.go:28] interesting pod/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 19:31:51.882867 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:51.882692    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 19:31:52.883141 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:52.883093    2582 patch_prober.go:28] interesting pod/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 19:31:52.883660 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:52.883166    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 19:31:53.883148 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:53.883100    2582 patch_prober.go:28] interesting pod/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 19:31:53.883674 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:53.883170    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 19:31:54.884438 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:54.883735    2582 patch_prober.go:28] interesting pod/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 19:31:54.884438 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:54.883798    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 19:31:55.886459 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:55.886427    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:55.886831 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:55.886748    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:55.887324 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:55.887307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:31:56.055984 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.055940    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"]
Sep 10 19:31:56.059713 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.059688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.061873 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.061851    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-9a4e54-serving-cert\""
Sep 10 19:31:56.069058 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.069028    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"]
Sep 10 19:31:56.171943 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.171866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb30701a-07cb-4888-968c-e2e44c174c11-openshift-service-ca\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.171943 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.171921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-maas-api-tls\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.172123 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.171943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk9q6\" (UniqueName: \"kubernetes.io/projected/fb30701a-07cb-4888-968c-e2e44c174c11-kube-api-access-lk9q6\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.172123 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.171984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-metrics-certs\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.272357 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.272322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb30701a-07cb-4888-968c-e2e44c174c11-openshift-service-ca\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.272558 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.272365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-maas-api-tls\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.272558 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.272388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk9q6\" (UniqueName: \"kubernetes.io/projected/fb30701a-07cb-4888-968c-e2e44c174c11-kube-api-access-lk9q6\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.272558 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.272491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-metrics-certs\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.273055 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.273031    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb30701a-07cb-4888-968c-e2e44c174c11-openshift-service-ca\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.274932 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.274907    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-maas-api-tls\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.275177 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.275154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-metrics-certs\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.280911 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.280891    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk9q6\" (UniqueName: \"kubernetes.io/projected/fb30701a-07cb-4888-968c-e2e44c174c11-kube-api-access-lk9q6\") pod \"maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.371904 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.371867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:56.645060 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.645034    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"]
Sep 10 19:31:56.647486 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:31:56.647456    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb30701a_07cb_4888_968c_e2e44c174c11.slice/crio-7eac826763bef3a29d1960594a768a1da1d34c9957292fa6ef697d5c470011ef WatchSource:0}: Error finding container 7eac826763bef3a29d1960594a768a1da1d34c9957292fa6ef697d5c470011ef: Status 404 returned error can't find the container with id 7eac826763bef3a29d1960594a768a1da1d34c9957292fa6ef697d5c470011ef
Sep 10 19:31:56.860384 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:56.860349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g" event={"ID":"fb30701a-07cb-4888-968c-e2e44c174c11","Type":"ContainerStarted","Data":"7eac826763bef3a29d1960594a768a1da1d34c9957292fa6ef697d5c470011ef"}
Sep 10 19:31:57.867456 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:57.867405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g" event={"ID":"fb30701a-07cb-4888-968c-e2e44c174c11","Type":"ContainerStarted","Data":"0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628"}
Sep 10 19:31:57.867834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:57.867765    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:31:57.886754 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:31:57.886704    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g" podStartSLOduration=1.274281924 podStartE2EDuration="1.886689743s" totalImagesPullingTime="612.407819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:31:57.884819282 +0000 UTC m=+969.740374322" watchObservedRunningTime="2026-09-10 19:31:57.886689743 +0000 UTC m=+969.742244811"
Sep 10 19:32:03.877354 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:03.877320    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:32:04.206685 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.206599    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"]
Sep 10 19:32:04.206882 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.206848    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k" podUID="a1582eae-c261-4bfb-a8cc-1ae012c202dc" containerName="maas-api" containerID="cri-o://5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491" gracePeriod=30
Sep 10 19:32:04.282543 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.282399    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"]
Sep 10 19:32:04.282769 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.282746    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg" podUID="fa6f04f2-3dc0-4c60-bf22-9470f2a43af0" containerName="payload-processing" containerID="cri-o://bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4" gracePeriod=30
Sep 10 19:32:04.288732 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.288704    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"]
Sep 10 19:32:04.288989 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.288944    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp" podUID="cb943a65-be98-437a-99fe-deea2501840f" containerName="payload-pre-processing" containerID="cri-o://1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d" gracePeriod=30
Sep 10 19:32:04.562217 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.562189    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:32:04.590457 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.590405    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:32:04.597961 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.597887    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:32:04.643627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643190    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrp7h\" (UniqueName: \"kubernetes.io/projected/a1582eae-c261-4bfb-a8cc-1ae012c202dc-kube-api-access-zrp7h\") pod \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") "
Sep 10 19:32:04.643627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643282    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1582eae-c261-4bfb-a8cc-1ae012c202dc-openshift-service-ca\") pod \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") "
Sep 10 19:32:04.643627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643310    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-metrics-certs\") pod \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") "
Sep 10 19:32:04.643627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643356    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb943a65-be98-437a-99fe-deea2501840f-plugins-config-volume\") pod \"cb943a65-be98-437a-99fe-deea2501840f\" (UID: \"cb943a65-be98-437a-99fe-deea2501840f\") "
Sep 10 19:32:04.643627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643380    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmzhx\" (UniqueName: \"kubernetes.io/projected/cb943a65-be98-437a-99fe-deea2501840f-kube-api-access-pmzhx\") pod \"cb943a65-be98-437a-99fe-deea2501840f\" (UID: \"cb943a65-be98-437a-99fe-deea2501840f\") "
Sep 10 19:32:04.643627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643435    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-plugins-config-volume\") pod \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\" (UID: \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\") "
Sep 10 19:32:04.643627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643495    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-maas-api-tls\") pod \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\" (UID: \"a1582eae-c261-4bfb-a8cc-1ae012c202dc\") "
Sep 10 19:32:04.643627 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643529    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsl4f\" (UniqueName: \"kubernetes.io/projected/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-kube-api-access-wsl4f\") pod \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\" (UID: \"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0\") "
Sep 10 19:32:04.644148 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643649    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1582eae-c261-4bfb-a8cc-1ae012c202dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1582eae-c261-4bfb-a8cc-1ae012c202dc" (UID: "a1582eae-c261-4bfb-a8cc-1ae012c202dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:32:04.644148 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.643812    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1582eae-c261-4bfb-a8cc-1ae012c202dc-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:04.646129 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.644462    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa6f04f2-3dc0-4c60-bf22-9470f2a43af0" (UID: "fa6f04f2-3dc0-4c60-bf22-9470f2a43af0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:32:04.646129 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.644848    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb943a65-be98-437a-99fe-deea2501840f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb943a65-be98-437a-99fe-deea2501840f" (UID: "cb943a65-be98-437a-99fe-deea2501840f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:32:04.648019 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.647985    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-kube-api-access-wsl4f" (OuterVolumeSpecName: "kube-api-access-wsl4f") pod "fa6f04f2-3dc0-4c60-bf22-9470f2a43af0" (UID: "fa6f04f2-3dc0-4c60-bf22-9470f2a43af0"). InnerVolumeSpecName "kube-api-access-wsl4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:32:04.649691 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.649654    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1582eae-c261-4bfb-a8cc-1ae012c202dc" (UID: "a1582eae-c261-4bfb-a8cc-1ae012c202dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:32:04.649803 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.649662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb943a65-be98-437a-99fe-deea2501840f-kube-api-access-pmzhx" (OuterVolumeSpecName: "kube-api-access-pmzhx") pod "cb943a65-be98-437a-99fe-deea2501840f" (UID: "cb943a65-be98-437a-99fe-deea2501840f"). InnerVolumeSpecName "kube-api-access-pmzhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:32:04.649803 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.649702    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a1582eae-c261-4bfb-a8cc-1ae012c202dc" (UID: "a1582eae-c261-4bfb-a8cc-1ae012c202dc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:32:04.649803 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.649715    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1582eae-c261-4bfb-a8cc-1ae012c202dc-kube-api-access-zrp7h" (OuterVolumeSpecName: "kube-api-access-zrp7h") pod "a1582eae-c261-4bfb-a8cc-1ae012c202dc" (UID: "a1582eae-c261-4bfb-a8cc-1ae012c202dc"). InnerVolumeSpecName "kube-api-access-zrp7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:32:04.694169 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.694137    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"]
Sep 10 19:32:04.694382 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.694359    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy" containerID="cri-o://624c07780b144617a1f850ae6f6eb52f3f74c20e5c725b8b503e5f21fe2e8186" gracePeriod=30
Sep 10 19:32:04.744740 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.744708    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:04.744740 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.744732    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb943a65-be98-437a-99fe-deea2501840f-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:04.744740 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.744741    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmzhx\" (UniqueName: \"kubernetes.io/projected/cb943a65-be98-437a-99fe-deea2501840f-kube-api-access-pmzhx\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:04.744933 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.744751    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:04.744933 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.744759    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1582eae-c261-4bfb-a8cc-1ae012c202dc-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:04.744933 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.744768    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsl4f\" (UniqueName: \"kubernetes.io/projected/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0-kube-api-access-wsl4f\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:04.744933 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.744776    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrp7h\" (UniqueName: \"kubernetes.io/projected/a1582eae-c261-4bfb-a8cc-1ae012c202dc-kube-api-access-zrp7h\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:04.899378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.899339    2582 generic.go:356] "Generic (PLEG): container finished" podID="fa6f04f2-3dc0-4c60-bf22-9470f2a43af0" containerID="bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4" exitCode=0
Sep 10 19:32:04.899850 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.899388    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"
Sep 10 19:32:04.899850 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.899405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg" event={"ID":"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0","Type":"ContainerDied","Data":"bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4"}
Sep 10 19:32:04.899850 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.899488    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg" event={"ID":"fa6f04f2-3dc0-4c60-bf22-9470f2a43af0","Type":"ContainerDied","Data":"fab2bbf6e58bb25c4faa0b61b4f61a48efbc64b3d204f56954c6f5e78ac38cf8"}
Sep 10 19:32:04.899850 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.899525    2582 scope.go:117] "RemoveContainer" containerID="bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4"
Sep 10 19:32:04.900834 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.900813    2582 generic.go:356] "Generic (PLEG): container finished" podID="cb943a65-be98-437a-99fe-deea2501840f" containerID="1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d" exitCode=0
Sep 10 19:32:04.900930 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.900908    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"
Sep 10 19:32:04.901004 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.900904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp" event={"ID":"cb943a65-be98-437a-99fe-deea2501840f","Type":"ContainerDied","Data":"1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d"}
Sep 10 19:32:04.901266 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.901061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp" event={"ID":"cb943a65-be98-437a-99fe-deea2501840f","Type":"ContainerDied","Data":"cd93299c5bea84bcca5d3949a64a498c6f413298bf67ad239b996e0f88e30064"}
Sep 10 19:32:04.902544 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.902518    2582 generic.go:356] "Generic (PLEG): container finished" podID="a1582eae-c261-4bfb-a8cc-1ae012c202dc" containerID="5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491" exitCode=0
Sep 10 19:32:04.902666 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.902566    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"
Sep 10 19:32:04.902666 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.902572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k" event={"ID":"a1582eae-c261-4bfb-a8cc-1ae012c202dc","Type":"ContainerDied","Data":"5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491"}
Sep 10 19:32:04.902666 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.902626    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k" event={"ID":"a1582eae-c261-4bfb-a8cc-1ae012c202dc","Type":"ContainerDied","Data":"abf91a2dd4cf40322464892eab7a52c87d0c10e21496acc19b2971946bd88e1a"}
Sep 10 19:32:04.909267 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.909252    2582 scope.go:117] "RemoveContainer" containerID="bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4"
Sep 10 19:32:04.909533 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:32:04.909513    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4\": container with ID starting with bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4 not found: ID does not exist" containerID="bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4"
Sep 10 19:32:04.909579 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.909541    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4"} err="failed to get container status \"bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4\": rpc error: code = NotFound desc = could not find container \"bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4\": container with ID starting with bbe25920aba4e083e7c122a89f10d2cdd7bd2151dcec5a1252f9bfabb2d431e4 not found: ID does not exist"
Sep 10 19:32:04.909579 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.909557    2582 scope.go:117] "RemoveContainer" containerID="1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d"
Sep 10 19:32:04.916864 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.916846    2582 scope.go:117] "RemoveContainer" containerID="1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d"
Sep 10 19:32:04.917108 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:32:04.917089    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d\": container with ID starting with 1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d not found: ID does not exist" containerID="1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d"
Sep 10 19:32:04.917164 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.917115    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d"} err="failed to get container status \"1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d\": rpc error: code = NotFound desc = could not find container \"1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d\": container with ID starting with 1a79a88ba4f987a9a25e588bef91a7c67491de7eafe76529508c827c011e025d not found: ID does not exist"
Sep 10 19:32:04.917164 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.917130    2582 scope.go:117] "RemoveContainer" containerID="5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491"
Sep 10 19:32:04.923727 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.923702    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"]
Sep 10 19:32:04.924707 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.924694    2582 scope.go:117] "RemoveContainer" containerID="5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491"
Sep 10 19:32:04.924972 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:32:04.924957    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491\": container with ID starting with 5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491 not found: ID does not exist" containerID="5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491"
Sep 10 19:32:04.925038 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.924977    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491"} err="failed to get container status \"5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491\": rpc error: code = NotFound desc = could not find container \"5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491\": container with ID starting with 5c9a17a6c280fe0341bfa757d56ff06e41875d5d02c8e386ea82b3f9ddc2c491 not found: ID does not exist"
Sep 10 19:32:04.930675 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.930627    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-34de9e5b-6d86689798-fh2jp"]
Sep 10 19:32:04.948178 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.948157    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"]
Sep 10 19:32:04.951339 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.951318    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-34de9e5b-cbd565dcd-dvq6k"]
Sep 10 19:32:04.963300 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.963280    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"]
Sep 10 19:32:04.968347 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:04.968327    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-34de9e5b-559db8788f-xjgsg"]
Sep 10 19:32:06.669561 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:06.669519    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1582eae-c261-4bfb-a8cc-1ae012c202dc" path="/var/lib/kubelet/pods/a1582eae-c261-4bfb-a8cc-1ae012c202dc/volumes"
Sep 10 19:32:06.670023 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:06.670006    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb943a65-be98-437a-99fe-deea2501840f" path="/var/lib/kubelet/pods/cb943a65-be98-437a-99fe-deea2501840f/volumes"
Sep 10 19:32:06.670459 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:06.670443    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa6f04f2-3dc0-4c60-bf22-9470f2a43af0" path="/var/lib/kubelet/pods/fa6f04f2-3dc0-4c60-bf22-9470f2a43af0/volumes"
Sep 10 19:32:09.929229 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.929200    2582 generic.go:356] "Generic (PLEG): container finished" podID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerID="624c07780b144617a1f850ae6f6eb52f3f74c20e5c725b8b503e5f21fe2e8186" exitCode=0
Sep 10 19:32:09.929569 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.929278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" event={"ID":"4819f0aa-cebb-420e-b75b-9472d4d9563f","Type":"ContainerDied","Data":"624c07780b144617a1f850ae6f6eb52f3f74c20e5c725b8b503e5f21fe2e8186"}
Sep 10 19:32:09.929569 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.929347    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk" event={"ID":"4819f0aa-cebb-420e-b75b-9472d4d9563f","Type":"ContainerDied","Data":"be7fad78a8843cde4c2b86317309fcd4df006e7ef53d4ab783d4c85279bd0f28"}
Sep 10 19:32:09.929569 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.929371    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be7fad78a8843cde4c2b86317309fcd4df006e7ef53d4ab783d4c85279bd0f28"
Sep 10 19:32:09.929569 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.929392    2582 scope.go:117] "RemoveContainer" containerID="3e30956cff4b0994e615800005cd5bb1637ab61012bb4061eaeb49722601b237"
Sep 10 19:32:09.938754 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.938733    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:32:09.983436 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983349    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-socket\") pod \"4819f0aa-cebb-420e-b75b-9472d4d9563f\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") "
Sep 10 19:32:09.983436 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983387    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-podinfo\") pod \"4819f0aa-cebb-420e-b75b-9472d4d9563f\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") "
Sep 10 19:32:09.983652 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983445    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j28s\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-kube-api-access-4j28s\") pod \"4819f0aa-cebb-420e-b75b-9472d4d9563f\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") "
Sep 10 19:32:09.983652 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983465    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-token\") pod \"4819f0aa-cebb-420e-b75b-9472d4d9563f\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") "
Sep 10 19:32:09.983652 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983484    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-credential-socket\") pod \"4819f0aa-cebb-420e-b75b-9472d4d9563f\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") "
Sep 10 19:32:09.983652 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983514    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-certs\") pod \"4819f0aa-cebb-420e-b75b-9472d4d9563f\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") "
Sep 10 19:32:09.983652 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983553    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4819f0aa-cebb-420e-b75b-9472d4d9563f-istiod-ca-cert\") pod \"4819f0aa-cebb-420e-b75b-9472d4d9563f\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") "
Sep 10 19:32:09.983652 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983596    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-data\") pod \"4819f0aa-cebb-420e-b75b-9472d4d9563f\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") "
Sep 10 19:32:09.983652 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983638    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-envoy\") pod \"4819f0aa-cebb-420e-b75b-9472d4d9563f\" (UID: \"4819f0aa-cebb-420e-b75b-9472d4d9563f\") "
Sep 10 19:32:09.983995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983849    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4819f0aa-cebb-420e-b75b-9472d4d9563f" (UID: "4819f0aa-cebb-420e-b75b-9472d4d9563f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:32:09.983995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983862    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4819f0aa-cebb-420e-b75b-9472d4d9563f" (UID: "4819f0aa-cebb-420e-b75b-9472d4d9563f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:32:09.983995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983943    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4819f0aa-cebb-420e-b75b-9472d4d9563f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4819f0aa-cebb-420e-b75b-9472d4d9563f" (UID: "4819f0aa-cebb-420e-b75b-9472d4d9563f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:32:09.983995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.983959    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4819f0aa-cebb-420e-b75b-9472d4d9563f" (UID: "4819f0aa-cebb-420e-b75b-9472d4d9563f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:32:09.984195 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.984102    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-data" (OuterVolumeSpecName: "istio-data") pod "4819f0aa-cebb-420e-b75b-9472d4d9563f" (UID: "4819f0aa-cebb-420e-b75b-9472d4d9563f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:32:09.985762 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.985723    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4819f0aa-cebb-420e-b75b-9472d4d9563f" (UID: "4819f0aa-cebb-420e-b75b-9472d4d9563f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:32:09.985916 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.985818    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4819f0aa-cebb-420e-b75b-9472d4d9563f" (UID: "4819f0aa-cebb-420e-b75b-9472d4d9563f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:32:09.985916 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.985833    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-kube-api-access-4j28s" (OuterVolumeSpecName: "kube-api-access-4j28s") pod "4819f0aa-cebb-420e-b75b-9472d4d9563f" (UID: "4819f0aa-cebb-420e-b75b-9472d4d9563f"). InnerVolumeSpecName "kube-api-access-4j28s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:32:09.985916 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:09.985844    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4819f0aa-cebb-420e-b75b-9472d4d9563f" (UID: "4819f0aa-cebb-420e-b75b-9472d4d9563f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:32:10.084805 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.084768    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j28s\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-kube-api-access-4j28s\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:10.084805 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.084800    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-token\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:10.084805 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.084813    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-credential-socket\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:10.085217 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.084825    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:10.085217 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.084835    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4819f0aa-cebb-420e-b75b-9472d4d9563f-istiod-ca-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:10.085217 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.084844    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-data\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:10.085217 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.084851    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-envoy\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:10.085217 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.084859    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4819f0aa-cebb-420e-b75b-9472d4d9563f-workload-socket\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:10.085217 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.084866    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4819f0aa-cebb-420e-b75b-9472d4d9563f-istio-podinfo\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:10.934982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.934873    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"
Sep 10 19:32:10.971237 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.971206    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"]
Sep 10 19:32:10.977795 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:10.977760    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-34de9e5b-openshift-default-6d544f5496-74clk"]
Sep 10 19:32:12.667921 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:12.667878    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" path="/var/lib/kubelet/pods/4819f0aa-cebb-420e-b75b-9472d4d9563f/volumes"
Sep 10 19:32:50.643853 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.643819    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"]
Sep 10 19:32:50.644313 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.644084    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g" podUID="fb30701a-07cb-4888-968c-e2e44c174c11" containerName="maas-api" containerID="cri-o://0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628" gracePeriod=30
Sep 10 19:32:50.887133 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.887102    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:32:50.923465 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.923387    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-metrics-certs\") pod \"fb30701a-07cb-4888-968c-e2e44c174c11\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") "
Sep 10 19:32:50.923582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.923466    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb30701a-07cb-4888-968c-e2e44c174c11-openshift-service-ca\") pod \"fb30701a-07cb-4888-968c-e2e44c174c11\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") "
Sep 10 19:32:50.923582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.923514    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk9q6\" (UniqueName: \"kubernetes.io/projected/fb30701a-07cb-4888-968c-e2e44c174c11-kube-api-access-lk9q6\") pod \"fb30701a-07cb-4888-968c-e2e44c174c11\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") "
Sep 10 19:32:50.923701 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.923588    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-maas-api-tls\") pod \"fb30701a-07cb-4888-968c-e2e44c174c11\" (UID: \"fb30701a-07cb-4888-968c-e2e44c174c11\") "
Sep 10 19:32:50.923854 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.923831    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb30701a-07cb-4888-968c-e2e44c174c11-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb30701a-07cb-4888-968c-e2e44c174c11" (UID: "fb30701a-07cb-4888-968c-e2e44c174c11"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:32:50.925495 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.925465    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fb30701a-07cb-4888-968c-e2e44c174c11" (UID: "fb30701a-07cb-4888-968c-e2e44c174c11"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:32:50.925580 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.925537    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb30701a-07cb-4888-968c-e2e44c174c11" (UID: "fb30701a-07cb-4888-968c-e2e44c174c11"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:32:50.925933 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:50.925912    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb30701a-07cb-4888-968c-e2e44c174c11-kube-api-access-lk9q6" (OuterVolumeSpecName: "kube-api-access-lk9q6") pod "fb30701a-07cb-4888-968c-e2e44c174c11" (UID: "fb30701a-07cb-4888-968c-e2e44c174c11"). InnerVolumeSpecName "kube-api-access-lk9q6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:32:51.024740 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.024702    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk9q6\" (UniqueName: \"kubernetes.io/projected/fb30701a-07cb-4888-968c-e2e44c174c11-kube-api-access-lk9q6\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:51.024740 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.024744    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:51.024924 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.024759    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb30701a-07cb-4888-968c-e2e44c174c11-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:51.024924 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.024772    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb30701a-07cb-4888-968c-e2e44c174c11-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:32:51.115835 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.115800    2582 generic.go:356] "Generic (PLEG): container finished" podID="fb30701a-07cb-4888-968c-e2e44c174c11" containerID="0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628" exitCode=0
Sep 10 19:32:51.115994 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.115845    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"
Sep 10 19:32:51.115994 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.115856    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g" event={"ID":"fb30701a-07cb-4888-968c-e2e44c174c11","Type":"ContainerDied","Data":"0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628"}
Sep 10 19:32:51.115994 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.115921    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g" event={"ID":"fb30701a-07cb-4888-968c-e2e44c174c11","Type":"ContainerDied","Data":"7eac826763bef3a29d1960594a768a1da1d34c9957292fa6ef697d5c470011ef"}
Sep 10 19:32:51.115994 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.115942    2582 scope.go:117] "RemoveContainer" containerID="0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628"
Sep 10 19:32:51.125373 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.125354    2582 scope.go:117] "RemoveContainer" containerID="0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628"
Sep 10 19:32:51.125668 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:32:51.125648    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628\": container with ID starting with 0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628 not found: ID does not exist" containerID="0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628"
Sep 10 19:32:51.125728 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.125678    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628"} err="failed to get container status \"0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628\": rpc error: code = NotFound desc = could not find container \"0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628\": container with ID starting with 0001e3a8c988d4f7291f3a6a7877a9423d5607aad73a050acaddcba7542f2628 not found: ID does not exist"
Sep 10 19:32:51.139795 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.139767    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"]
Sep 10 19:32:51.146225 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:51.146206    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9a4e54-6d85768b7d-bc89g"]
Sep 10 19:32:52.668507 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:52.668474    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb30701a-07cb-4888-968c-e2e44c174c11" path="/var/lib/kubelet/pods/fb30701a-07cb-4888-968c-e2e44c174c11/volumes"
Sep 10 19:32:58.977333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977300    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"]
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977630    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb30701a-07cb-4888-968c-e2e44c174c11" containerName="maas-api"
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977644    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb30701a-07cb-4888-968c-e2e44c174c11" containerName="maas-api"
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977654    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy"
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977662    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy"
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977679    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6f04f2-3dc0-4c60-bf22-9470f2a43af0" containerName="payload-processing"
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977687    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6f04f2-3dc0-4c60-bf22-9470f2a43af0" containerName="payload-processing"
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977702    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1582eae-c261-4bfb-a8cc-1ae012c202dc" containerName="maas-api"
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977707    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1582eae-c261-4bfb-a8cc-1ae012c202dc" containerName="maas-api"
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977715    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb943a65-be98-437a-99fe-deea2501840f" containerName="payload-pre-processing"
Sep 10 19:32:58.977739 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977720    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb943a65-be98-437a-99fe-deea2501840f" containerName="payload-pre-processing"
Sep 10 19:32:58.978131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977777    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy"
Sep 10 19:32:58.978131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977785    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb943a65-be98-437a-99fe-deea2501840f" containerName="payload-pre-processing"
Sep 10 19:32:58.978131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977791    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb30701a-07cb-4888-968c-e2e44c174c11" containerName="maas-api"
Sep 10 19:32:58.978131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977799    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy"
Sep 10 19:32:58.978131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977804    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1582eae-c261-4bfb-a8cc-1ae012c202dc" containerName="maas-api"
Sep 10 19:32:58.978131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.977812    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6f04f2-3dc0-4c60-bf22-9470f2a43af0" containerName="payload-processing"
Sep 10 19:32:58.980634 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.980616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:58.983226 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.983204    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-4c1277-openshift-default-dockercfg-rn5r7\""
Sep 10 19:32:58.992580 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:58.992556    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"]
Sep 10 19:32:59.086218 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.086186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-data\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.086432 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.086248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-credential-socket\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.086432 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.086332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-token\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.086432 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.086377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb88f\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-kube-api-access-sb88f\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.086606 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.086491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-podinfo\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.086606 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.086530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-envoy\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.086606 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.086573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istiod-ca-cert\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.086606 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.086603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-socket\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.086768 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.086634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-certs\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.187516 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-credential-socket\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.187516 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-token\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.187755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb88f\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-kube-api-access-sb88f\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.187755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187578    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-podinfo\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.187755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-envoy\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.187755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istiod-ca-cert\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.187755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-socket\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.187755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-certs\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.187755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-data\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.188105 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187959    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-credential-socket\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.188105 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.187996    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-data\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.188217 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.188177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-socket\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.188266 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.188216    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-certs\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.188407 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.188385    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istiod-ca-cert\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.189934 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.189905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-envoy\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.190121 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.190097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-podinfo\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.196619 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.196598    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-token\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.196906 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.196885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb88f\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-kube-api-access-sb88f\") pod \"e2e-noten-4c1277-openshift-default-56b6867864-czlgj\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") " pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.291629 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.291595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:32:59.565686 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.565660    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"]
Sep 10 19:32:59.568122 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:32:59.568089    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167f550f_d4c2_462a_bcbe_a8afc429e1c5.slice/crio-f8df2689c786339c4583f83a9f46fe8d15a86295e74be0bae257bcddfc3e416e WatchSource:0}: Error finding container f8df2689c786339c4583f83a9f46fe8d15a86295e74be0bae257bcddfc3e416e: Status 404 returned error can't find the container with id f8df2689c786339c4583f83a9f46fe8d15a86295e74be0bae257bcddfc3e416e
Sep 10 19:32:59.570447 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.570386    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:32:59.570532 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.570491    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:32:59.570576 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:32:59.570530    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:33:00.158406 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:00.158370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj" event={"ID":"167f550f-d4c2-462a-bcbe-a8afc429e1c5","Type":"ContainerStarted","Data":"bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6"}
Sep 10 19:33:00.158821 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:00.158441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj" event={"ID":"167f550f-d4c2-462a-bcbe-a8afc429e1c5","Type":"ContainerStarted","Data":"f8df2689c786339c4583f83a9f46fe8d15a86295e74be0bae257bcddfc3e416e"}
Sep 10 19:33:00.180664 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:00.180618    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj" podStartSLOduration=2.180602473 podStartE2EDuration="2.180602473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:33:00.179350002 +0000 UTC m=+1032.034905045" watchObservedRunningTime="2026-09-10 19:33:00.180602473 +0000 UTC m=+1032.036157501"
Sep 10 19:33:00.292938 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:00.292845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:33:00.305928 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:00.305898    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:33:01.163429 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:01.163386    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:33:01.164478 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:01.164456    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:33:21.197000 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:21.196957    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"]
Sep 10 19:33:21.197553 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:21.197204    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj" podUID="167f550f-d4c2-462a-bcbe-a8afc429e1c5" containerName="istio-proxy" containerID="cri-o://bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6" gracePeriod=30
Sep 10 19:33:26.428049 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.428025    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:33:26.523976 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.523946    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-envoy\") pod \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") "
Sep 10 19:33:26.524167 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524019    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb88f\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-kube-api-access-sb88f\") pod \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") "
Sep 10 19:33:26.524167 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524058    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-podinfo\") pod \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") "
Sep 10 19:33:26.524167 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524074    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-socket\") pod \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") "
Sep 10 19:33:26.524167 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-credential-socket\") pod \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") "
Sep 10 19:33:26.524167 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524117    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-certs\") pod \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") "
Sep 10 19:33:26.524167 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524150    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-token\") pod \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") "
Sep 10 19:33:26.524520 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524177    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-data\") pod \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") "
Sep 10 19:33:26.524520 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524199    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istiod-ca-cert\") pod \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\" (UID: \"167f550f-d4c2-462a-bcbe-a8afc429e1c5\") "
Sep 10 19:33:26.524520 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524467    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "167f550f-d4c2-462a-bcbe-a8afc429e1c5" (UID: "167f550f-d4c2-462a-bcbe-a8afc429e1c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:33:26.524662 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524603    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "167f550f-d4c2-462a-bcbe-a8afc429e1c5" (UID: "167f550f-d4c2-462a-bcbe-a8afc429e1c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:33:26.524662 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524626    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "167f550f-d4c2-462a-bcbe-a8afc429e1c5" (UID: "167f550f-d4c2-462a-bcbe-a8afc429e1c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:33:26.524830 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524808    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "167f550f-d4c2-462a-bcbe-a8afc429e1c5" (UID: "167f550f-d4c2-462a-bcbe-a8afc429e1c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:33:26.524889 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.524810    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "167f550f-d4c2-462a-bcbe-a8afc429e1c5" (UID: "167f550f-d4c2-462a-bcbe-a8afc429e1c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:33:26.526400 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.526374    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-kube-api-access-sb88f" (OuterVolumeSpecName: "kube-api-access-sb88f") pod "167f550f-d4c2-462a-bcbe-a8afc429e1c5" (UID: "167f550f-d4c2-462a-bcbe-a8afc429e1c5"). InnerVolumeSpecName "kube-api-access-sb88f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:33:26.526517 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.526397    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "167f550f-d4c2-462a-bcbe-a8afc429e1c5" (UID: "167f550f-d4c2-462a-bcbe-a8afc429e1c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:33:26.526517 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.526449    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "167f550f-d4c2-462a-bcbe-a8afc429e1c5" (UID: "167f550f-d4c2-462a-bcbe-a8afc429e1c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:33:26.526517 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.526494    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "167f550f-d4c2-462a-bcbe-a8afc429e1c5" (UID: "167f550f-d4c2-462a-bcbe-a8afc429e1c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:33:26.625354 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.625311    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-podinfo\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:33:26.625354 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.625345    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-socket\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:33:26.625354 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.625354    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-credential-socket\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:33:26.625354 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.625364    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-workload-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:33:26.625639 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.625372    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-token\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:33:26.625639 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.625380    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-data\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:33:26.625639 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.625388    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istiod-ca-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:33:26.625639 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.625395    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/167f550f-d4c2-462a-bcbe-a8afc429e1c5-istio-envoy\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:33:26.625639 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:26.625403    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb88f\" (UniqueName: \"kubernetes.io/projected/167f550f-d4c2-462a-bcbe-a8afc429e1c5-kube-api-access-sb88f\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:33:27.279482 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:27.279406    2582 generic.go:356] "Generic (PLEG): container finished" podID="167f550f-d4c2-462a-bcbe-a8afc429e1c5" containerID="bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6" exitCode=0
Sep 10 19:33:27.279482 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:27.279481    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"
Sep 10 19:33:27.279749 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:27.279512    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj" event={"ID":"167f550f-d4c2-462a-bcbe-a8afc429e1c5","Type":"ContainerDied","Data":"bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6"}
Sep 10 19:33:27.279749 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:27.279565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj" event={"ID":"167f550f-d4c2-462a-bcbe-a8afc429e1c5","Type":"ContainerDied","Data":"f8df2689c786339c4583f83a9f46fe8d15a86295e74be0bae257bcddfc3e416e"}
Sep 10 19:33:27.279749 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:27.279579    2582 scope.go:117] "RemoveContainer" containerID="bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6"
Sep 10 19:33:27.289833 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:27.289799    2582 scope.go:117] "RemoveContainer" containerID="bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6"
Sep 10 19:33:27.290251 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:33:27.290230    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6\": container with ID starting with bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6 not found: ID does not exist" containerID="bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6"
Sep 10 19:33:27.290333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:27.290264    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6"} err="failed to get container status \"bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6\": rpc error: code = NotFound desc = could not find container \"bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6\": container with ID starting with bd09b7d4e5644ad48e6211ebb7c834f0edc29572a56d150fb2911ac8ea7934f6 not found: ID does not exist"
Sep 10 19:33:27.300971 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:27.300945    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"]
Sep 10 19:33:27.303786 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:27.303763    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-4c1277-openshift-default-56b6867864-czlgj"]
Sep 10 19:33:28.668396 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:28.668355    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="167f550f-d4c2-462a-bcbe-a8afc429e1c5" path="/var/lib/kubelet/pods/167f550f-d4c2-462a-bcbe-a8afc429e1c5/volumes"
Sep 10 19:33:44.563724 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.563644    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"]
Sep 10 19:33:44.564083 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.563966    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="167f550f-d4c2-462a-bcbe-a8afc429e1c5" containerName="istio-proxy"
Sep 10 19:33:44.564083 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.563978    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="167f550f-d4c2-462a-bcbe-a8afc429e1c5" containerName="istio-proxy"
Sep 10 19:33:44.564083 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.563991    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy"
Sep 10 19:33:44.564083 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.563997    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4819f0aa-cebb-420e-b75b-9472d4d9563f" containerName="istio-proxy"
Sep 10 19:33:44.564083 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.564060    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="167f550f-d4c2-462a-bcbe-a8afc429e1c5" containerName="istio-proxy"
Sep 10 19:33:44.566917 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.566896    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.576744 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.576725    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cecfebe7-openshift-default-dockercfg-bjwnv\""
Sep 10 19:33:44.579560 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.579538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-certs\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.579661 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.579573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-credential-socket\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.579661 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.579611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-envoy\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.579661 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.579639    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-socket\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.579787 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.579674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd596\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-kube-api-access-fd596\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.579787 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.579702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-data\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.579787 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.579727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-podinfo\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.579787 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.579744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-token\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.579787 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.579764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istiod-ca-cert\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.599818 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.599790    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"]
Sep 10 19:33:44.680158 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-envoy\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680158 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-socket\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680460 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd596\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-kube-api-access-fd596\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680460 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-data\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680460 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-podinfo\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680460 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-token\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680460 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istiod-ca-cert\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680460 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-certs\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680460 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-credential-socket\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680821 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-socket\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680821 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680703    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-data\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680821 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-credential-socket\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.680977 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.680901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-certs\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.681070 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.681045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istiod-ca-cert\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.682576 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.682555    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-envoy\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.682716 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.682699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-podinfo\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.691972 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.691950    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-token\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.700619 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.700598    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd596\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-kube-api-access-fd596\") pod \"e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") " pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:44.876292 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:44.876204    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:45.161580 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:45.161553    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"]
Sep 10 19:33:45.164112 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:33:45.164074    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11c9ab9_f6b0_4954_be94_d586e6df08b5.slice/crio-5179e1b3c5f983c635e6216e1a994ea46060dc51766b67cee11fd8aaecb3b7b2 WatchSource:0}: Error finding container 5179e1b3c5f983c635e6216e1a994ea46060dc51766b67cee11fd8aaecb3b7b2: Status 404 returned error can't find the container with id 5179e1b3c5f983c635e6216e1a994ea46060dc51766b67cee11fd8aaecb3b7b2
Sep 10 19:33:45.166133 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:45.166101    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:33:45.166192 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:45.166179    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:33:45.166229 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:45.166210    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:33:45.361465 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:45.361430    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" event={"ID":"f11c9ab9-f6b0-4954-be94-d586e6df08b5","Type":"ContainerStarted","Data":"58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757"}
Sep 10 19:33:45.361638 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:45.361481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" event={"ID":"f11c9ab9-f6b0-4954-be94-d586e6df08b5","Type":"ContainerStarted","Data":"5179e1b3c5f983c635e6216e1a994ea46060dc51766b67cee11fd8aaecb3b7b2"}
Sep 10 19:33:45.387543 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:45.387485    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" podStartSLOduration=1.387467394 podStartE2EDuration="1.387467394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:33:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:33:45.38599081 +0000 UTC m=+1077.241545859" watchObservedRunningTime="2026-09-10 19:33:45.387467394 +0000 UTC m=+1077.243022422"
Sep 10 19:33:45.877232 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:45.877194    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:46.882422 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:46.882379    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:47.370498 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:47.370464    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:47.371469 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:47.371449    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:33:48.616052 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.616013    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"]
Sep 10 19:33:48.618368 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.618343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.621205 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.621180    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cecfebe7-serving-cert\""
Sep 10 19:33:48.637068 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.637041    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"]
Sep 10 19:33:48.713625 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.713584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-maas-api-tls\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.713815 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.713740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nq5z\" (UniqueName: \"kubernetes.io/projected/dd74db11-3389-4738-90e6-29633b1f1197-kube-api-access-2nq5z\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.713888 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.713851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd74db11-3389-4738-90e6-29633b1f1197-openshift-service-ca\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.713953 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.713942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-metrics-certs\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.814354 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.814316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-metrics-certs\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.814549 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.814384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-maas-api-tls\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.814549 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.814432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nq5z\" (UniqueName: \"kubernetes.io/projected/dd74db11-3389-4738-90e6-29633b1f1197-kube-api-access-2nq5z\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.814549 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.814462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd74db11-3389-4738-90e6-29633b1f1197-openshift-service-ca\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.815197 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.815170    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd74db11-3389-4738-90e6-29633b1f1197-openshift-service-ca\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.816982 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.816956    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-maas-api-tls\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.817076 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.817017    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-metrics-certs\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.825909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.825887    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nq5z\" (UniqueName: \"kubernetes.io/projected/dd74db11-3389-4738-90e6-29633b1f1197-kube-api-access-2nq5z\") pod \"maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:48.930209 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:48.930118    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:49.215290 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:49.215259    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"]
Sep 10 19:33:49.217807 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:33:49.217773    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd74db11_3389_4738_90e6_29633b1f1197.slice/crio-f78c20d22573025c5153f3be4b831e18958c7d122aa06b3e2d409f8b9ba38646 WatchSource:0}: Error finding container f78c20d22573025c5153f3be4b831e18958c7d122aa06b3e2d409f8b9ba38646: Status 404 returned error can't find the container with id f78c20d22573025c5153f3be4b831e18958c7d122aa06b3e2d409f8b9ba38646
Sep 10 19:33:49.379948 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:49.379910    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx" event={"ID":"dd74db11-3389-4738-90e6-29633b1f1197","Type":"ContainerStarted","Data":"f78c20d22573025c5153f3be4b831e18958c7d122aa06b3e2d409f8b9ba38646"}
Sep 10 19:33:50.386601 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:50.386569    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx" event={"ID":"dd74db11-3389-4738-90e6-29633b1f1197","Type":"ContainerStarted","Data":"d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c"}
Sep 10 19:33:50.386992 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:50.386676    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:33:50.428311 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:50.428256    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx" podStartSLOduration=2.005496919 podStartE2EDuration="2.428239618s" totalImagesPullingTime="422.742699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:33:50.427223268 +0000 UTC m=+1082.282778297" watchObservedRunningTime="2026-09-10 19:33:50.428239618 +0000 UTC m=+1082.283794648"
Sep 10 19:33:56.396374 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:33:56.396341    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:34:03.422999 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.422960    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"]
Sep 10 19:34:03.423389 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.423254    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl" podUID="59821bad-d9da-4dd8-9114-9c9b16358b9d" containerName="maas-api" containerID="cri-o://2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564" gracePeriod=30
Sep 10 19:34:03.677656 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.677587    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:34:03.753962 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.753922    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59821bad-d9da-4dd8-9114-9c9b16358b9d-openshift-service-ca\") pod \"59821bad-d9da-4dd8-9114-9c9b16358b9d\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") "
Sep 10 19:34:03.753962 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.753966    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-maas-api-tls\") pod \"59821bad-d9da-4dd8-9114-9c9b16358b9d\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") "
Sep 10 19:34:03.754215 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.754003    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-metrics-certs\") pod \"59821bad-d9da-4dd8-9114-9c9b16358b9d\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") "
Sep 10 19:34:03.754215 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.754054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs82f\" (UniqueName: \"kubernetes.io/projected/59821bad-d9da-4dd8-9114-9c9b16358b9d-kube-api-access-zs82f\") pod \"59821bad-d9da-4dd8-9114-9c9b16358b9d\" (UID: \"59821bad-d9da-4dd8-9114-9c9b16358b9d\") "
Sep 10 19:34:03.754396 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.754367    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59821bad-d9da-4dd8-9114-9c9b16358b9d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59821bad-d9da-4dd8-9114-9c9b16358b9d" (UID: "59821bad-d9da-4dd8-9114-9c9b16358b9d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:34:03.756370 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.756342    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59821bad-d9da-4dd8-9114-9c9b16358b9d" (UID: "59821bad-d9da-4dd8-9114-9c9b16358b9d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:34:03.756682 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.756650    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59821bad-d9da-4dd8-9114-9c9b16358b9d-kube-api-access-zs82f" (OuterVolumeSpecName: "kube-api-access-zs82f") pod "59821bad-d9da-4dd8-9114-9c9b16358b9d" (UID: "59821bad-d9da-4dd8-9114-9c9b16358b9d"). InnerVolumeSpecName "kube-api-access-zs82f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:34:03.756682 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.756675    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "59821bad-d9da-4dd8-9114-9c9b16358b9d" (UID: "59821bad-d9da-4dd8-9114-9c9b16358b9d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:34:03.855608 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.855576    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59821bad-d9da-4dd8-9114-9c9b16358b9d-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:03.855608 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.855605    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:03.855608 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.855615    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59821bad-d9da-4dd8-9114-9c9b16358b9d-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:03.855894 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:03.855623    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs82f\" (UniqueName: \"kubernetes.io/projected/59821bad-d9da-4dd8-9114-9c9b16358b9d-kube-api-access-zs82f\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:04.454965 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.454927    2582 generic.go:356] "Generic (PLEG): container finished" podID="59821bad-d9da-4dd8-9114-9c9b16358b9d" containerID="2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564" exitCode=0
Sep 10 19:34:04.455401 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.455009    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"
Sep 10 19:34:04.455401 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.455013    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl" event={"ID":"59821bad-d9da-4dd8-9114-9c9b16358b9d","Type":"ContainerDied","Data":"2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564"}
Sep 10 19:34:04.455401 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.455091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl" event={"ID":"59821bad-d9da-4dd8-9114-9c9b16358b9d","Type":"ContainerDied","Data":"e6c7c1fa96e936127d31ab2d118ff92025f3b50ea44ed809996f65ebd4cc14d2"}
Sep 10 19:34:04.455401 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.455116    2582 scope.go:117] "RemoveContainer" containerID="2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564"
Sep 10 19:34:04.463609 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.463589    2582 scope.go:117] "RemoveContainer" containerID="2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564"
Sep 10 19:34:04.463902 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:34:04.463877    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564\": container with ID starting with 2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564 not found: ID does not exist" containerID="2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564"
Sep 10 19:34:04.463994 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.463906    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564"} err="failed to get container status \"2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564\": rpc error: code = NotFound desc = could not find container \"2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564\": container with ID starting with 2a62d9572ed32bce5a2a59e35337fc6d98e48933479f5a8436c09037c96c2564 not found: ID does not exist"
Sep 10 19:34:04.483589 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.483566    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"]
Sep 10 19:34:04.486498 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.486479    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-173596-75b6f4b744-zfqbl"]
Sep 10 19:34:04.669136 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:04.669100    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59821bad-d9da-4dd8-9114-9c9b16358b9d" path="/var/lib/kubelet/pods/59821bad-d9da-4dd8-9114-9c9b16358b9d/volumes"
Sep 10 19:34:06.467133 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:06.467102    2582 generic.go:356] "Generic (PLEG): container finished" podID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerID="58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757" exitCode=0
Sep 10 19:34:06.467590 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:06.467177    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" event={"ID":"f11c9ab9-f6b0-4954-be94-d586e6df08b5","Type":"ContainerDied","Data":"58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757"}
Sep 10 19:34:06.467652 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:06.467636    2582 scope.go:117] "RemoveContainer" containerID="58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757"
Sep 10 19:34:06.468646 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:06.468619    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:34:06.468713 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:06.468684    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:34:06.468752 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:06.468717    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:34:07.473865 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:07.473825    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" event={"ID":"f11c9ab9-f6b0-4954-be94-d586e6df08b5","Type":"ContainerStarted","Data":"7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962"}
Sep 10 19:34:07.877427 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:07.877367    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:34:07.877754 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:07.877724    2582 patch_prober.go:28] interesting pod/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 19:34:07.877948 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:07.877920    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 19:34:08.877524 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:08.877481    2582 patch_prober.go:28] interesting pod/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 19:34:08.878101 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:08.877550    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 19:34:09.876972 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:09.876934    2582 patch_prober.go:28] interesting pod/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 19:34:09.877297 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:09.877262    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 19:34:10.877695 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:10.877649    2582 patch_prober.go:28] interesting pod/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 19:34:10.878216 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:10.877723    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 19:34:11.877014 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:11.876975    2582 patch_prober.go:28] interesting pod/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 19:34:11.877312 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:11.877283    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 19:34:12.877358 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:12.877320    2582 patch_prober.go:28] interesting pod/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 19:34:12.877989 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:12.877955    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 19:34:13.880480 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:13.880449    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:34:13.880843 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:13.880703    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:34:13.881486 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:13.881469    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:34:23.231719 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.231687    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"]
Sep 10 19:34:23.232094 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.231909    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b" podUID="160ec50c-a433-44f1-a66c-555b3b203a49" containerName="maas-api" containerID="cri-o://7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431" gracePeriod=30
Sep 10 19:34:23.255872 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.255839    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b" podUID="160ec50c-a433-44f1-a66c-555b3b203a49" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.30:8443/health\": dial tcp 10.134.0.30:8443: connect: connection refused"
Sep 10 19:34:23.476071 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.476047    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:34:23.552235 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.552203    2582 generic.go:356] "Generic (PLEG): container finished" podID="160ec50c-a433-44f1-a66c-555b3b203a49" containerID="7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431" exitCode=0
Sep 10 19:34:23.552402 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.552251    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"
Sep 10 19:34:23.552402 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.552290    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b" event={"ID":"160ec50c-a433-44f1-a66c-555b3b203a49","Type":"ContainerDied","Data":"7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431"}
Sep 10 19:34:23.552402 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.552347    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b" event={"ID":"160ec50c-a433-44f1-a66c-555b3b203a49","Type":"ContainerDied","Data":"739cc69966485c1a413d23943337fa8de65eae7518141c0ab8787b9b8f61ade0"}
Sep 10 19:34:23.552402 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.552377    2582 scope.go:117] "RemoveContainer" containerID="7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431"
Sep 10 19:34:23.560951 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.560931    2582 scope.go:117] "RemoveContainer" containerID="7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431"
Sep 10 19:34:23.561210 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:34:23.561190    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431\": container with ID starting with 7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431 not found: ID does not exist" containerID="7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431"
Sep 10 19:34:23.561260 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.561219    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431"} err="failed to get container status \"7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431\": rpc error: code = NotFound desc = could not find container \"7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431\": container with ID starting with 7b8793db309ffbefd67d974afc6e41ba9b201708b064a6e230b826d064903431 not found: ID does not exist"
Sep 10 19:34:23.631532 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.631496    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-maas-api-tls\") pod \"160ec50c-a433-44f1-a66c-555b3b203a49\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") "
Sep 10 19:34:23.631760 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.631727    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-metrics-certs\") pod \"160ec50c-a433-44f1-a66c-555b3b203a49\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") "
Sep 10 19:34:23.631907 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.631802    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rpkk\" (UniqueName: \"kubernetes.io/projected/160ec50c-a433-44f1-a66c-555b3b203a49-kube-api-access-4rpkk\") pod \"160ec50c-a433-44f1-a66c-555b3b203a49\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") "
Sep 10 19:34:23.631907 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.631856    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160ec50c-a433-44f1-a66c-555b3b203a49-openshift-service-ca\") pod \"160ec50c-a433-44f1-a66c-555b3b203a49\" (UID: \"160ec50c-a433-44f1-a66c-555b3b203a49\") "
Sep 10 19:34:23.632442 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.632378    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/160ec50c-a433-44f1-a66c-555b3b203a49-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "160ec50c-a433-44f1-a66c-555b3b203a49" (UID: "160ec50c-a433-44f1-a66c-555b3b203a49"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:34:23.634388 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.634346    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160ec50c-a433-44f1-a66c-555b3b203a49-kube-api-access-4rpkk" (OuterVolumeSpecName: "kube-api-access-4rpkk") pod "160ec50c-a433-44f1-a66c-555b3b203a49" (UID: "160ec50c-a433-44f1-a66c-555b3b203a49"). InnerVolumeSpecName "kube-api-access-4rpkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:34:23.634499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.634381    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "160ec50c-a433-44f1-a66c-555b3b203a49" (UID: "160ec50c-a433-44f1-a66c-555b3b203a49"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:34:23.634499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.634428    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "160ec50c-a433-44f1-a66c-555b3b203a49" (UID: "160ec50c-a433-44f1-a66c-555b3b203a49"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:34:23.733139 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.733100    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:23.733139 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.733135    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rpkk\" (UniqueName: \"kubernetes.io/projected/160ec50c-a433-44f1-a66c-555b3b203a49-kube-api-access-4rpkk\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:23.733139 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.733149    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160ec50c-a433-44f1-a66c-555b3b203a49-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:23.733378 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.733157    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160ec50c-a433-44f1-a66c-555b3b203a49-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:23.875285 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.875256    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"]
Sep 10 19:34:23.880285 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:23.880259    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e7e4c3-7b8d46d589-cks8b"]
Sep 10 19:34:24.668484 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:24.668454    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160ec50c-a433-44f1-a66c-555b3b203a49" path="/var/lib/kubelet/pods/160ec50c-a433-44f1-a66c-555b3b203a49/volumes"
Sep 10 19:34:31.513308 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.513262    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"]
Sep 10 19:34:31.513923 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.513524    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx" podUID="dd74db11-3389-4738-90e6-29633b1f1197" containerName="maas-api" containerID="cri-o://d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c" gracePeriod=30
Sep 10 19:34:31.749958 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.749933    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:34:31.903219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.903127    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nq5z\" (UniqueName: \"kubernetes.io/projected/dd74db11-3389-4738-90e6-29633b1f1197-kube-api-access-2nq5z\") pod \"dd74db11-3389-4738-90e6-29633b1f1197\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") "
Sep 10 19:34:31.903219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.903170    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-metrics-certs\") pod \"dd74db11-3389-4738-90e6-29633b1f1197\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") "
Sep 10 19:34:31.903219 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.903194    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-maas-api-tls\") pod \"dd74db11-3389-4738-90e6-29633b1f1197\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") "
Sep 10 19:34:31.903543 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.903240    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd74db11-3389-4738-90e6-29633b1f1197-openshift-service-ca\") pod \"dd74db11-3389-4738-90e6-29633b1f1197\" (UID: \"dd74db11-3389-4738-90e6-29633b1f1197\") "
Sep 10 19:34:31.903695 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.903666    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd74db11-3389-4738-90e6-29633b1f1197-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dd74db11-3389-4738-90e6-29633b1f1197" (UID: "dd74db11-3389-4738-90e6-29633b1f1197"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:34:31.905492 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.905459    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dd74db11-3389-4738-90e6-29633b1f1197" (UID: "dd74db11-3389-4738-90e6-29633b1f1197"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:34:31.905492 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.905485    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dd74db11-3389-4738-90e6-29633b1f1197" (UID: "dd74db11-3389-4738-90e6-29633b1f1197"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:34:31.905492 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:31.905509    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd74db11-3389-4738-90e6-29633b1f1197-kube-api-access-2nq5z" (OuterVolumeSpecName: "kube-api-access-2nq5z") pod "dd74db11-3389-4738-90e6-29633b1f1197" (UID: "dd74db11-3389-4738-90e6-29633b1f1197"). InnerVolumeSpecName "kube-api-access-2nq5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:34:32.004130 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.004092    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nq5z\" (UniqueName: \"kubernetes.io/projected/dd74db11-3389-4738-90e6-29633b1f1197-kube-api-access-2nq5z\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:32.004130 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.004127    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:32.004130 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.004141    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd74db11-3389-4738-90e6-29633b1f1197-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:32.004367 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.004150    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd74db11-3389-4738-90e6-29633b1f1197-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:32.597214 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.597168    2582 generic.go:356] "Generic (PLEG): container finished" podID="dd74db11-3389-4738-90e6-29633b1f1197" containerID="d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c" exitCode=0
Sep 10 19:34:32.597706 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.597243    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"
Sep 10 19:34:32.597706 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.597250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx" event={"ID":"dd74db11-3389-4738-90e6-29633b1f1197","Type":"ContainerDied","Data":"d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c"}
Sep 10 19:34:32.597706 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.597307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx" event={"ID":"dd74db11-3389-4738-90e6-29633b1f1197","Type":"ContainerDied","Data":"f78c20d22573025c5153f3be4b831e18958c7d122aa06b3e2d409f8b9ba38646"}
Sep 10 19:34:32.597706 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.597331    2582 scope.go:117] "RemoveContainer" containerID="d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c"
Sep 10 19:34:32.607354 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.607331    2582 scope.go:117] "RemoveContainer" containerID="d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c"
Sep 10 19:34:32.607720 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:34:32.607694    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c\": container with ID starting with d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c not found: ID does not exist" containerID="d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c"
Sep 10 19:34:32.607821 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.607729    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c"} err="failed to get container status \"d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c\": rpc error: code = NotFound desc = could not find container \"d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c\": container with ID starting with d1aa7fee2e1ff62cc680a90a564d8a496d205bb61656934ed8e2a06ec2eae73c not found: ID does not exist"
Sep 10 19:34:32.647741 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.647713    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"]
Sep 10 19:34:32.650382 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.650355    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cecfebe7-5f4bc59c-zcxdx"]
Sep 10 19:34:32.674094 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:32.674057    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd74db11-3389-4738-90e6-29633b1f1197" path="/var/lib/kubelet/pods/dd74db11-3389-4738-90e6-29633b1f1197/volumes"
Sep 10 19:34:37.171248 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171212    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"]
Sep 10 19:34:37.171724 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171702    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160ec50c-a433-44f1-a66c-555b3b203a49" containerName="maas-api"
Sep 10 19:34:37.171793 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171766    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="160ec50c-a433-44f1-a66c-555b3b203a49" containerName="maas-api"
Sep 10 19:34:37.171793 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171785    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59821bad-d9da-4dd8-9114-9c9b16358b9d" containerName="maas-api"
Sep 10 19:34:37.171909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171801    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59821bad-d9da-4dd8-9114-9c9b16358b9d" containerName="maas-api"
Sep 10 19:34:37.171909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171833    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd74db11-3389-4738-90e6-29633b1f1197" containerName="maas-api"
Sep 10 19:34:37.171909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171842    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd74db11-3389-4738-90e6-29633b1f1197" containerName="maas-api"
Sep 10 19:34:37.172164 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171964    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="59821bad-d9da-4dd8-9114-9c9b16358b9d" containerName="maas-api"
Sep 10 19:34:37.172164 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171976    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="160ec50c-a433-44f1-a66c-555b3b203a49" containerName="maas-api"
Sep 10 19:34:37.172164 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.171989    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd74db11-3389-4738-90e6-29633b1f1197" containerName="maas-api"
Sep 10 19:34:37.175437 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.175388    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.180768 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.180745    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-28d250-serving-cert\""
Sep 10 19:34:37.196503 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.196473    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"]
Sep 10 19:34:37.348748 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.348714    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef00ce67-6409-4bf0-8a7c-d417f757480b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.348748 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.348748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbbbv\" (UniqueName: \"kubernetes.io/projected/ef00ce67-6409-4bf0-8a7c-d417f757480b-kube-api-access-vbbbv\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.348962 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.348837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.348962 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.348883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.450215 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.450122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef00ce67-6409-4bf0-8a7c-d417f757480b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.450215 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.450162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbbbv\" (UniqueName: \"kubernetes.io/projected/ef00ce67-6409-4bf0-8a7c-d417f757480b-kube-api-access-vbbbv\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.450215 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.450210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.450557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.450231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.450557 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:34:37.450378    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-serving-cert: secret "maas-api-e2e-shared-a-w3-28d250-serving-cert" not found
Sep 10 19:34:37.450557 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:34:37.450470    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls podName:ef00ce67-6409-4bf0-8a7c-d417f757480b nodeName:}" failed. No retries permitted until 2026-09-10 19:34:37.950445363 +0000 UTC m=+1129.806000386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls") pod "maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9" (UID: "ef00ce67-6409-4bf0-8a7c-d417f757480b") : secret "maas-api-e2e-shared-a-w3-28d250-serving-cert" not found
Sep 10 19:34:37.450875 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.450846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef00ce67-6409-4bf0-8a7c-d417f757480b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.452767 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.452747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.461310 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.461288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbbbv\" (UniqueName: \"kubernetes.io/projected/ef00ce67-6409-4bf0-8a7c-d417f757480b-kube-api-access-vbbbv\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.955291 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:37.955256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:37.955468 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:34:37.955403    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-serving-cert: secret "maas-api-e2e-shared-a-w3-28d250-serving-cert" not found
Sep 10 19:34:37.955516 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:34:37.955481    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls podName:ef00ce67-6409-4bf0-8a7c-d417f757480b nodeName:}" failed. No retries permitted until 2026-09-10 19:34:38.955464883 +0000 UTC m=+1130.811019908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls") pod "maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9" (UID: "ef00ce67-6409-4bf0-8a7c-d417f757480b") : secret "maas-api-e2e-shared-a-w3-28d250-serving-cert" not found
Sep 10 19:34:38.319915 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.319883    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"]
Sep 10 19:34:38.322366 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.322350    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:34:38.327547 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.327522    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-28d250-dockercfg-qsbk6\""
Sep 10 19:34:38.327547 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.327538    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-28d250\""
Sep 10 19:34:38.338551 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.338531    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"]
Sep 10 19:34:38.460673 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.460640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z96xs\" (UniqueName: \"kubernetes.io/projected/25d5afda-d332-49c5-9fe4-bd783a51bdba-kube-api-access-z96xs\") pod \"payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5\" (UID: \"25d5afda-d332-49c5-9fe4-bd783a51bdba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:34:38.460853 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.460755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5afda-d332-49c5-9fe4-bd783a51bdba-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5\" (UID: \"25d5afda-d332-49c5-9fe4-bd783a51bdba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:34:38.561897 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.561860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5afda-d332-49c5-9fe4-bd783a51bdba-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5\" (UID: \"25d5afda-d332-49c5-9fe4-bd783a51bdba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:34:38.562081 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.561909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z96xs\" (UniqueName: \"kubernetes.io/projected/25d5afda-d332-49c5-9fe4-bd783a51bdba-kube-api-access-z96xs\") pod \"payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5\" (UID: \"25d5afda-d332-49c5-9fe4-bd783a51bdba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:34:38.562676 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.562656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5afda-d332-49c5-9fe4-bd783a51bdba-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5\" (UID: \"25d5afda-d332-49c5-9fe4-bd783a51bdba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:34:38.580314 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.580249    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z96xs\" (UniqueName: \"kubernetes.io/projected/25d5afda-d332-49c5-9fe4-bd783a51bdba-kube-api-access-z96xs\") pod \"payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5\" (UID: \"25d5afda-d332-49c5-9fe4-bd783a51bdba\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:34:38.633158 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.633123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:34:38.913389 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.913280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"]
Sep 10 19:34:38.916304 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:34:38.916277    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d5afda_d332_49c5_9fe4_bd783a51bdba.slice/crio-42f23462fa83df9cf4667e49f15b7b28add66bde9d4ba0c6669688c469507b19 WatchSource:0}: Error finding container 42f23462fa83df9cf4667e49f15b7b28add66bde9d4ba0c6669688c469507b19: Status 404 returned error can't find the container with id 42f23462fa83df9cf4667e49f15b7b28add66bde9d4ba0c6669688c469507b19
Sep 10 19:34:38.964252 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.964226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:38.966355 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.966334    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:38.986242 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:38.986210    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:39.277339 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:39.277310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"]
Sep 10 19:34:39.278764 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:34:39.278739    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef00ce67_6409_4bf0_8a7c_d417f757480b.slice/crio-f284ee7eb873c82328e945a43b2d6cf8995a6410880788bdf2bbf62692f3c0bd WatchSource:0}: Error finding container f284ee7eb873c82328e945a43b2d6cf8995a6410880788bdf2bbf62692f3c0bd: Status 404 returned error can't find the container with id f284ee7eb873c82328e945a43b2d6cf8995a6410880788bdf2bbf62692f3c0bd
Sep 10 19:34:39.631792 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:39.631689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9" event={"ID":"ef00ce67-6409-4bf0-8a7c-d417f757480b","Type":"ContainerStarted","Data":"f284ee7eb873c82328e945a43b2d6cf8995a6410880788bdf2bbf62692f3c0bd"}
Sep 10 19:34:39.633158 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:39.633135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5" event={"ID":"25d5afda-d332-49c5-9fe4-bd783a51bdba","Type":"ContainerStarted","Data":"a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790"}
Sep 10 19:34:39.633287 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:39.633184    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5" event={"ID":"25d5afda-d332-49c5-9fe4-bd783a51bdba","Type":"ContainerStarted","Data":"42f23462fa83df9cf4667e49f15b7b28add66bde9d4ba0c6669688c469507b19"}
Sep 10 19:34:39.633287 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:39.633263    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:34:39.660252 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:39.660206    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5" podStartSLOduration=1.660187276 podStartE2EDuration="1.660187276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:34:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:34:39.657331421 +0000 UTC m=+1131.512886466" watchObservedRunningTime="2026-09-10 19:34:39.660187276 +0000 UTC m=+1131.515742298"
Sep 10 19:34:40.639059 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:40.639026    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9" event={"ID":"ef00ce67-6409-4bf0-8a7c-d417f757480b","Type":"ContainerStarted","Data":"7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770"}
Sep 10 19:34:40.639479 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:40.639120    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:40.679879 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:40.679832    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9" podStartSLOduration=3.286680057 podStartE2EDuration="3.679815841s" totalImagesPullingTime="393.135784ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:34:40.679268935 +0000 UTC m=+1132.534823989" watchObservedRunningTime="2026-09-10 19:34:40.679815841 +0000 UTC m=+1132.535370869"
Sep 10 19:34:40.861897 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:40.861858    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"]
Sep 10 19:34:40.862109 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:40.862070    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy" containerID="cri-o://7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962" gracePeriod=30
Sep 10 19:34:43.882852 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:43.882802    2582 patch_prober.go:28] interesting pod/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 19:34:43.883228 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:43.882867    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 19:34:46.107705 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.107679    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:34:46.121046 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121024    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd596\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-kube-api-access-fd596\") pod \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") "
Sep 10 19:34:46.121126 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-podinfo\") pod \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") "
Sep 10 19:34:46.121126 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121079    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-data\") pod \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") "
Sep 10 19:34:46.121126 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121108    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-token\") pod \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") "
Sep 10 19:34:46.121262 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121165    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-certs\") pod \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") "
Sep 10 19:34:46.121262 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121197    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-credential-socket\") pod \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") "
Sep 10 19:34:46.121262 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121219    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-envoy\") pod \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") "
Sep 10 19:34:46.121426 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121350    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "f11c9ab9-f6b0-4954-be94-d586e6df08b5" (UID: "f11c9ab9-f6b0-4954-be94-d586e6df08b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:34:46.121487 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121451    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istiod-ca-cert\") pod \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") "
Sep 10 19:34:46.121545 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121488    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f11c9ab9-f6b0-4954-be94-d586e6df08b5" (UID: "f11c9ab9-f6b0-4954-be94-d586e6df08b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:34:46.121545 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121496    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f11c9ab9-f6b0-4954-be94-d586e6df08b5" (UID: "f11c9ab9-f6b0-4954-be94-d586e6df08b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:34:46.121545 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121503    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-socket\") pod \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\" (UID: \"f11c9ab9-f6b0-4954-be94-d586e6df08b5\") "
Sep 10 19:34:46.121738 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121676    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f11c9ab9-f6b0-4954-be94-d586e6df08b5" (UID: "f11c9ab9-f6b0-4954-be94-d586e6df08b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:34:46.121801 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121771    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f11c9ab9-f6b0-4954-be94-d586e6df08b5" (UID: "f11c9ab9-f6b0-4954-be94-d586e6df08b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:34:46.121801 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121795    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:46.121902 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121810    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-credential-socket\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:46.121902 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121823    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-workload-socket\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:46.121902 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.121836    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-data\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:46.123250 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.123222    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-kube-api-access-fd596" (OuterVolumeSpecName: "kube-api-access-fd596") pod "f11c9ab9-f6b0-4954-be94-d586e6df08b5" (UID: "f11c9ab9-f6b0-4954-be94-d586e6df08b5"). InnerVolumeSpecName "kube-api-access-fd596". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:34:46.123376 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.123308    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "f11c9ab9-f6b0-4954-be94-d586e6df08b5" (UID: "f11c9ab9-f6b0-4954-be94-d586e6df08b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:34:46.123714 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.123690    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f11c9ab9-f6b0-4954-be94-d586e6df08b5" (UID: "f11c9ab9-f6b0-4954-be94-d586e6df08b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:34:46.123807 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.123703    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f11c9ab9-f6b0-4954-be94-d586e6df08b5" (UID: "f11c9ab9-f6b0-4954-be94-d586e6df08b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:34:46.223123 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.223088    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-token\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:46.223123 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.223116    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-envoy\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:46.223123 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.223126    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istiod-ca-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:46.223123 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.223134    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd596\" (UniqueName: \"kubernetes.io/projected/f11c9ab9-f6b0-4954-be94-d586e6df08b5-kube-api-access-fd596\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:46.223475 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.223142    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f11c9ab9-f6b0-4954-be94-d586e6df08b5-istio-podinfo\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:34:46.649944 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.649916    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:34:46.667749 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.667716    2582 generic.go:356] "Generic (PLEG): container finished" podID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerID="7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962" exitCode=0
Sep 10 19:34:46.667887 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.667815    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"
Sep 10 19:34:46.668565 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.668545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" event={"ID":"f11c9ab9-f6b0-4954-be94-d586e6df08b5","Type":"ContainerDied","Data":"7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962"}
Sep 10 19:34:46.668655 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.668583    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45" event={"ID":"f11c9ab9-f6b0-4954-be94-d586e6df08b5","Type":"ContainerDied","Data":"5179e1b3c5f983c635e6216e1a994ea46060dc51766b67cee11fd8aaecb3b7b2"}
Sep 10 19:34:46.668655 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.668606    2582 scope.go:117] "RemoveContainer" containerID="7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962"
Sep 10 19:34:46.678756 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.678738    2582 scope.go:117] "RemoveContainer" containerID="58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757"
Sep 10 19:34:46.687085 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.687065    2582 scope.go:117] "RemoveContainer" containerID="7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962"
Sep 10 19:34:46.687425 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:34:46.687383    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962\": container with ID starting with 7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962 not found: ID does not exist" containerID="7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962"
Sep 10 19:34:46.687503 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.687442    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962"} err="failed to get container status \"7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962\": rpc error: code = NotFound desc = could not find container \"7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962\": container with ID starting with 7c284996f22a235ebda0e4164cc8231f8285a3ea0056c875adcdb1762f68a962 not found: ID does not exist"
Sep 10 19:34:46.687503 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.687466    2582 scope.go:117] "RemoveContainer" containerID="58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757"
Sep 10 19:34:46.687778 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:34:46.687757    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757\": container with ID starting with 58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757 not found: ID does not exist" containerID="58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757"
Sep 10 19:34:46.687872 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.687786    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757"} err="failed to get container status \"58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757\": rpc error: code = NotFound desc = could not find container \"58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757\": container with ID starting with 58b590a5dab9d8010c980e8df983f957ca301803a86db9020233837623785757 not found: ID does not exist"
Sep 10 19:34:46.698993 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.698961    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"]
Sep 10 19:34:46.706914 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:46.706889    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cecfebe7-openshift-default-5c5cb64b8-kxq45"]
Sep 10 19:34:48.668815 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:48.668784    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" path="/var/lib/kubelet/pods/f11c9ab9-f6b0-4954-be94-d586e6df08b5/volumes"
Sep 10 19:34:50.641143 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:34:50.641113    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:35:00.439928 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.439893    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"]
Sep 10 19:35:00.440345 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.440335    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy"
Sep 10 19:35:00.440392 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.440350    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy"
Sep 10 19:35:00.440483 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.440470    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy"
Sep 10 19:35:00.440578 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.440487    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy"
Sep 10 19:35:00.443713 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.443692    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.446645 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.446619    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-32ce4f-serving-cert\""
Sep 10 19:35:00.453983 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.453954    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"]
Sep 10 19:35:00.539279 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.539241    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvhql\" (UniqueName: \"kubernetes.io/projected/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-kube-api-access-vvhql\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.539279 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.539287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.539506 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.539306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.539506 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.539402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.640320 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.640286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvhql\" (UniqueName: \"kubernetes.io/projected/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-kube-api-access-vvhql\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.640320 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.640338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.640600 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.640357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.640600 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.640402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.640600 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:35:00.640539    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-serving-cert: secret "maas-api-e2e-shared-a-w2-32ce4f-serving-cert" not found
Sep 10 19:35:00.640766 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:35:00.640604    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-maas-api-tls podName:b905a5e4-5b6e-49ca-8d4a-7330adcd56a9 nodeName:}" failed. No retries permitted until 2026-09-10 19:35:01.140584311 +0000 UTC m=+1152.996139317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-maas-api-tls") pod "maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw" (UID: "b905a5e4-5b6e-49ca-8d4a-7330adcd56a9") : secret "maas-api-e2e-shared-a-w2-32ce4f-serving-cert" not found
Sep 10 19:35:00.641089 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.641063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.642776 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.642750    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:00.651899 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:00.651868    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvhql\" (UniqueName: \"kubernetes.io/projected/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-kube-api-access-vvhql\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:01.145498 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.145457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:01.148105 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.148079    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:01.357844 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.357807    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:01.540756 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.540716    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"]
Sep 10 19:35:01.541171 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.541131    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy"
Sep 10 19:35:01.541171 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.541147    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f11c9ab9-f6b0-4954-be94-d586e6df08b5" containerName="istio-proxy"
Sep 10 19:35:01.544129 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.544107    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.546725 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.546700    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-b83810-openshift-default-dockercfg-v6k8d\""
Sep 10 19:35:01.559366 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.559334    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"]
Sep 10 19:35:01.637872 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.637838    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"]
Sep 10 19:35:01.640121 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:35:01.640065    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb905a5e4_5b6e_49ca_8d4a_7330adcd56a9.slice/crio-111936ad4f563c41c6373e125b92855fd68b2d9f85bf81364c85a24f4a800382 WatchSource:0}: Error finding container 111936ad4f563c41c6373e125b92855fd68b2d9f85bf81364c85a24f4a800382: Status 404 returned error can't find the container with id 111936ad4f563c41c6373e125b92855fd68b2d9f85bf81364c85a24f4a800382
Sep 10 19:35:01.649235 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.649189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-podinfo\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.649452 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.649274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c364db59-da8c-48a1-a26e-5a7304810ea6-istiod-ca-cert\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.649452 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.649337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-socket\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.649452 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.649365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2492\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-kube-api-access-s2492\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.649452 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.649440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-credential-socket\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.649706 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.649567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-token\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.649706 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.649622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-data\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.649706 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.649667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-certs\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.649706 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.649692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-envoy\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.737308 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.737213    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw" event={"ID":"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9","Type":"ContainerStarted","Data":"111936ad4f563c41c6373e125b92855fd68b2d9f85bf81364c85a24f4a800382"}
Sep 10 19:35:01.750663 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.750631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-token\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.750776 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.750672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-data\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.750776 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.750700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-certs\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.750776 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.750722    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-envoy\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.750776 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.750756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-podinfo\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.750995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.750812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c364db59-da8c-48a1-a26e-5a7304810ea6-istiod-ca-cert\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.750995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.750844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-socket\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.750995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.750872    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2492\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-kube-api-access-s2492\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.750995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.750918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-credential-socket\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.751206 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.751092    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-data\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.751507 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.751449    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-credential-socket\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.751507 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.751482    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-certs\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.751656 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.751540    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-socket\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.752017 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.751990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c364db59-da8c-48a1-a26e-5a7304810ea6-istiod-ca-cert\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.753142 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.753117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-envoy\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.753382 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.753363    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-podinfo\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.760172 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.760145    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2492\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-kube-api-access-s2492\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.760612 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.760591    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-token\") pod \"e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") " pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:01.855038 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:01.855003    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:02.138949 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.138926    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"]
Sep 10 19:35:02.141312 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:35:02.141273    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc364db59_da8c_48a1_a26e_5a7304810ea6.slice/crio-30c641cedad0b634c40e6e150e1fb8a09ba11a82b645702221c00decf7884469 WatchSource:0}: Error finding container 30c641cedad0b634c40e6e150e1fb8a09ba11a82b645702221c00decf7884469: Status 404 returned error can't find the container with id 30c641cedad0b634c40e6e150e1fb8a09ba11a82b645702221c00decf7884469
Sep 10 19:35:02.143563 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.143533    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:35:02.143645 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.143599    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:35:02.143645 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.143628    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:35:02.743253 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.743214    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw" event={"ID":"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9","Type":"ContainerStarted","Data":"16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000"}
Sep 10 19:35:02.743699 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.743388    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:02.744968 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.744943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" event={"ID":"c364db59-da8c-48a1-a26e-5a7304810ea6","Type":"ContainerStarted","Data":"4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5"}
Sep 10 19:35:02.745086 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.744986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" event={"ID":"c364db59-da8c-48a1-a26e-5a7304810ea6","Type":"ContainerStarted","Data":"30c641cedad0b634c40e6e150e1fb8a09ba11a82b645702221c00decf7884469"}
Sep 10 19:35:02.766845 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.766788    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw" podStartSLOduration=2.342905848 podStartE2EDuration="2.766773146s" totalImagesPullingTime="423.867298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:35:02.764529191 +0000 UTC m=+1154.620084239" watchObservedRunningTime="2026-09-10 19:35:02.766773146 +0000 UTC m=+1154.622328172"
Sep 10 19:35:02.787874 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.787818    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" podStartSLOduration=1.787800104 podStartE2EDuration="1.787800104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:35:02.786769572 +0000 UTC m=+1154.642324651" watchObservedRunningTime="2026-09-10 19:35:02.787800104 +0000 UTC m=+1154.643355138"
Sep 10 19:35:02.856070 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:02.856025    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:03.860928 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:03.860898    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:04.753764 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:04.753732    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:04.754625 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:04.754605    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:06.617332 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.617302    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"]
Sep 10 19:35:06.619851 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.619825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:06.622236 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.622212    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-b83810\""
Sep 10 19:35:06.622355 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.622337    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-b83810-dockercfg-w479f\""
Sep 10 19:35:06.632673 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.632613    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"]
Sep 10 19:35:06.693499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.693465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9lrq\" (UniqueName: \"kubernetes.io/projected/fe181001-67a9-44b0-93aa-ce538f9aed9d-kube-api-access-x9lrq\") pod \"payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m\" (UID: \"fe181001-67a9-44b0-93aa-ce538f9aed9d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:06.693499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.693499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe181001-67a9-44b0-93aa-ce538f9aed9d-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m\" (UID: \"fe181001-67a9-44b0-93aa-ce538f9aed9d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:06.794777 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.794738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lrq\" (UniqueName: \"kubernetes.io/projected/fe181001-67a9-44b0-93aa-ce538f9aed9d-kube-api-access-x9lrq\") pod \"payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m\" (UID: \"fe181001-67a9-44b0-93aa-ce538f9aed9d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:06.794777 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.794778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe181001-67a9-44b0-93aa-ce538f9aed9d-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m\" (UID: \"fe181001-67a9-44b0-93aa-ce538f9aed9d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:06.795448 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.795401    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe181001-67a9-44b0-93aa-ce538f9aed9d-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m\" (UID: \"fe181001-67a9-44b0-93aa-ce538f9aed9d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:06.805542 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.805517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9lrq\" (UniqueName: \"kubernetes.io/projected/fe181001-67a9-44b0-93aa-ce538f9aed9d-kube-api-access-x9lrq\") pod \"payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m\" (UID: \"fe181001-67a9-44b0-93aa-ce538f9aed9d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:06.931161 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:06.931074    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:07.214505 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:07.214326    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"]
Sep 10 19:35:07.216681 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:35:07.216653    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe181001_67a9_44b0_93aa_ce538f9aed9d.slice/crio-f8c2b19261c5fe37796efb58a763fe346b96647632db58bc6575174d3d550bd2 WatchSource:0}: Error finding container f8c2b19261c5fe37796efb58a763fe346b96647632db58bc6575174d3d550bd2: Status 404 returned error can't find the container with id f8c2b19261c5fe37796efb58a763fe346b96647632db58bc6575174d3d550bd2
Sep 10 19:35:07.768536 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:07.768496    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m" event={"ID":"fe181001-67a9-44b0-93aa-ce538f9aed9d","Type":"ContainerStarted","Data":"9227e3e3d936f069ab82a8e4f400fe16daae31441916d3dd573652a3d98a5ea1"}
Sep 10 19:35:07.768945 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:07.768562    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m" event={"ID":"fe181001-67a9-44b0-93aa-ce538f9aed9d","Type":"ContainerStarted","Data":"f8c2b19261c5fe37796efb58a763fe346b96647632db58bc6575174d3d550bd2"}
Sep 10 19:35:07.768945 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:07.768613    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:07.789689 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:07.789640    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m" podStartSLOduration=1.7896261770000002 podStartE2EDuration="1.789626177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:35:07.788536504 +0000 UTC m=+1159.644091564" watchObservedRunningTime="2026-09-10 19:35:07.789626177 +0000 UTC m=+1159.645181207"
Sep 10 19:35:08.755385 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:08.755352    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:35:18.775680 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:18.775582    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:35:24.854270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:24.854231    2582 generic.go:356] "Generic (PLEG): container finished" podID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerID="4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5" exitCode=0
Sep 10 19:35:24.854710 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:24.854305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" event={"ID":"c364db59-da8c-48a1-a26e-5a7304810ea6","Type":"ContainerDied","Data":"4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5"}
Sep 10 19:35:24.854753 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:24.854732    2582 scope.go:117] "RemoveContainer" containerID="4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5"
Sep 10 19:35:24.855860 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:24.855836    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:35:24.855924 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:24.855900    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:35:24.855960 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:24.855929    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 10 19:35:25.860700 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:25.860671    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" event={"ID":"c364db59-da8c-48a1-a26e-5a7304810ea6","Type":"ContainerStarted","Data":"a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8"}
Sep 10 19:35:26.855952 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:26.855914    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:26.856164 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:26.856141    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 19:35:26.856210 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:26.856195    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 19:35:27.855841 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:27.855801    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 19:35:27.856228 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:27.855877    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 19:35:28.855591 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:28.855553    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 19:35:28.855769 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:28.855608    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 19:35:29.855476 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:29.855437    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 19:35:29.855868 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:29.855495    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 19:35:30.029909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.029870    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"]
Sep 10 19:35:30.032094 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.032079    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:30.034645 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.034619    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-7bfb5d\""
Sep 10 19:35:30.034645 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.034642    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-7bfb5d-dockercfg-sbtck\""
Sep 10 19:35:30.047297 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.047274    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"]
Sep 10 19:35:30.056559 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.056540    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"]
Sep 10 19:35:30.058676 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.058662    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:35:30.083433 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.081916    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"]
Sep 10 19:35:30.215874 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.215786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9f659cd-ffb2-4554-948e-266944f4dea4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l\" (UID: \"b9f659cd-ffb2-4554-948e-266944f4dea4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:35:30.216018 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.215893    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jddv\" (UniqueName: \"kubernetes.io/projected/b9f659cd-ffb2-4554-948e-266944f4dea4-kube-api-access-9jddv\") pod \"payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l\" (UID: \"b9f659cd-ffb2-4554-948e-266944f4dea4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:35:30.216018 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.215928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4f6d\" (UniqueName: \"kubernetes.io/projected/37fd68e0-0387-4d91-b241-c4659ed67b7e-kube-api-access-m4f6d\") pod \"payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk\" (UID: \"37fd68e0-0387-4d91-b241-c4659ed67b7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:30.216018 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.215993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd68e0-0387-4d91-b241-c4659ed67b7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk\" (UID: \"37fd68e0-0387-4d91-b241-c4659ed67b7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:30.317472 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.317434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jddv\" (UniqueName: \"kubernetes.io/projected/b9f659cd-ffb2-4554-948e-266944f4dea4-kube-api-access-9jddv\") pod \"payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l\" (UID: \"b9f659cd-ffb2-4554-948e-266944f4dea4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:35:30.317643 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.317487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4f6d\" (UniqueName: \"kubernetes.io/projected/37fd68e0-0387-4d91-b241-c4659ed67b7e-kube-api-access-m4f6d\") pod \"payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk\" (UID: \"37fd68e0-0387-4d91-b241-c4659ed67b7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:30.317643 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.317532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd68e0-0387-4d91-b241-c4659ed67b7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk\" (UID: \"37fd68e0-0387-4d91-b241-c4659ed67b7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:30.317643 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.317595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9f659cd-ffb2-4554-948e-266944f4dea4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l\" (UID: \"b9f659cd-ffb2-4554-948e-266944f4dea4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:35:30.318295 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.318275    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9f659cd-ffb2-4554-948e-266944f4dea4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l\" (UID: \"b9f659cd-ffb2-4554-948e-266944f4dea4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:35:30.318333 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.318288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd68e0-0387-4d91-b241-c4659ed67b7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk\" (UID: \"37fd68e0-0387-4d91-b241-c4659ed67b7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:30.327710 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.327681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4f6d\" (UniqueName: \"kubernetes.io/projected/37fd68e0-0387-4d91-b241-c4659ed67b7e-kube-api-access-m4f6d\") pod \"payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk\" (UID: \"37fd68e0-0387-4d91-b241-c4659ed67b7e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:30.327832 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.327783    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jddv\" (UniqueName: \"kubernetes.io/projected/b9f659cd-ffb2-4554-948e-266944f4dea4-kube-api-access-9jddv\") pod \"payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l\" (UID: \"b9f659cd-ffb2-4554-948e-266944f4dea4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:35:30.342643 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.342607    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:30.389568 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.389528    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:35:30.645608 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.645576    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"]
Sep 10 19:35:30.647379 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:35:30.647352    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37fd68e0_0387_4d91_b241_c4659ed67b7e.slice/crio-2bf82e704df491533781e5ee0b66d745d247ab34c65aa41013d0d865106e5043 WatchSource:0}: Error finding container 2bf82e704df491533781e5ee0b66d745d247ab34c65aa41013d0d865106e5043: Status 404 returned error can't find the container with id 2bf82e704df491533781e5ee0b66d745d247ab34c65aa41013d0d865106e5043
Sep 10 19:35:30.681191 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.680978    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"]
Sep 10 19:35:30.856045 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.856004    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 19:35:30.856452 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.856062    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 19:35:30.900406 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.900312    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk" event={"ID":"37fd68e0-0387-4d91-b241-c4659ed67b7e","Type":"ContainerStarted","Data":"bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76"}
Sep 10 19:35:30.900406 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.900381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk" event={"ID":"37fd68e0-0387-4d91-b241-c4659ed67b7e","Type":"ContainerStarted","Data":"2bf82e704df491533781e5ee0b66d745d247ab34c65aa41013d0d865106e5043"}
Sep 10 19:35:30.900809 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.900789    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:30.902884 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.902858    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l" event={"ID":"b9f659cd-ffb2-4554-948e-266944f4dea4","Type":"ContainerStarted","Data":"44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd"}
Sep 10 19:35:30.903040 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.902902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l" event={"ID":"b9f659cd-ffb2-4554-948e-266944f4dea4","Type":"ContainerStarted","Data":"149e3f2f2aeaedbeb4798fc26969edc51b90595f107ef2ef821e28d4466abe10"}
Sep 10 19:35:30.903040 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.902989    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:35:30.921515 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.921459    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk" podStartSLOduration=0.921438548 podStartE2EDuration="921.438548ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:35:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:35:30.91921825 +0000 UTC m=+1182.774773303" watchObservedRunningTime="2026-09-10 19:35:30.921438548 +0000 UTC m=+1182.776993580"
Sep 10 19:35:30.938553 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:30.938506    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l" podStartSLOduration=0.93849248 podStartE2EDuration="938.49248ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:35:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:35:30.936448357 +0000 UTC m=+1182.792003403" watchObservedRunningTime="2026-09-10 19:35:30.93849248 +0000 UTC m=+1182.794047509"
Sep 10 19:35:31.860375 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:31.860341    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:31.860881 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:31.860740    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:31.861521 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:31.861500    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:35:41.911584 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:41.911553    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:35:41.912061 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:35:41.911632    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:36:07.065846 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.065811    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"]
Sep 10 19:36:07.068714 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.068691    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:36:07.071274 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.071250    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-26a424d6\""
Sep 10 19:36:07.080250 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.080229    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"]
Sep 10 19:36:07.133125 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.133088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd5fa222-64e2-41eb-a9d0-73d936d32c80-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp\" (UID: \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:36:07.133309 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.133180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5nn6\" (UniqueName: \"kubernetes.io/projected/fd5fa222-64e2-41eb-a9d0-73d936d32c80-kube-api-access-l5nn6\") pod \"payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp\" (UID: \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:36:07.234345 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.234305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd5fa222-64e2-41eb-a9d0-73d936d32c80-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp\" (UID: \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:36:07.234564 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.234376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5nn6\" (UniqueName: \"kubernetes.io/projected/fd5fa222-64e2-41eb-a9d0-73d936d32c80-kube-api-access-l5nn6\") pod \"payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp\" (UID: \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:36:07.235040 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.235019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd5fa222-64e2-41eb-a9d0-73d936d32c80-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp\" (UID: \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:36:07.243563 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.243533    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5nn6\" (UniqueName: \"kubernetes.io/projected/fd5fa222-64e2-41eb-a9d0-73d936d32c80-kube-api-access-l5nn6\") pod \"payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp\" (UID: \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:36:07.379254 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.379161    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:36:07.648209 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:07.648134    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"]
Sep 10 19:36:07.650613 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:36:07.650587    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5fa222_64e2_41eb_a9d0_73d936d32c80.slice/crio-6e4fa4dd0b4db40c8ea82c28c5fba0420ac98640dc4a0aa9a8fd8d34f7e460be WatchSource:0}: Error finding container 6e4fa4dd0b4db40c8ea82c28c5fba0420ac98640dc4a0aa9a8fd8d34f7e460be: Status 404 returned error can't find the container with id 6e4fa4dd0b4db40c8ea82c28c5fba0420ac98640dc4a0aa9a8fd8d34f7e460be
Sep 10 19:36:08.091614 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:08.091579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp" event={"ID":"fd5fa222-64e2-41eb-a9d0-73d936d32c80","Type":"ContainerStarted","Data":"4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79"}
Sep 10 19:36:08.092014 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:08.091627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp" event={"ID":"fd5fa222-64e2-41eb-a9d0-73d936d32c80","Type":"ContainerStarted","Data":"6e4fa4dd0b4db40c8ea82c28c5fba0420ac98640dc4a0aa9a8fd8d34f7e460be"}
Sep 10 19:36:08.092014 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:08.091681    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:36:08.108167 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:08.107744    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp" podStartSLOduration=1.10772707 podStartE2EDuration="1.10772707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:36:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:36:08.107388738 +0000 UTC m=+1219.962943772" watchObservedRunningTime="2026-09-10 19:36:08.10772707 +0000 UTC m=+1219.963282100"
Sep 10 19:36:19.099592 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:36:19.099560    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:38:22.325116 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.325078    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"]
Sep 10 19:38:22.325922 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.325461    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp" podUID="fd5fa222-64e2-41eb-a9d0-73d936d32c80" containerName="payload-pre-processing" containerID="cri-o://4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79" gracePeriod=30
Sep 10 19:38:22.592234 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.592207    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:38:22.731080 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.731043    2582 generic.go:356] "Generic (PLEG): container finished" podID="fd5fa222-64e2-41eb-a9d0-73d936d32c80" containerID="4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79" exitCode=0
Sep 10 19:38:22.731270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.731090    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"
Sep 10 19:38:22.731270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.731118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp" event={"ID":"fd5fa222-64e2-41eb-a9d0-73d936d32c80","Type":"ContainerDied","Data":"4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79"}
Sep 10 19:38:22.731270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.731167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp" event={"ID":"fd5fa222-64e2-41eb-a9d0-73d936d32c80","Type":"ContainerDied","Data":"6e4fa4dd0b4db40c8ea82c28c5fba0420ac98640dc4a0aa9a8fd8d34f7e460be"}
Sep 10 19:38:22.731270 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.731196    2582 scope.go:117] "RemoveContainer" containerID="4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79"
Sep 10 19:38:22.739471 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.739453    2582 scope.go:117] "RemoveContainer" containerID="4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79"
Sep 10 19:38:22.739768 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:38:22.739742    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79\": container with ID starting with 4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79 not found: ID does not exist" containerID="4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79"
Sep 10 19:38:22.739860 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.739776    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79"} err="failed to get container status \"4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79\": rpc error: code = NotFound desc = could not find container \"4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79\": container with ID starting with 4b1414b39797ceab7eadb8dd1fa78df37f5052696201d412f5532a02f7fc8a79 not found: ID does not exist"
Sep 10 19:38:22.781041 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.781017    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd5fa222-64e2-41eb-a9d0-73d936d32c80-plugins-config-volume\") pod \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\" (UID: \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\") "
Sep 10 19:38:22.781128 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.781116    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5nn6\" (UniqueName: \"kubernetes.io/projected/fd5fa222-64e2-41eb-a9d0-73d936d32c80-kube-api-access-l5nn6\") pod \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\" (UID: \"fd5fa222-64e2-41eb-a9d0-73d936d32c80\") "
Sep 10 19:38:22.781358 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.781336    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5fa222-64e2-41eb-a9d0-73d936d32c80-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd5fa222-64e2-41eb-a9d0-73d936d32c80" (UID: "fd5fa222-64e2-41eb-a9d0-73d936d32c80"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:38:22.782917 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.782893    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5fa222-64e2-41eb-a9d0-73d936d32c80-kube-api-access-l5nn6" (OuterVolumeSpecName: "kube-api-access-l5nn6") pod "fd5fa222-64e2-41eb-a9d0-73d936d32c80" (UID: "fd5fa222-64e2-41eb-a9d0-73d936d32c80"). InnerVolumeSpecName "kube-api-access-l5nn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:38:22.881976 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.881904    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5nn6\" (UniqueName: \"kubernetes.io/projected/fd5fa222-64e2-41eb-a9d0-73d936d32c80-kube-api-access-l5nn6\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:38:22.881976 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:22.881941    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd5fa222-64e2-41eb-a9d0-73d936d32c80-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:38:23.055055 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:23.055023    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"]
Sep 10 19:38:23.062336 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:23.062311    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26a424d6-64c9b4d978-nnfxp"]
Sep 10 19:38:24.669119 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:24.669085    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd5fa222-64e2-41eb-a9d0-73d936d32c80" path="/var/lib/kubelet/pods/fd5fa222-64e2-41eb-a9d0-73d936d32c80/volumes"
Sep 10 19:38:48.714146 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:38:48.714115    2582 scope.go:117] "RemoveContainer" containerID="624c07780b144617a1f850ae6f6eb52f3f74c20e5c725b8b503e5f21fe2e8186"
Sep 10 19:40:15.567883 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.567803    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"]
Sep 10 19:40:15.568335 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.568171    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5fa222-64e2-41eb-a9d0-73d936d32c80" containerName="payload-pre-processing"
Sep 10 19:40:15.568335 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.568184    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5fa222-64e2-41eb-a9d0-73d936d32c80" containerName="payload-pre-processing"
Sep 10 19:40:15.568335 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.568273    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5fa222-64e2-41eb-a9d0-73d936d32c80" containerName="payload-pre-processing"
Sep 10 19:40:15.571315 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.571290    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:15.573565 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.573541    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-846240\""
Sep 10 19:40:15.573697 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.573627    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-846240-dockercfg-4w7cj\""
Sep 10 19:40:15.580345 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.580323    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"]
Sep 10 19:40:15.721948 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.721911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45wtj\" (UniqueName: \"kubernetes.io/projected/6daa4772-d012-4dc5-928e-d44aeeef674b-kube-api-access-45wtj\") pod \"payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh\" (UID: \"6daa4772-d012-4dc5-928e-d44aeeef674b\") " pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:15.722121 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.721973    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6daa4772-d012-4dc5-928e-d44aeeef674b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh\" (UID: \"6daa4772-d012-4dc5-928e-d44aeeef674b\") " pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:15.823471 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.823333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6daa4772-d012-4dc5-928e-d44aeeef674b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh\" (UID: \"6daa4772-d012-4dc5-928e-d44aeeef674b\") " pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:15.823669 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.823578    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45wtj\" (UniqueName: \"kubernetes.io/projected/6daa4772-d012-4dc5-928e-d44aeeef674b-kube-api-access-45wtj\") pod \"payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh\" (UID: \"6daa4772-d012-4dc5-928e-d44aeeef674b\") " pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:15.824232 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.824213    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6daa4772-d012-4dc5-928e-d44aeeef674b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh\" (UID: \"6daa4772-d012-4dc5-928e-d44aeeef674b\") " pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:15.832579 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.832557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45wtj\" (UniqueName: \"kubernetes.io/projected/6daa4772-d012-4dc5-928e-d44aeeef674b-kube-api-access-45wtj\") pod \"payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh\" (UID: \"6daa4772-d012-4dc5-928e-d44aeeef674b\") " pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:15.882743 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:15.882706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:16.163503 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:16.160895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"]
Sep 10 19:40:16.166712 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:40:16.166681    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6daa4772_d012_4dc5_928e_d44aeeef674b.slice/crio-1eedb472cd7c925e614c00a7bb5879c1f2e98dc300cff2b2c55809844064b2b4 WatchSource:0}: Error finding container 1eedb472cd7c925e614c00a7bb5879c1f2e98dc300cff2b2c55809844064b2b4: Status 404 returned error can't find the container with id 1eedb472cd7c925e614c00a7bb5879c1f2e98dc300cff2b2c55809844064b2b4
Sep 10 19:40:16.256989 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:16.256956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh" event={"ID":"6daa4772-d012-4dc5-928e-d44aeeef674b","Type":"ContainerStarted","Data":"c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306"}
Sep 10 19:40:16.257145 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:16.257005    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh" event={"ID":"6daa4772-d012-4dc5-928e-d44aeeef674b","Type":"ContainerStarted","Data":"1eedb472cd7c925e614c00a7bb5879c1f2e98dc300cff2b2c55809844064b2b4"}
Sep 10 19:40:16.257145 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:16.257044    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:16.276100 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:16.276040    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh" podStartSLOduration=1.276023891 podStartE2EDuration="1.276023891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:40:16.273800773 +0000 UTC m=+1468.129355815" watchObservedRunningTime="2026-09-10 19:40:16.276023891 +0000 UTC m=+1468.131578921"
Sep 10 19:40:27.263845 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:27.263813    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:40:44.894249 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:44.894218    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"]
Sep 10 19:40:44.897829 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:44.897806    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:40:44.900308 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:44.900288    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ed39fa-dockercfg-7knxg\""
Sep 10 19:40:44.900442 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:44.900384    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ed39fa\""
Sep 10 19:40:44.908274 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:44.908253    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"]
Sep 10 19:40:44.957401 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:44.957373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38928cf1-e9e0-44c5-a3b6-19504e7d0773-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh\" (UID: \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\") " pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:40:44.957544 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:44.957448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbr8x\" (UniqueName: \"kubernetes.io/projected/38928cf1-e9e0-44c5-a3b6-19504e7d0773-kube-api-access-tbr8x\") pod \"payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh\" (UID: \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\") " pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:40:45.057933 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:45.057897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38928cf1-e9e0-44c5-a3b6-19504e7d0773-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh\" (UID: \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\") " pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:40:45.058102 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:45.057950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbr8x\" (UniqueName: \"kubernetes.io/projected/38928cf1-e9e0-44c5-a3b6-19504e7d0773-kube-api-access-tbr8x\") pod \"payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh\" (UID: \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\") " pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:40:45.058723 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:45.058703    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38928cf1-e9e0-44c5-a3b6-19504e7d0773-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh\" (UID: \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\") " pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:40:45.068583 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:45.068558    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbr8x\" (UniqueName: \"kubernetes.io/projected/38928cf1-e9e0-44c5-a3b6-19504e7d0773-kube-api-access-tbr8x\") pod \"payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh\" (UID: \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\") " pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:40:45.210732 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:45.210656    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:40:45.483678 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:45.483654    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"]
Sep 10 19:40:45.485555 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:40:45.485528    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38928cf1_e9e0_44c5_a3b6_19504e7d0773.slice/crio-e9d320220df400c64eb034c94e988f063402761141ee0d791634bfe8fcf2119f WatchSource:0}: Error finding container e9d320220df400c64eb034c94e988f063402761141ee0d791634bfe8fcf2119f: Status 404 returned error can't find the container with id e9d320220df400c64eb034c94e988f063402761141ee0d791634bfe8fcf2119f
Sep 10 19:40:46.398953 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:46.398909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh" event={"ID":"38928cf1-e9e0-44c5-a3b6-19504e7d0773","Type":"ContainerStarted","Data":"1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb"}
Sep 10 19:40:46.399365 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:46.398970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh" event={"ID":"38928cf1-e9e0-44c5-a3b6-19504e7d0773","Type":"ContainerStarted","Data":"e9d320220df400c64eb034c94e988f063402761141ee0d791634bfe8fcf2119f"}
Sep 10 19:40:46.399365 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:46.399078    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:40:46.419225 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:46.419178    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh" podStartSLOduration=2.419162717 podStartE2EDuration="2.419162717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:40:46.418292264 +0000 UTC m=+1498.273847321" watchObservedRunningTime="2026-09-10 19:40:46.419162717 +0000 UTC m=+1498.274717745"
Sep 10 19:40:57.405584 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:40:57.405549    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:41:26.578447 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:26.578394    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"]
Sep 10 19:41:26.578901 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:26.578660    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh" podUID="6daa4772-d012-4dc5-928e-d44aeeef674b" containerName="payload-processing" containerID="cri-o://c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306" gracePeriod=30
Sep 10 19:41:26.830493 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:26.830430    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:41:26.910442 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:26.910394    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45wtj\" (UniqueName: \"kubernetes.io/projected/6daa4772-d012-4dc5-928e-d44aeeef674b-kube-api-access-45wtj\") pod \"6daa4772-d012-4dc5-928e-d44aeeef674b\" (UID: \"6daa4772-d012-4dc5-928e-d44aeeef674b\") "
Sep 10 19:41:26.910601 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:26.910478    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6daa4772-d012-4dc5-928e-d44aeeef674b-plugins-config-volume\") pod \"6daa4772-d012-4dc5-928e-d44aeeef674b\" (UID: \"6daa4772-d012-4dc5-928e-d44aeeef674b\") "
Sep 10 19:41:26.910857 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:26.910822    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6daa4772-d012-4dc5-928e-d44aeeef674b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6daa4772-d012-4dc5-928e-d44aeeef674b" (UID: "6daa4772-d012-4dc5-928e-d44aeeef674b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:41:26.912497 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:26.912474    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6daa4772-d012-4dc5-928e-d44aeeef674b-kube-api-access-45wtj" (OuterVolumeSpecName: "kube-api-access-45wtj") pod "6daa4772-d012-4dc5-928e-d44aeeef674b" (UID: "6daa4772-d012-4dc5-928e-d44aeeef674b"). InnerVolumeSpecName "kube-api-access-45wtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:41:27.011584 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.011546    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6daa4772-d012-4dc5-928e-d44aeeef674b-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:41:27.011584 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.011580    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45wtj\" (UniqueName: \"kubernetes.io/projected/6daa4772-d012-4dc5-928e-d44aeeef674b-kube-api-access-45wtj\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:41:27.599045 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.599006    2582 generic.go:356] "Generic (PLEG): container finished" podID="6daa4772-d012-4dc5-928e-d44aeeef674b" containerID="c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306" exitCode=0
Sep 10 19:41:27.599475 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.599061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh" event={"ID":"6daa4772-d012-4dc5-928e-d44aeeef674b","Type":"ContainerDied","Data":"c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306"}
Sep 10 19:41:27.599475 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.599074    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"
Sep 10 19:41:27.599475 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.599148    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh" event={"ID":"6daa4772-d012-4dc5-928e-d44aeeef674b","Type":"ContainerDied","Data":"1eedb472cd7c925e614c00a7bb5879c1f2e98dc300cff2b2c55809844064b2b4"}
Sep 10 19:41:27.599475 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.599181    2582 scope.go:117] "RemoveContainer" containerID="c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306"
Sep 10 19:41:27.610715 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.610687    2582 scope.go:117] "RemoveContainer" containerID="c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306"
Sep 10 19:41:27.611135 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:41:27.611113    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306\": container with ID starting with c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306 not found: ID does not exist" containerID="c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306"
Sep 10 19:41:27.611215 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.611143    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306"} err="failed to get container status \"c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306\": rpc error: code = NotFound desc = could not find container \"c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306\": container with ID starting with c1b3d981e370a6f5f5f824698d81fbfed28f959abebf5da4eca6de3fc3d95306 not found: ID does not exist"
Sep 10 19:41:27.625199 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.625171    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"]
Sep 10 19:41:27.629837 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:27.629816    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-846240-b7bc7c9c5-lnxgh"]
Sep 10 19:41:28.668276 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:28.668242    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6daa4772-d012-4dc5-928e-d44aeeef674b" path="/var/lib/kubelet/pods/6daa4772-d012-4dc5-928e-d44aeeef674b/volumes"
Sep 10 19:41:49.751750 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:49.751712    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"]
Sep 10 19:41:49.752207 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:49.751998    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh" podUID="38928cf1-e9e0-44c5-a3b6-19504e7d0773" containerName="payload-processing" containerID="cri-o://1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb" gracePeriod=30
Sep 10 19:41:50.001138 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.001114    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:41:50.108455 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.108420    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbr8x\" (UniqueName: \"kubernetes.io/projected/38928cf1-e9e0-44c5-a3b6-19504e7d0773-kube-api-access-tbr8x\") pod \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\" (UID: \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\") "
Sep 10 19:41:50.108655 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.108563    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38928cf1-e9e0-44c5-a3b6-19504e7d0773-plugins-config-volume\") pod \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\" (UID: \"38928cf1-e9e0-44c5-a3b6-19504e7d0773\") "
Sep 10 19:41:50.108939 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.108914    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38928cf1-e9e0-44c5-a3b6-19504e7d0773-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "38928cf1-e9e0-44c5-a3b6-19504e7d0773" (UID: "38928cf1-e9e0-44c5-a3b6-19504e7d0773"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:41:50.110945 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.110920    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38928cf1-e9e0-44c5-a3b6-19504e7d0773-kube-api-access-tbr8x" (OuterVolumeSpecName: "kube-api-access-tbr8x") pod "38928cf1-e9e0-44c5-a3b6-19504e7d0773" (UID: "38928cf1-e9e0-44c5-a3b6-19504e7d0773"). InnerVolumeSpecName "kube-api-access-tbr8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:41:50.209742 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.209715    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbr8x\" (UniqueName: \"kubernetes.io/projected/38928cf1-e9e0-44c5-a3b6-19504e7d0773-kube-api-access-tbr8x\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:41:50.209742 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.209740    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38928cf1-e9e0-44c5-a3b6-19504e7d0773-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:41:50.709075 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.709045    2582 generic.go:356] "Generic (PLEG): container finished" podID="38928cf1-e9e0-44c5-a3b6-19504e7d0773" containerID="1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb" exitCode=0
Sep 10 19:41:50.709223 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.709084    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"
Sep 10 19:41:50.709223 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.709128    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh" event={"ID":"38928cf1-e9e0-44c5-a3b6-19504e7d0773","Type":"ContainerDied","Data":"1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb"}
Sep 10 19:41:50.709223 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.709178    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh" event={"ID":"38928cf1-e9e0-44c5-a3b6-19504e7d0773","Type":"ContainerDied","Data":"e9d320220df400c64eb034c94e988f063402761141ee0d791634bfe8fcf2119f"}
Sep 10 19:41:50.709223 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.709205    2582 scope.go:117] "RemoveContainer" containerID="1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb"
Sep 10 19:41:50.718437 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.718396    2582 scope.go:117] "RemoveContainer" containerID="1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb"
Sep 10 19:41:50.718724 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:41:50.718700    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb\": container with ID starting with 1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb not found: ID does not exist" containerID="1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb"
Sep 10 19:41:50.718797 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.718731    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb"} err="failed to get container status \"1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb\": rpc error: code = NotFound desc = could not find container \"1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb\": container with ID starting with 1cc5a5f934ba88136ae791f81bae414870a4f3ee8cd3847381d232fa7ec760cb not found: ID does not exist"
Sep 10 19:41:50.728388 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.728362    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"]
Sep 10 19:41:50.733391 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:50.733367    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ed39fa-5456ccf869-wgnkh"]
Sep 10 19:41:52.668622 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:41:52.668589    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38928cf1-e9e0-44c5-a3b6-19504e7d0773" path="/var/lib/kubelet/pods/38928cf1-e9e0-44c5-a3b6-19504e7d0773/volumes"
Sep 10 19:42:07.845632 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:07.845592    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"]
Sep 10 19:42:07.846245 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:07.845825    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw" podUID="b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" containerName="maas-api" containerID="cri-o://16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000" gracePeriod=30
Sep 10 19:42:08.086065 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.086041    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:42:08.167713 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.167631    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-metrics-certs\") pod \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") "
Sep 10 19:42:08.167713 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.167675    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvhql\" (UniqueName: \"kubernetes.io/projected/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-kube-api-access-vvhql\") pod \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") "
Sep 10 19:42:08.167713 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.167715    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-openshift-service-ca\") pod \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") "
Sep 10 19:42:08.167990 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.167729    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-maas-api-tls\") pod \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\" (UID: \"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9\") "
Sep 10 19:42:08.168082 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.168058    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" (UID: "b905a5e4-5b6e-49ca-8d4a-7330adcd56a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:42:08.169701 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.169675    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" (UID: "b905a5e4-5b6e-49ca-8d4a-7330adcd56a9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:42:08.169832 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.169817    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" (UID: "b905a5e4-5b6e-49ca-8d4a-7330adcd56a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:42:08.169919 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.169896    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-kube-api-access-vvhql" (OuterVolumeSpecName: "kube-api-access-vvhql") pod "b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" (UID: "b905a5e4-5b6e-49ca-8d4a-7330adcd56a9"). InnerVolumeSpecName "kube-api-access-vvhql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:42:08.269197 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.269158    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:42:08.269197 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.269187    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:42:08.269197 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.269206    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:42:08.269460 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.269214    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvhql\" (UniqueName: \"kubernetes.io/projected/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9-kube-api-access-vvhql\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:42:08.796755 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.796714    2582 generic.go:356] "Generic (PLEG): container finished" podID="b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" containerID="16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000" exitCode=0
Sep 10 19:42:08.796937 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.796764    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"
Sep 10 19:42:08.796937 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.796785    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw" event={"ID":"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9","Type":"ContainerDied","Data":"16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000"}
Sep 10 19:42:08.796937 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.796839    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw" event={"ID":"b905a5e4-5b6e-49ca-8d4a-7330adcd56a9","Type":"ContainerDied","Data":"111936ad4f563c41c6373e125b92855fd68b2d9f85bf81364c85a24f4a800382"}
Sep 10 19:42:08.796937 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.796868    2582 scope.go:117] "RemoveContainer" containerID="16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000"
Sep 10 19:42:08.805736 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.805716    2582 scope.go:117] "RemoveContainer" containerID="16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000"
Sep 10 19:42:08.806003 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:42:08.805982    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000\": container with ID starting with 16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000 not found: ID does not exist" containerID="16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000"
Sep 10 19:42:08.806071 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.806016    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000"} err="failed to get container status \"16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000\": rpc error: code = NotFound desc = could not find container \"16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000\": container with ID starting with 16d4d1bc31a4b0f9c2d9c8799ea05cb4fb0e2f1dfe2e5f94bd65a7bd38c87000 not found: ID does not exist"
Sep 10 19:42:08.822661 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.822637    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"]
Sep 10 19:42:08.825297 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:08.825274    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-32ce4f-547d9dbb58-l8wvw"]
Sep 10 19:42:10.668572 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:10.668540    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" path="/var/lib/kubelet/pods/b905a5e4-5b6e-49ca-8d4a-7330adcd56a9/volumes"
Sep 10 19:42:26.273955 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.273924    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"]
Sep 10 19:42:26.274469 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.274141    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l" podUID="b9f659cd-ffb2-4554-948e-266944f4dea4" containerName="payload-processing" containerID="cri-o://44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd" gracePeriod=30
Sep 10 19:42:26.281257 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.281226    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"]
Sep 10 19:42:26.281511 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.281482    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk" podUID="37fd68e0-0387-4d91-b241-c4659ed67b7e" containerName="payload-pre-processing" containerID="cri-o://bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76" gracePeriod=30
Sep 10 19:42:26.550934 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.550901    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:42:26.553440 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.553407    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:42:26.620998 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.620964    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd68e0-0387-4d91-b241-c4659ed67b7e-plugins-config-volume\") pod \"37fd68e0-0387-4d91-b241-c4659ed67b7e\" (UID: \"37fd68e0-0387-4d91-b241-c4659ed67b7e\") "
Sep 10 19:42:26.620998 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.621002    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9f659cd-ffb2-4554-948e-266944f4dea4-plugins-config-volume\") pod \"b9f659cd-ffb2-4554-948e-266944f4dea4\" (UID: \"b9f659cd-ffb2-4554-948e-266944f4dea4\") "
Sep 10 19:42:26.621243 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.621029    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jddv\" (UniqueName: \"kubernetes.io/projected/b9f659cd-ffb2-4554-948e-266944f4dea4-kube-api-access-9jddv\") pod \"b9f659cd-ffb2-4554-948e-266944f4dea4\" (UID: \"b9f659cd-ffb2-4554-948e-266944f4dea4\") "
Sep 10 19:42:26.621243 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.621158    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4f6d\" (UniqueName: \"kubernetes.io/projected/37fd68e0-0387-4d91-b241-c4659ed67b7e-kube-api-access-m4f6d\") pod \"37fd68e0-0387-4d91-b241-c4659ed67b7e\" (UID: \"37fd68e0-0387-4d91-b241-c4659ed67b7e\") "
Sep 10 19:42:26.621443 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.621392    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fd68e0-0387-4d91-b241-c4659ed67b7e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37fd68e0-0387-4d91-b241-c4659ed67b7e" (UID: "37fd68e0-0387-4d91-b241-c4659ed67b7e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:42:26.621500 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.621395    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f659cd-ffb2-4554-948e-266944f4dea4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9f659cd-ffb2-4554-948e-266944f4dea4" (UID: "b9f659cd-ffb2-4554-948e-266944f4dea4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:42:26.623094 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.623073    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f659cd-ffb2-4554-948e-266944f4dea4-kube-api-access-9jddv" (OuterVolumeSpecName: "kube-api-access-9jddv") pod "b9f659cd-ffb2-4554-948e-266944f4dea4" (UID: "b9f659cd-ffb2-4554-948e-266944f4dea4"). InnerVolumeSpecName "kube-api-access-9jddv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:42:26.623149 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.623111    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37fd68e0-0387-4d91-b241-c4659ed67b7e-kube-api-access-m4f6d" (OuterVolumeSpecName: "kube-api-access-m4f6d") pod "37fd68e0-0387-4d91-b241-c4659ed67b7e" (UID: "37fd68e0-0387-4d91-b241-c4659ed67b7e"). InnerVolumeSpecName "kube-api-access-m4f6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:42:26.722075 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.722046    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4f6d\" (UniqueName: \"kubernetes.io/projected/37fd68e0-0387-4d91-b241-c4659ed67b7e-kube-api-access-m4f6d\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:42:26.722075 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.722072    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37fd68e0-0387-4d91-b241-c4659ed67b7e-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:42:26.722241 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.722081    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9f659cd-ffb2-4554-948e-266944f4dea4-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:42:26.722241 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.722091    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jddv\" (UniqueName: \"kubernetes.io/projected/b9f659cd-ffb2-4554-948e-266944f4dea4-kube-api-access-9jddv\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:42:26.877082 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.876993    2582 generic.go:356] "Generic (PLEG): container finished" podID="37fd68e0-0387-4d91-b241-c4659ed67b7e" containerID="bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76" exitCode=0
Sep 10 19:42:26.877082 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.877033    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"
Sep 10 19:42:26.877294 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.877084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk" event={"ID":"37fd68e0-0387-4d91-b241-c4659ed67b7e","Type":"ContainerDied","Data":"bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76"}
Sep 10 19:42:26.877294 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.877137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk" event={"ID":"37fd68e0-0387-4d91-b241-c4659ed67b7e","Type":"ContainerDied","Data":"2bf82e704df491533781e5ee0b66d745d247ab34c65aa41013d0d865106e5043"}
Sep 10 19:42:26.877294 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.877167    2582 scope.go:117] "RemoveContainer" containerID="bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76"
Sep 10 19:42:26.878485 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.878466    2582 generic.go:356] "Generic (PLEG): container finished" podID="b9f659cd-ffb2-4554-948e-266944f4dea4" containerID="44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd" exitCode=0
Sep 10 19:42:26.878601 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.878497    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l" event={"ID":"b9f659cd-ffb2-4554-948e-266944f4dea4","Type":"ContainerDied","Data":"44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd"}
Sep 10 19:42:26.878601 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.878524    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"
Sep 10 19:42:26.878601 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.878549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l" event={"ID":"b9f659cd-ffb2-4554-948e-266944f4dea4","Type":"ContainerDied","Data":"149e3f2f2aeaedbeb4798fc26969edc51b90595f107ef2ef821e28d4466abe10"}
Sep 10 19:42:26.885925 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.885910    2582 scope.go:117] "RemoveContainer" containerID="bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76"
Sep 10 19:42:26.886205 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:42:26.886187    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76\": container with ID starting with bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76 not found: ID does not exist" containerID="bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76"
Sep 10 19:42:26.886281 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.886217    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76"} err="failed to get container status \"bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76\": rpc error: code = NotFound desc = could not find container \"bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76\": container with ID starting with bbe7ee540ef1c33016a1a54d601f310260459b71f013874280ffcd525c42ba76 not found: ID does not exist"
Sep 10 19:42:26.886281 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.886240    2582 scope.go:117] "RemoveContainer" containerID="44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd"
Sep 10 19:42:26.893521 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.893492    2582 scope.go:117] "RemoveContainer" containerID="44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd"
Sep 10 19:42:26.893785 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:42:26.893767    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd\": container with ID starting with 44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd not found: ID does not exist" containerID="44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd"
Sep 10 19:42:26.893855 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.893790    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd"} err="failed to get container status \"44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd\": rpc error: code = NotFound desc = could not find container \"44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd\": container with ID starting with 44e15caea25a446efe4f8501901e1ffb4be5234e3a0beda6d819fe11055546dd not found: ID does not exist"
Sep 10 19:42:26.898111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.898090    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"]
Sep 10 19:42:26.905499 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.905478    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7bfb5d-7fc8d56cf-z6p4l"]
Sep 10 19:42:26.916840 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.916816    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"]
Sep 10 19:42:26.921368 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:26.921347    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7bfb5d-5f6cbc8474-b8vhk"]
Sep 10 19:42:28.668509 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:28.668478    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37fd68e0-0387-4d91-b241-c4659ed67b7e" path="/var/lib/kubelet/pods/37fd68e0-0387-4d91-b241-c4659ed67b7e/volumes"
Sep 10 19:42:28.668877 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:28.668833    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f659cd-ffb2-4554-948e-266944f4dea4" path="/var/lib/kubelet/pods/b9f659cd-ffb2-4554-948e-266944f4dea4/volumes"
Sep 10 19:42:39.813515 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813477    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"]
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813892    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6daa4772-d012-4dc5-928e-d44aeeef674b" containerName="payload-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813908    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6daa4772-d012-4dc5-928e-d44aeeef674b" containerName="payload-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813921    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38928cf1-e9e0-44c5-a3b6-19504e7d0773" containerName="payload-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813930    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38928cf1-e9e0-44c5-a3b6-19504e7d0773" containerName="payload-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813939    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" containerName="maas-api"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813945    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" containerName="maas-api"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813952    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f659cd-ffb2-4554-948e-266944f4dea4" containerName="payload-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813961    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f659cd-ffb2-4554-948e-266944f4dea4" containerName="payload-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813970    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fd68e0-0387-4d91-b241-c4659ed67b7e" containerName="payload-pre-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.813975    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fd68e0-0387-4d91-b241-c4659ed67b7e" containerName="payload-pre-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.814036    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b905a5e4-5b6e-49ca-8d4a-7330adcd56a9" containerName="maas-api"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.814046    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="37fd68e0-0387-4d91-b241-c4659ed67b7e" containerName="payload-pre-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.814058    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f659cd-ffb2-4554-948e-266944f4dea4" containerName="payload-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.814068    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="38928cf1-e9e0-44c5-a3b6-19504e7d0773" containerName="payload-processing"
Sep 10 19:42:39.814111 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.814078    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6daa4772-d012-4dc5-928e-d44aeeef674b" containerName="payload-processing"
Sep 10 19:42:39.818373 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.818348    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:39.820738 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.820707    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-63ed30-serving-cert\""
Sep 10 19:42:39.828853 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.828824    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"]
Sep 10 19:42:39.930129 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.930100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-metrics-certs\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:39.930289 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.930147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604dcfbd-a5a2-4195-a73f-abec65dbd777-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:39.930289 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.930209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rzsm\" (UniqueName: \"kubernetes.io/projected/604dcfbd-a5a2-4195-a73f-abec65dbd777-kube-api-access-9rzsm\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:39.930289 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:39.930258    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-maas-api-tls\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.031031 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.030989    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-metrics-certs\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.031218 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.031055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604dcfbd-a5a2-4195-a73f-abec65dbd777-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.031218 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.031100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rzsm\" (UniqueName: \"kubernetes.io/projected/604dcfbd-a5a2-4195-a73f-abec65dbd777-kube-api-access-9rzsm\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.031218 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.031141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-maas-api-tls\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.031791 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.031766    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604dcfbd-a5a2-4195-a73f-abec65dbd777-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.033526 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.033506    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-metrics-certs\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.033584 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.033546    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-maas-api-tls\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.039671 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.039648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rzsm\" (UniqueName: \"kubernetes.io/projected/604dcfbd-a5a2-4195-a73f-abec65dbd777-kube-api-access-9rzsm\") pod \"maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.132388 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.132324    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.405214 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.405035    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"]
Sep 10 19:42:40.407921 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:42:40.407893    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604dcfbd_a5a2_4195_a73f_abec65dbd777.slice/crio-720d4688b69360246721fa953aead8c9b7a1a977eaa5565e873274eca439af30 WatchSource:0}: Error finding container 720d4688b69360246721fa953aead8c9b7a1a977eaa5565e873274eca439af30: Status 404 returned error can't find the container with id 720d4688b69360246721fa953aead8c9b7a1a977eaa5565e873274eca439af30
Sep 10 19:42:40.409360 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.409341    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:42:40.944939 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.944906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd" event={"ID":"604dcfbd-a5a2-4195-a73f-abec65dbd777","Type":"ContainerStarted","Data":"6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee"}
Sep 10 19:42:40.945390 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.944962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd" event={"ID":"604dcfbd-a5a2-4195-a73f-abec65dbd777","Type":"ContainerStarted","Data":"720d4688b69360246721fa953aead8c9b7a1a977eaa5565e873274eca439af30"}
Sep 10 19:42:40.945390 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.945043    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:42:40.964198 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:40.964157    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd" podStartSLOduration=1.564937351 podStartE2EDuration="1.96414314s" totalImagesPullingTime="399.205789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:42:40.962891159 +0000 UTC m=+1612.818446190" watchObservedRunningTime="2026-09-10 19:42:40.96414314 +0000 UTC m=+1612.819698203"
Sep 10 19:42:46.954473 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:42:46.954435    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:43:09.714361 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.714323    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"]
Sep 10 19:43:09.717780 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.717761    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:09.720105 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.720069    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-544dea\""
Sep 10 19:43:09.720218 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.720161    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-544dea-dockercfg-nlrqn\""
Sep 10 19:43:09.727386 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.727361    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"]
Sep 10 19:43:09.730580 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.730561    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"]
Sep 10 19:43:09.730667 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.730643    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:09.742946 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.742910    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"]
Sep 10 19:43:09.877008 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.876968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1288859a-8fe5-4804-9bca-dd9afa4cdd38-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz\" (UID: \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:09.877210 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.877074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5kf\" (UniqueName: \"kubernetes.io/projected/1288859a-8fe5-4804-9bca-dd9afa4cdd38-kube-api-access-qm5kf\") pod \"payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz\" (UID: \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:09.877210 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.877126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb1e5902-145a-4d75-8e41-32756dd29b72-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p\" (UID: \"eb1e5902-145a-4d75-8e41-32756dd29b72\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:09.877210 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.877179    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4rkp\" (UniqueName: \"kubernetes.io/projected/eb1e5902-145a-4d75-8e41-32756dd29b72-kube-api-access-l4rkp\") pod \"payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p\" (UID: \"eb1e5902-145a-4d75-8e41-32756dd29b72\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:09.977707 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.977618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb1e5902-145a-4d75-8e41-32756dd29b72-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p\" (UID: \"eb1e5902-145a-4d75-8e41-32756dd29b72\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:09.977707 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.977660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4rkp\" (UniqueName: \"kubernetes.io/projected/eb1e5902-145a-4d75-8e41-32756dd29b72-kube-api-access-l4rkp\") pod \"payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p\" (UID: \"eb1e5902-145a-4d75-8e41-32756dd29b72\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:09.977911 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.977710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1288859a-8fe5-4804-9bca-dd9afa4cdd38-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz\" (UID: \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:09.977911 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.977746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5kf\" (UniqueName: \"kubernetes.io/projected/1288859a-8fe5-4804-9bca-dd9afa4cdd38-kube-api-access-qm5kf\") pod \"payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz\" (UID: \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:09.978530 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.978507    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1288859a-8fe5-4804-9bca-dd9afa4cdd38-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz\" (UID: \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:09.978595 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.978570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb1e5902-145a-4d75-8e41-32756dd29b72-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p\" (UID: \"eb1e5902-145a-4d75-8e41-32756dd29b72\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:09.986626 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.986600    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4rkp\" (UniqueName: \"kubernetes.io/projected/eb1e5902-145a-4d75-8e41-32756dd29b72-kube-api-access-l4rkp\") pod \"payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p\" (UID: \"eb1e5902-145a-4d75-8e41-32756dd29b72\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:09.986939 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:09.986920    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5kf\" (UniqueName: \"kubernetes.io/projected/1288859a-8fe5-4804-9bca-dd9afa4cdd38-kube-api-access-qm5kf\") pod \"payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz\" (UID: \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:10.028583 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:10.028555    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:10.040626 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:10.040600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:10.306895 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:10.306869    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"]
Sep 10 19:43:10.308958 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:43:10.308933    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1288859a_8fe5_4804_9bca_dd9afa4cdd38.slice/crio-ba16da5dbaec187af7be679eb61e607ceaaedf91ca9497676540c0bdc137b3a0 WatchSource:0}: Error finding container ba16da5dbaec187af7be679eb61e607ceaaedf91ca9497676540c0bdc137b3a0: Status 404 returned error can't find the container with id ba16da5dbaec187af7be679eb61e607ceaaedf91ca9497676540c0bdc137b3a0
Sep 10 19:43:10.326214 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:10.326192    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"]
Sep 10 19:43:10.327620 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:43:10.327597    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1e5902_145a_4d75_8e41_32756dd29b72.slice/crio-2f514236e88d0a5c9730d1be41f09e347ce45663d3f884eb43677d8e6e4806dd WatchSource:0}: Error finding container 2f514236e88d0a5c9730d1be41f09e347ce45663d3f884eb43677d8e6e4806dd: Status 404 returned error can't find the container with id 2f514236e88d0a5c9730d1be41f09e347ce45663d3f884eb43677d8e6e4806dd
Sep 10 19:43:11.087098 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:11.087058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p" event={"ID":"eb1e5902-145a-4d75-8e41-32756dd29b72","Type":"ContainerStarted","Data":"e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc"}
Sep 10 19:43:11.087728 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:11.087117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p" event={"ID":"eb1e5902-145a-4d75-8e41-32756dd29b72","Type":"ContainerStarted","Data":"2f514236e88d0a5c9730d1be41f09e347ce45663d3f884eb43677d8e6e4806dd"}
Sep 10 19:43:11.087728 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:11.087148    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:11.088780 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:11.088756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz" event={"ID":"1288859a-8fe5-4804-9bca-dd9afa4cdd38","Type":"ContainerStarted","Data":"778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7"}
Sep 10 19:43:11.088898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:11.088799    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz" event={"ID":"1288859a-8fe5-4804-9bca-dd9afa4cdd38","Type":"ContainerStarted","Data":"ba16da5dbaec187af7be679eb61e607ceaaedf91ca9497676540c0bdc137b3a0"}
Sep 10 19:43:11.088898 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:11.088883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:11.106700 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:11.106654    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p" podStartSLOduration=2.106636173 podStartE2EDuration="2.106636173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:43:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:43:11.103925303 +0000 UTC m=+1642.959480351" watchObservedRunningTime="2026-09-10 19:43:11.106636173 +0000 UTC m=+1642.962191204"
Sep 10 19:43:11.122746 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:11.122707    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz" podStartSLOduration=2.122693373 podStartE2EDuration="2.122693373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:43:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:43:11.120796531 +0000 UTC m=+1642.976351573" watchObservedRunningTime="2026-09-10 19:43:11.122693373 +0000 UTC m=+1642.978248445"
Sep 10 19:43:22.095139 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:22.095106    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:43:22.095553 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:22.095324    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:43:38.280365 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:43:38.280331    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p_eb1e5902-145a-4d75-8e41-32756dd29b72/payload-processing/0.log"
Sep 10 19:44:19.347299 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:19.347273    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p_eb1e5902-145a-4d75-8e41-32756dd29b72/payload-processing/0.log"
Sep 10 19:44:25.368482 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.368446    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"]
Sep 10 19:44:25.371753 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.371736    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:25.374155 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.374125    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-07ffe4-dockercfg-2526q\""
Sep 10 19:44:25.374155 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.374142    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-07ffe4\""
Sep 10 19:44:25.381527 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.381505    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"]
Sep 10 19:44:25.493861 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.493831    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d680b74-b020-4a5b-8106-da63e0bccdb7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8\" (UID: \"7d680b74-b020-4a5b-8106-da63e0bccdb7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:25.493861 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.493864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjbfb\" (UniqueName: \"kubernetes.io/projected/7d680b74-b020-4a5b-8106-da63e0bccdb7-kube-api-access-jjbfb\") pod \"payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8\" (UID: \"7d680b74-b020-4a5b-8106-da63e0bccdb7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:25.595327 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.595293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d680b74-b020-4a5b-8106-da63e0bccdb7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8\" (UID: \"7d680b74-b020-4a5b-8106-da63e0bccdb7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:25.595327 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.595325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbfb\" (UniqueName: \"kubernetes.io/projected/7d680b74-b020-4a5b-8106-da63e0bccdb7-kube-api-access-jjbfb\") pod \"payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8\" (UID: \"7d680b74-b020-4a5b-8106-da63e0bccdb7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:25.595997 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.595975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d680b74-b020-4a5b-8106-da63e0bccdb7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8\" (UID: \"7d680b74-b020-4a5b-8106-da63e0bccdb7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:25.606096 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.606073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjbfb\" (UniqueName: \"kubernetes.io/projected/7d680b74-b020-4a5b-8106-da63e0bccdb7-kube-api-access-jjbfb\") pod \"payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8\" (UID: \"7d680b74-b020-4a5b-8106-da63e0bccdb7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:25.682765 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.682686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:25.954245 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:25.954220    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"]
Sep 10 19:44:25.956370 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:44:25.956344    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d680b74_b020_4a5b_8106_da63e0bccdb7.slice/crio-d83eec86c07163828a1e9f5a91a653060be5a5862b261539ee45ab03157c41f8 WatchSource:0}: Error finding container d83eec86c07163828a1e9f5a91a653060be5a5862b261539ee45ab03157c41f8: Status 404 returned error can't find the container with id d83eec86c07163828a1e9f5a91a653060be5a5862b261539ee45ab03157c41f8
Sep 10 19:44:26.446934 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:26.446901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8" event={"ID":"7d680b74-b020-4a5b-8106-da63e0bccdb7","Type":"ContainerStarted","Data":"4dd229c15f67127c4dbca258468b8f93209389f1688e27cdb0dcb58953d504df"}
Sep 10 19:44:26.447319 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:26.446959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8" event={"ID":"7d680b74-b020-4a5b-8106-da63e0bccdb7","Type":"ContainerStarted","Data":"d83eec86c07163828a1e9f5a91a653060be5a5862b261539ee45ab03157c41f8"}
Sep 10 19:44:26.447319 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:26.447003    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:26.466989 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:26.466944    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8" podStartSLOduration=1.466931916 podStartE2EDuration="1.466931916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:44:26.465449515 +0000 UTC m=+1718.321004571" watchObservedRunningTime="2026-09-10 19:44:26.466931916 +0000 UTC m=+1718.322486945"
Sep 10 19:44:37.454861 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:37.454828    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:55.341688 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.341650    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"]
Sep 10 19:44:55.342201 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.341914    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8" podUID="7d680b74-b020-4a5b-8106-da63e0bccdb7" containerName="payload-processing" containerID="cri-o://4dd229c15f67127c4dbca258468b8f93209389f1688e27cdb0dcb58953d504df" gracePeriod=30
Sep 10 19:44:55.584468 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.584405    2582 generic.go:356] "Generic (PLEG): container finished" podID="7d680b74-b020-4a5b-8106-da63e0bccdb7" containerID="4dd229c15f67127c4dbca258468b8f93209389f1688e27cdb0dcb58953d504df" exitCode=0
Sep 10 19:44:55.584604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.584476    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8" event={"ID":"7d680b74-b020-4a5b-8106-da63e0bccdb7","Type":"ContainerDied","Data":"4dd229c15f67127c4dbca258468b8f93209389f1688e27cdb0dcb58953d504df"}
Sep 10 19:44:55.584604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.584524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8" event={"ID":"7d680b74-b020-4a5b-8106-da63e0bccdb7","Type":"ContainerDied","Data":"d83eec86c07163828a1e9f5a91a653060be5a5862b261539ee45ab03157c41f8"}
Sep 10 19:44:55.584604 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.584543    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d83eec86c07163828a1e9f5a91a653060be5a5862b261539ee45ab03157c41f8"
Sep 10 19:44:55.589014 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.588994    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:55.621511 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.621400    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d680b74-b020-4a5b-8106-da63e0bccdb7-plugins-config-volume\") pod \"7d680b74-b020-4a5b-8106-da63e0bccdb7\" (UID: \"7d680b74-b020-4a5b-8106-da63e0bccdb7\") "
Sep 10 19:44:55.621679 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.621565    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjbfb\" (UniqueName: \"kubernetes.io/projected/7d680b74-b020-4a5b-8106-da63e0bccdb7-kube-api-access-jjbfb\") pod \"7d680b74-b020-4a5b-8106-da63e0bccdb7\" (UID: \"7d680b74-b020-4a5b-8106-da63e0bccdb7\") "
Sep 10 19:44:55.621737 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.621710    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d680b74-b020-4a5b-8106-da63e0bccdb7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d680b74-b020-4a5b-8106-da63e0bccdb7" (UID: "7d680b74-b020-4a5b-8106-da63e0bccdb7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:44:55.621856 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.621839    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d680b74-b020-4a5b-8106-da63e0bccdb7-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:44:55.623594 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.623571    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d680b74-b020-4a5b-8106-da63e0bccdb7-kube-api-access-jjbfb" (OuterVolumeSpecName: "kube-api-access-jjbfb") pod "7d680b74-b020-4a5b-8106-da63e0bccdb7" (UID: "7d680b74-b020-4a5b-8106-da63e0bccdb7"). InnerVolumeSpecName "kube-api-access-jjbfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:44:55.722964 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:55.722928    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjbfb\" (UniqueName: \"kubernetes.io/projected/7d680b74-b020-4a5b-8106-da63e0bccdb7-kube-api-access-jjbfb\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:44:56.588517 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:56.588482    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"
Sep 10 19:44:56.611585 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:56.611554    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"]
Sep 10 19:44:56.616681 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:56.616654    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07ffe4-b48cddddc-qfhp8"]
Sep 10 19:44:56.668467 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:44:56.668437    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d680b74-b020-4a5b-8106-da63e0bccdb7" path="/var/lib/kubelet/pods/7d680b74-b020-4a5b-8106-da63e0bccdb7/volumes"
Sep 10 19:45:21.846756 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:21.846672    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"]
Sep 10 19:45:21.847364 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:21.846900    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd" podUID="604dcfbd-a5a2-4195-a73f-abec65dbd777" containerName="maas-api" containerID="cri-o://6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee" gracePeriod=30
Sep 10 19:45:21.949900 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:21.949862    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd" podUID="604dcfbd-a5a2-4195-a73f-abec65dbd777" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.52:8443/health\": dial tcp 10.134.0.52:8443: connect: connection refused"
Sep 10 19:45:22.090458 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.090399    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:45:22.149246 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.149171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604dcfbd-a5a2-4195-a73f-abec65dbd777-openshift-service-ca\") pod \"604dcfbd-a5a2-4195-a73f-abec65dbd777\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") "
Sep 10 19:45:22.149400 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.149250    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-metrics-certs\") pod \"604dcfbd-a5a2-4195-a73f-abec65dbd777\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") "
Sep 10 19:45:22.149400 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.149299    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-maas-api-tls\") pod \"604dcfbd-a5a2-4195-a73f-abec65dbd777\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") "
Sep 10 19:45:22.149400 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.149335    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rzsm\" (UniqueName: \"kubernetes.io/projected/604dcfbd-a5a2-4195-a73f-abec65dbd777-kube-api-access-9rzsm\") pod \"604dcfbd-a5a2-4195-a73f-abec65dbd777\" (UID: \"604dcfbd-a5a2-4195-a73f-abec65dbd777\") "
Sep 10 19:45:22.149607 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.149585    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604dcfbd-a5a2-4195-a73f-abec65dbd777-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "604dcfbd-a5a2-4195-a73f-abec65dbd777" (UID: "604dcfbd-a5a2-4195-a73f-abec65dbd777"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:45:22.149670 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.149652    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604dcfbd-a5a2-4195-a73f-abec65dbd777-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:45:22.151492 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.151460    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "604dcfbd-a5a2-4195-a73f-abec65dbd777" (UID: "604dcfbd-a5a2-4195-a73f-abec65dbd777"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:45:22.151602 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.151522    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604dcfbd-a5a2-4195-a73f-abec65dbd777-kube-api-access-9rzsm" (OuterVolumeSpecName: "kube-api-access-9rzsm") pod "604dcfbd-a5a2-4195-a73f-abec65dbd777" (UID: "604dcfbd-a5a2-4195-a73f-abec65dbd777"). InnerVolumeSpecName "kube-api-access-9rzsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:45:22.151602 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.151586    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "604dcfbd-a5a2-4195-a73f-abec65dbd777" (UID: "604dcfbd-a5a2-4195-a73f-abec65dbd777"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:45:22.250253 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.250216    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:45:22.250253 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.250249    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rzsm\" (UniqueName: \"kubernetes.io/projected/604dcfbd-a5a2-4195-a73f-abec65dbd777-kube-api-access-9rzsm\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:45:22.250253 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.250259    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604dcfbd-a5a2-4195-a73f-abec65dbd777-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:45:22.710344 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.710313    2582 generic.go:356] "Generic (PLEG): container finished" podID="604dcfbd-a5a2-4195-a73f-abec65dbd777" containerID="6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee" exitCode=0
Sep 10 19:45:22.710510 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.710359    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"
Sep 10 19:45:22.710510 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.710395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd" event={"ID":"604dcfbd-a5a2-4195-a73f-abec65dbd777","Type":"ContainerDied","Data":"6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee"}
Sep 10 19:45:22.710510 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.710463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd" event={"ID":"604dcfbd-a5a2-4195-a73f-abec65dbd777","Type":"ContainerDied","Data":"720d4688b69360246721fa953aead8c9b7a1a977eaa5565e873274eca439af30"}
Sep 10 19:45:22.710510 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.710495    2582 scope.go:117] "RemoveContainer" containerID="6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee"
Sep 10 19:45:22.719277 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.719261    2582 scope.go:117] "RemoveContainer" containerID="6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee"
Sep 10 19:45:22.719575 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:45:22.719554    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee\": container with ID starting with 6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee not found: ID does not exist" containerID="6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee"
Sep 10 19:45:22.719634 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.719583    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee"} err="failed to get container status \"6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee\": rpc error: code = NotFound desc = could not find container \"6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee\": container with ID starting with 6439ae54648f845fdb00dc893781243a65a79d407e032e4a0e10efba973b01ee not found: ID does not exist"
Sep 10 19:45:22.728944 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.728925    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"]
Sep 10 19:45:22.735850 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:22.735830    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-63ed30-68dcfcbb5d-gb9bd"]
Sep 10 19:45:24.667871 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:45:24.667833    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="604dcfbd-a5a2-4195-a73f-abec65dbd777" path="/var/lib/kubelet/pods/604dcfbd-a5a2-4195-a73f-abec65dbd777/volumes"
Sep 10 19:46:22.658635 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.658596    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"]
Sep 10 19:46:22.659186 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.658876    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p" podUID="eb1e5902-145a-4d75-8e41-32756dd29b72" containerName="payload-processing" containerID="cri-o://e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc" gracePeriod=30
Sep 10 19:46:22.673473 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.673448    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"]
Sep 10 19:46:22.673716 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.673676    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz" podUID="1288859a-8fe5-4804-9bca-dd9afa4cdd38" containerName="payload-pre-processing" containerID="cri-o://778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7" gracePeriod=30
Sep 10 19:46:22.946748 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.946715    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:46:22.949285 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.949266    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:46:22.993125 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.993081    2582 generic.go:356] "Generic (PLEG): container finished" podID="eb1e5902-145a-4d75-8e41-32756dd29b72" containerID="e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc" exitCode=0
Sep 10 19:46:22.993314 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.993135    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"
Sep 10 19:46:22.993314 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.993166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p" event={"ID":"eb1e5902-145a-4d75-8e41-32756dd29b72","Type":"ContainerDied","Data":"e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc"}
Sep 10 19:46:22.993314 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.993252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p" event={"ID":"eb1e5902-145a-4d75-8e41-32756dd29b72","Type":"ContainerDied","Data":"2f514236e88d0a5c9730d1be41f09e347ce45663d3f884eb43677d8e6e4806dd"}
Sep 10 19:46:22.993314 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.993280    2582 scope.go:117] "RemoveContainer" containerID="e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc"
Sep 10 19:46:22.994832 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.994810    2582 generic.go:356] "Generic (PLEG): container finished" podID="1288859a-8fe5-4804-9bca-dd9afa4cdd38" containerID="778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7" exitCode=0
Sep 10 19:46:22.994927 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.994843    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"
Sep 10 19:46:22.994927 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.994862    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz" event={"ID":"1288859a-8fe5-4804-9bca-dd9afa4cdd38","Type":"ContainerDied","Data":"778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7"}
Sep 10 19:46:22.994927 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:22.994905    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz" event={"ID":"1288859a-8fe5-4804-9bca-dd9afa4cdd38","Type":"ContainerDied","Data":"ba16da5dbaec187af7be679eb61e607ceaaedf91ca9497676540c0bdc137b3a0"}
Sep 10 19:46:23.004037 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.003997    2582 scope.go:117] "RemoveContainer" containerID="e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc"
Sep 10 19:46:23.004443 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:46:23.004400    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc\": container with ID starting with e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc not found: ID does not exist" containerID="e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc"
Sep 10 19:46:23.004537 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.004454    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc"} err="failed to get container status \"e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc\": rpc error: code = NotFound desc = could not find container \"e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc\": container with ID starting with e57d9993996bac821cb9e5a7df3f405f5818c4616390f80948782513518993bc not found: ID does not exist"
Sep 10 19:46:23.004537 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.004476    2582 scope.go:117] "RemoveContainer" containerID="778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7"
Sep 10 19:46:23.013966 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.013885    2582 scope.go:117] "RemoveContainer" containerID="778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7"
Sep 10 19:46:23.014297 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:46:23.014272    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7\": container with ID starting with 778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7 not found: ID does not exist" containerID="778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7"
Sep 10 19:46:23.014427 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.014309    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7"} err="failed to get container status \"778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7\": rpc error: code = NotFound desc = could not find container \"778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7\": container with ID starting with 778d784c3b00da6927dc1866c228533fd4c6e4006d7faaff139e3081a27237b7 not found: ID does not exist"
Sep 10 19:46:23.069629 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.069593    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4rkp\" (UniqueName: \"kubernetes.io/projected/eb1e5902-145a-4d75-8e41-32756dd29b72-kube-api-access-l4rkp\") pod \"eb1e5902-145a-4d75-8e41-32756dd29b72\" (UID: \"eb1e5902-145a-4d75-8e41-32756dd29b72\") "
Sep 10 19:46:23.069784 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.069649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm5kf\" (UniqueName: \"kubernetes.io/projected/1288859a-8fe5-4804-9bca-dd9afa4cdd38-kube-api-access-qm5kf\") pod \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\" (UID: \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\") "
Sep 10 19:46:23.069784 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.069682    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb1e5902-145a-4d75-8e41-32756dd29b72-plugins-config-volume\") pod \"eb1e5902-145a-4d75-8e41-32756dd29b72\" (UID: \"eb1e5902-145a-4d75-8e41-32756dd29b72\") "
Sep 10 19:46:23.069784 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.069712    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1288859a-8fe5-4804-9bca-dd9afa4cdd38-plugins-config-volume\") pod \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\" (UID: \"1288859a-8fe5-4804-9bca-dd9afa4cdd38\") "
Sep 10 19:46:23.070099 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.070071    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb1e5902-145a-4d75-8e41-32756dd29b72-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb1e5902-145a-4d75-8e41-32756dd29b72" (UID: "eb1e5902-145a-4d75-8e41-32756dd29b72"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:46:23.070203 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.070110    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1288859a-8fe5-4804-9bca-dd9afa4cdd38-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1288859a-8fe5-4804-9bca-dd9afa4cdd38" (UID: "1288859a-8fe5-4804-9bca-dd9afa4cdd38"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:46:23.071804 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.071784    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1288859a-8fe5-4804-9bca-dd9afa4cdd38-kube-api-access-qm5kf" (OuterVolumeSpecName: "kube-api-access-qm5kf") pod "1288859a-8fe5-4804-9bca-dd9afa4cdd38" (UID: "1288859a-8fe5-4804-9bca-dd9afa4cdd38"). InnerVolumeSpecName "kube-api-access-qm5kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:23.071901 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.071869    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb1e5902-145a-4d75-8e41-32756dd29b72-kube-api-access-l4rkp" (OuterVolumeSpecName: "kube-api-access-l4rkp") pod "eb1e5902-145a-4d75-8e41-32756dd29b72" (UID: "eb1e5902-145a-4d75-8e41-32756dd29b72"). InnerVolumeSpecName "kube-api-access-l4rkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:23.170670 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.170624    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm5kf\" (UniqueName: \"kubernetes.io/projected/1288859a-8fe5-4804-9bca-dd9afa4cdd38-kube-api-access-qm5kf\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:23.170670 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.170665    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb1e5902-145a-4d75-8e41-32756dd29b72-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:23.170670 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.170676    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1288859a-8fe5-4804-9bca-dd9afa4cdd38-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:23.170670 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.170685    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4rkp\" (UniqueName: \"kubernetes.io/projected/eb1e5902-145a-4d75-8e41-32756dd29b72-kube-api-access-l4rkp\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:23.317463 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.317436    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"]
Sep 10 19:46:23.324911 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.324886    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-544dea-789d86b85c-9f88p"]
Sep 10 19:46:23.336393 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.336369    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"]
Sep 10 19:46:23.340610 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:23.340587    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-544dea-5f848f948b-vmjdz"]
Sep 10 19:46:24.668043 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:24.668008    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1288859a-8fe5-4804-9bca-dd9afa4cdd38" path="/var/lib/kubelet/pods/1288859a-8fe5-4804-9bca-dd9afa4cdd38/volumes"
Sep 10 19:46:24.668441 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:24.668356    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb1e5902-145a-4d75-8e41-32756dd29b72" path="/var/lib/kubelet/pods/eb1e5902-145a-4d75-8e41-32756dd29b72/volumes"
Sep 10 19:46:40.507611 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.507577    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"]
Sep 10 19:46:40.508134 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.507799    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9" podUID="ef00ce67-6409-4bf0-8a7c-d417f757480b" containerName="maas-api" containerID="cri-o://7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770" gracePeriod=30
Sep 10 19:46:40.566179 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.566143    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"]
Sep 10 19:46:40.566424 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.566366    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5" podUID="25d5afda-d332-49c5-9fe4-bd783a51bdba" containerName="payload-processing" containerID="cri-o://a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790" gracePeriod=30
Sep 10 19:46:40.640191 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.640150    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5" podUID="25d5afda-d332-49c5-9fe4-bd783a51bdba" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.43:9004: connect: connection refused"
Sep 10 19:46:40.829795 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.829771    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:46:40.832476 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.832455    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:46:40.920729 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.920697    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5afda-d332-49c5-9fe4-bd783a51bdba-plugins-config-volume\") pod \"25d5afda-d332-49c5-9fe4-bd783a51bdba\" (UID: \"25d5afda-d332-49c5-9fe4-bd783a51bdba\") "
Sep 10 19:46:40.920923 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.920743    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls\") pod \"ef00ce67-6409-4bf0-8a7c-d417f757480b\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") "
Sep 10 19:46:40.920923 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.920771    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z96xs\" (UniqueName: \"kubernetes.io/projected/25d5afda-d332-49c5-9fe4-bd783a51bdba-kube-api-access-z96xs\") pod \"25d5afda-d332-49c5-9fe4-bd783a51bdba\" (UID: \"25d5afda-d332-49c5-9fe4-bd783a51bdba\") "
Sep 10 19:46:40.920923 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.920793    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbbbv\" (UniqueName: \"kubernetes.io/projected/ef00ce67-6409-4bf0-8a7c-d417f757480b-kube-api-access-vbbbv\") pod \"ef00ce67-6409-4bf0-8a7c-d417f757480b\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") "
Sep 10 19:46:40.920923 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.920908    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-metrics-certs\") pod \"ef00ce67-6409-4bf0-8a7c-d417f757480b\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") "
Sep 10 19:46:40.921189 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.921157    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d5afda-d332-49c5-9fe4-bd783a51bdba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "25d5afda-d332-49c5-9fe4-bd783a51bdba" (UID: "25d5afda-d332-49c5-9fe4-bd783a51bdba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:46:40.922854 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.922825    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef00ce67-6409-4bf0-8a7c-d417f757480b" (UID: "ef00ce67-6409-4bf0-8a7c-d417f757480b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:46:40.922986 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.922965    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef00ce67-6409-4bf0-8a7c-d417f757480b-kube-api-access-vbbbv" (OuterVolumeSpecName: "kube-api-access-vbbbv") pod "ef00ce67-6409-4bf0-8a7c-d417f757480b" (UID: "ef00ce67-6409-4bf0-8a7c-d417f757480b"). InnerVolumeSpecName "kube-api-access-vbbbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:40.923030 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.922964    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ef00ce67-6409-4bf0-8a7c-d417f757480b" (UID: "ef00ce67-6409-4bf0-8a7c-d417f757480b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:46:40.923030 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:40.922974    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d5afda-d332-49c5-9fe4-bd783a51bdba-kube-api-access-z96xs" (OuterVolumeSpecName: "kube-api-access-z96xs") pod "25d5afda-d332-49c5-9fe4-bd783a51bdba" (UID: "25d5afda-d332-49c5-9fe4-bd783a51bdba"). InnerVolumeSpecName "kube-api-access-z96xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:41.022225 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.022182    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef00ce67-6409-4bf0-8a7c-d417f757480b-openshift-service-ca\") pod \"ef00ce67-6409-4bf0-8a7c-d417f757480b\" (UID: \"ef00ce67-6409-4bf0-8a7c-d417f757480b\") "
Sep 10 19:46:41.022500 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.022483    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5afda-d332-49c5-9fe4-bd783a51bdba-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:41.022582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.022505    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:41.022582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.022519    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z96xs\" (UniqueName: \"kubernetes.io/projected/25d5afda-d332-49c5-9fe4-bd783a51bdba-kube-api-access-z96xs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:41.022582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.022531    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbbbv\" (UniqueName: \"kubernetes.io/projected/ef00ce67-6409-4bf0-8a7c-d417f757480b-kube-api-access-vbbbv\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:41.022582 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.022544    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef00ce67-6409-4bf0-8a7c-d417f757480b-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:41.022720 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.022572    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef00ce67-6409-4bf0-8a7c-d417f757480b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef00ce67-6409-4bf0-8a7c-d417f757480b" (UID: "ef00ce67-6409-4bf0-8a7c-d417f757480b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:46:41.083459 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.083352    2582 generic.go:356] "Generic (PLEG): container finished" podID="ef00ce67-6409-4bf0-8a7c-d417f757480b" containerID="7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770" exitCode=0
Sep 10 19:46:41.083459 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.083404    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"
Sep 10 19:46:41.083671 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.083466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9" event={"ID":"ef00ce67-6409-4bf0-8a7c-d417f757480b","Type":"ContainerDied","Data":"7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770"}
Sep 10 19:46:41.083671 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.083539    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9" event={"ID":"ef00ce67-6409-4bf0-8a7c-d417f757480b","Type":"ContainerDied","Data":"f284ee7eb873c82328e945a43b2d6cf8995a6410880788bdf2bbf62692f3c0bd"}
Sep 10 19:46:41.083671 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.083572    2582 scope.go:117] "RemoveContainer" containerID="7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770"
Sep 10 19:46:41.084908 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.084887    2582 generic.go:356] "Generic (PLEG): container finished" podID="25d5afda-d332-49c5-9fe4-bd783a51bdba" containerID="a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790" exitCode=0
Sep 10 19:46:41.085027 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.084926    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"
Sep 10 19:46:41.085027 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.084948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5" event={"ID":"25d5afda-d332-49c5-9fe4-bd783a51bdba","Type":"ContainerDied","Data":"a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790"}
Sep 10 19:46:41.085027 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.084988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5" event={"ID":"25d5afda-d332-49c5-9fe4-bd783a51bdba","Type":"ContainerDied","Data":"42f23462fa83df9cf4667e49f15b7b28add66bde9d4ba0c6669688c469507b19"}
Sep 10 19:46:41.095841 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.095823    2582 scope.go:117] "RemoveContainer" containerID="7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770"
Sep 10 19:46:41.096231 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:46:41.096129    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770\": container with ID starting with 7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770 not found: ID does not exist" containerID="7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770"
Sep 10 19:46:41.096231 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.096156    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770"} err="failed to get container status \"7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770\": rpc error: code = NotFound desc = could not find container \"7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770\": container with ID starting with 7d1d5b4109a2bad13cfc1d4cbb1be1ec05dd4636cc1ad5cb792275123fe98770 not found: ID does not exist"
Sep 10 19:46:41.096231 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.096172    2582 scope.go:117] "RemoveContainer" containerID="a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790"
Sep 10 19:46:41.104110 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.104094    2582 scope.go:117] "RemoveContainer" containerID="a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790"
Sep 10 19:46:41.104359 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:46:41.104343    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790\": container with ID starting with a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790 not found: ID does not exist" containerID="a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790"
Sep 10 19:46:41.104398 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.104367    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790"} err="failed to get container status \"a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790\": rpc error: code = NotFound desc = could not find container \"a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790\": container with ID starting with a6e625ea0910dfba3fc254b4e728c545e5d9db8ae406cfa91cce3d047b87a790 not found: ID does not exist"
Sep 10 19:46:41.110571 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.110549    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"]
Sep 10 19:46:41.114559 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.114539    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-28d250-6898c59787-hlgz9"]
Sep 10 19:46:41.122862 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.122842    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef00ce67-6409-4bf0-8a7c-d417f757480b-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:41.125189 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.125168    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"]
Sep 10 19:46:41.132469 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:41.131873    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-28d250-f59c66f77-5bcc5"]
Sep 10 19:46:42.668911 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:42.668874    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25d5afda-d332-49c5-9fe4-bd783a51bdba" path="/var/lib/kubelet/pods/25d5afda-d332-49c5-9fe4-bd783a51bdba/volumes"
Sep 10 19:46:42.669515 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:42.669493    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef00ce67-6409-4bf0-8a7c-d417f757480b" path="/var/lib/kubelet/pods/ef00ce67-6409-4bf0-8a7c-d417f757480b/volumes"
Sep 10 19:46:58.949678 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:58.949638    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"]
Sep 10 19:46:58.950160 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:58.949909    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m" podUID="fe181001-67a9-44b0-93aa-ce538f9aed9d" containerName="payload-processing" containerID="cri-o://9227e3e3d936f069ab82a8e4f400fe16daae31441916d3dd573652a3d98a5ea1" gracePeriod=30
Sep 10 19:46:59.171265 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:59.171231    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe181001-67a9-44b0-93aa-ce538f9aed9d" containerID="9227e3e3d936f069ab82a8e4f400fe16daae31441916d3dd573652a3d98a5ea1" exitCode=0
Sep 10 19:46:59.171468 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:59.171267    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m" event={"ID":"fe181001-67a9-44b0-93aa-ce538f9aed9d","Type":"ContainerDied","Data":"9227e3e3d936f069ab82a8e4f400fe16daae31441916d3dd573652a3d98a5ea1"}
Sep 10 19:46:59.205247 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:59.205182    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:46:59.263891 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:59.263861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9lrq\" (UniqueName: \"kubernetes.io/projected/fe181001-67a9-44b0-93aa-ce538f9aed9d-kube-api-access-x9lrq\") pod \"fe181001-67a9-44b0-93aa-ce538f9aed9d\" (UID: \"fe181001-67a9-44b0-93aa-ce538f9aed9d\") "
Sep 10 19:46:59.264057 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:59.263900    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe181001-67a9-44b0-93aa-ce538f9aed9d-plugins-config-volume\") pod \"fe181001-67a9-44b0-93aa-ce538f9aed9d\" (UID: \"fe181001-67a9-44b0-93aa-ce538f9aed9d\") "
Sep 10 19:46:59.264316 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:59.264286    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe181001-67a9-44b0-93aa-ce538f9aed9d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe181001-67a9-44b0-93aa-ce538f9aed9d" (UID: "fe181001-67a9-44b0-93aa-ce538f9aed9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:46:59.266043 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:59.266011    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe181001-67a9-44b0-93aa-ce538f9aed9d-kube-api-access-x9lrq" (OuterVolumeSpecName: "kube-api-access-x9lrq") pod "fe181001-67a9-44b0-93aa-ce538f9aed9d" (UID: "fe181001-67a9-44b0-93aa-ce538f9aed9d"). InnerVolumeSpecName "kube-api-access-x9lrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:59.364427 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:59.364390    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9lrq\" (UniqueName: \"kubernetes.io/projected/fe181001-67a9-44b0-93aa-ce538f9aed9d-kube-api-access-x9lrq\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:46:59.364427 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:46:59.364437    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe181001-67a9-44b0-93aa-ce538f9aed9d-plugins-config-volume\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:00.176776 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:00.176739    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"
Sep 10 19:47:00.176776 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:00.176772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m" event={"ID":"fe181001-67a9-44b0-93aa-ce538f9aed9d","Type":"ContainerDied","Data":"f8c2b19261c5fe37796efb58a763fe346b96647632db58bc6575174d3d550bd2"}
Sep 10 19:47:00.177321 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:00.176839    2582 scope.go:117] "RemoveContainer" containerID="9227e3e3d936f069ab82a8e4f400fe16daae31441916d3dd573652a3d98a5ea1"
Sep 10 19:47:00.200443 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:00.200400    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"]
Sep 10 19:47:00.203807 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:00.203780    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b83810-6bb5c77845-cfv2m"]
Sep 10 19:47:00.669643 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:00.669607    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe181001-67a9-44b0-93aa-ce538f9aed9d" path="/var/lib/kubelet/pods/fe181001-67a9-44b0-93aa-ce538f9aed9d/volumes"
Sep 10 19:47:06.267319 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:06.267285    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"]
Sep 10 19:47:06.267895 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:06.267578    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy" containerID="cri-o://a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8" gracePeriod=30
Sep 10 19:47:08.855034 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:08.854999    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b647d647-8qfcp"]
Sep 10 19:47:08.855525 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:08.855191    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b647d647-8qfcp" podUID="9740f761-dfd3-4034-b22c-899d0cb76189" containerName="manager" containerID="cri-o://644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543" gracePeriod=30
Sep 10 19:47:09.097221 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.097196    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:47:09.147847 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.147757    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-webhook-cert\") pod \"9740f761-dfd3-4034-b22c-899d0cb76189\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") "
Sep 10 19:47:09.147847 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.147821    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-metrics-certs\") pod \"9740f761-dfd3-4034-b22c-899d0cb76189\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") "
Sep 10 19:47:09.148089 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.147910    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c9td\" (UniqueName: \"kubernetes.io/projected/9740f761-dfd3-4034-b22c-899d0cb76189-kube-api-access-5c9td\") pod \"9740f761-dfd3-4034-b22c-899d0cb76189\" (UID: \"9740f761-dfd3-4034-b22c-899d0cb76189\") "
Sep 10 19:47:09.149997 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.149960    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9740f761-dfd3-4034-b22c-899d0cb76189" (UID: "9740f761-dfd3-4034-b22c-899d0cb76189"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:47:09.150108 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.150012    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9740f761-dfd3-4034-b22c-899d0cb76189-kube-api-access-5c9td" (OuterVolumeSpecName: "kube-api-access-5c9td") pod "9740f761-dfd3-4034-b22c-899d0cb76189" (UID: "9740f761-dfd3-4034-b22c-899d0cb76189"). InnerVolumeSpecName "kube-api-access-5c9td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:47:09.150108 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.150045    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9740f761-dfd3-4034-b22c-899d0cb76189" (UID: "9740f761-dfd3-4034-b22c-899d0cb76189"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:47:09.216821 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.216790    2582 generic.go:356] "Generic (PLEG): container finished" podID="9740f761-dfd3-4034-b22c-899d0cb76189" containerID="644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543" exitCode=0
Sep 10 19:47:09.216995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.216837    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-8qfcp"
Sep 10 19:47:09.216995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.216881    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-8qfcp" event={"ID":"9740f761-dfd3-4034-b22c-899d0cb76189","Type":"ContainerDied","Data":"644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543"}
Sep 10 19:47:09.216995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.216929    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-8qfcp" event={"ID":"9740f761-dfd3-4034-b22c-899d0cb76189","Type":"ContainerDied","Data":"774e29bf8a45f1f96e0b0b50c4a6d1556b20d50349df0551b47efa2449e48f41"}
Sep 10 19:47:09.216995 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.216956    2582 scope.go:117] "RemoveContainer" containerID="644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543"
Sep 10 19:47:09.226580 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.226561    2582 scope.go:117] "RemoveContainer" containerID="644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543"
Sep 10 19:47:09.226831 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:47:09.226810    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543\": container with ID starting with 644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543 not found: ID does not exist" containerID="644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543"
Sep 10 19:47:09.226894 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.226844    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543"} err="failed to get container status \"644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543\": rpc error: code = NotFound desc = could not find container \"644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543\": container with ID starting with 644f5cbe38098976d7f4bc5681c6fed748be2647d4b322cfbf329562d6a84543 not found: ID does not exist"
Sep 10 19:47:09.240663 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.240638    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b647d647-8qfcp"]
Sep 10 19:47:09.244536 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.244515    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b647d647-8qfcp"]
Sep 10 19:47:09.248671 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.248654    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c9td\" (UniqueName: \"kubernetes.io/projected/9740f761-dfd3-4034-b22c-899d0cb76189-kube-api-access-5c9td\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:09.248742 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.248674    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-webhook-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:09.248742 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:09.248685    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9740f761-dfd3-4034-b22c-899d0cb76189-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:10.667958 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:10.667915    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9740f761-dfd3-4034-b22c-899d0cb76189" path="/var/lib/kubelet/pods/9740f761-dfd3-4034-b22c-899d0cb76189/volumes"
Sep 10 19:47:11.515531 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.515504    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:47:11.568252 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568156    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c364db59-da8c-48a1-a26e-5a7304810ea6-istiod-ca-cert\") pod \"c364db59-da8c-48a1-a26e-5a7304810ea6\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") "
Sep 10 19:47:11.568252 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568201    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-envoy\") pod \"c364db59-da8c-48a1-a26e-5a7304810ea6\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") "
Sep 10 19:47:11.568252 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568222    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-socket\") pod \"c364db59-da8c-48a1-a26e-5a7304810ea6\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") "
Sep 10 19:47:11.568557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568272    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-credential-socket\") pod \"c364db59-da8c-48a1-a26e-5a7304810ea6\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") "
Sep 10 19:47:11.568557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568326    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-data\") pod \"c364db59-da8c-48a1-a26e-5a7304810ea6\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") "
Sep 10 19:47:11.568557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568368    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2492\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-kube-api-access-s2492\") pod \"c364db59-da8c-48a1-a26e-5a7304810ea6\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") "
Sep 10 19:47:11.568557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568396    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-podinfo\") pod \"c364db59-da8c-48a1-a26e-5a7304810ea6\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") "
Sep 10 19:47:11.568557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568450    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-token\") pod \"c364db59-da8c-48a1-a26e-5a7304810ea6\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") "
Sep 10 19:47:11.568557 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568486    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-certs\") pod \"c364db59-da8c-48a1-a26e-5a7304810ea6\" (UID: \"c364db59-da8c-48a1-a26e-5a7304810ea6\") "
Sep 10 19:47:11.568870 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568595    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c364db59-da8c-48a1-a26e-5a7304810ea6" (UID: "c364db59-da8c-48a1-a26e-5a7304810ea6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:11.568870 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568698    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c364db59-da8c-48a1-a26e-5a7304810ea6" (UID: "c364db59-da8c-48a1-a26e-5a7304810ea6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:11.568870 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568719    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c364db59-da8c-48a1-a26e-5a7304810ea6" (UID: "c364db59-da8c-48a1-a26e-5a7304810ea6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:11.568870 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568739    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c364db59-da8c-48a1-a26e-5a7304810ea6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c364db59-da8c-48a1-a26e-5a7304810ea6" (UID: "c364db59-da8c-48a1-a26e-5a7304810ea6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:47:11.568870 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568847    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c364db59-da8c-48a1-a26e-5a7304810ea6" (UID: "c364db59-da8c-48a1-a26e-5a7304810ea6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:11.569131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568893    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-data\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:11.569131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568909    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c364db59-da8c-48a1-a26e-5a7304810ea6-istiod-ca-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:11.569131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568919    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-socket\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:11.569131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.568928    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-credential-socket\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:11.570581 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.570555    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c364db59-da8c-48a1-a26e-5a7304810ea6" (UID: "c364db59-da8c-48a1-a26e-5a7304810ea6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:11.570787 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.570753    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-kube-api-access-s2492" (OuterVolumeSpecName: "kube-api-access-s2492") pod "c364db59-da8c-48a1-a26e-5a7304810ea6" (UID: "c364db59-da8c-48a1-a26e-5a7304810ea6"). InnerVolumeSpecName "kube-api-access-s2492". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:47:11.571084 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.571063    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c364db59-da8c-48a1-a26e-5a7304810ea6" (UID: "c364db59-da8c-48a1-a26e-5a7304810ea6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:47:11.571156 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.571076    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c364db59-da8c-48a1-a26e-5a7304810ea6" (UID: "c364db59-da8c-48a1-a26e-5a7304810ea6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:47:11.670159 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.670120    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-envoy\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:11.670159 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.670152    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2492\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-kube-api-access-s2492\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:11.670159 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.670163    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-podinfo\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:11.670632 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.670173    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c364db59-da8c-48a1-a26e-5a7304810ea6-istio-token\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:11.670632 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:11.670183    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c364db59-da8c-48a1-a26e-5a7304810ea6-workload-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:47:12.232588 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.232545    2582 generic.go:356] "Generic (PLEG): container finished" podID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerID="a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8" exitCode=0
Sep 10 19:47:12.232765 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.232616    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"
Sep 10 19:47:12.232765 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.232631    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" event={"ID":"c364db59-da8c-48a1-a26e-5a7304810ea6","Type":"ContainerDied","Data":"a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8"}
Sep 10 19:47:12.232765 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.232690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z" event={"ID":"c364db59-da8c-48a1-a26e-5a7304810ea6","Type":"ContainerDied","Data":"30c641cedad0b634c40e6e150e1fb8a09ba11a82b645702221c00decf7884469"}
Sep 10 19:47:12.232765 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.232713    2582 scope.go:117] "RemoveContainer" containerID="a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8"
Sep 10 19:47:12.245558 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.245541    2582 scope.go:117] "RemoveContainer" containerID="4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5"
Sep 10 19:47:12.252997 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.252979    2582 scope.go:117] "RemoveContainer" containerID="a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8"
Sep 10 19:47:12.253266 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:47:12.253249    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8\": container with ID starting with a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8 not found: ID does not exist" containerID="a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8"
Sep 10 19:47:12.253308 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.253275    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8"} err="failed to get container status \"a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8\": rpc error: code = NotFound desc = could not find container \"a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8\": container with ID starting with a799e583932c453692876e07a02287ca65b015889e97ac3586a68be227aed4f8 not found: ID does not exist"
Sep 10 19:47:12.253308 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.253291    2582 scope.go:117] "RemoveContainer" containerID="4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5"
Sep 10 19:47:12.253559 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:47:12.253543    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5\": container with ID starting with 4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5 not found: ID does not exist" containerID="4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5"
Sep 10 19:47:12.253605 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.253562    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5"} err="failed to get container status \"4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5\": rpc error: code = NotFound desc = could not find container \"4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5\": container with ID starting with 4d70196ab644caa3679c45a5597977ff1f557d1c21c630d8f35f6003293ce3d5 not found: ID does not exist"
Sep 10 19:47:12.258113 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.258089    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"]
Sep 10 19:47:12.262501 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.262477    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b83810-openshift-default-6d4964446b-7p57z"]
Sep 10 19:47:12.667677 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:47:12.667645    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" path="/var/lib/kubelet/pods/c364db59-da8c-48a1-a26e-5a7304810ea6/volumes"
Sep 10 19:48:10.042271 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042235    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b647d647-vndbh"]
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042550    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d680b74-b020-4a5b-8106-da63e0bccdb7" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042563    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d680b74-b020-4a5b-8106-da63e0bccdb7" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042574    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe181001-67a9-44b0-93aa-ce538f9aed9d" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042580    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe181001-67a9-44b0-93aa-ce538f9aed9d" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042588    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb1e5902-145a-4d75-8e41-32756dd29b72" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042594    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb1e5902-145a-4d75-8e41-32756dd29b72" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042606    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1288859a-8fe5-4804-9bca-dd9afa4cdd38" containerName="payload-pre-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042611    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1288859a-8fe5-4804-9bca-dd9afa4cdd38" containerName="payload-pre-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042624    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042629    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042636    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9740f761-dfd3-4034-b22c-899d0cb76189" containerName="manager"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042641    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9740f761-dfd3-4034-b22c-899d0cb76189" containerName="manager"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042647    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="604dcfbd-a5a2-4195-a73f-abec65dbd777" containerName="maas-api"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042652    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="604dcfbd-a5a2-4195-a73f-abec65dbd777" containerName="maas-api"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042659    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d5afda-d332-49c5-9fe4-bd783a51bdba" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042664    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d5afda-d332-49c5-9fe4-bd783a51bdba" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042669    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef00ce67-6409-4bf0-8a7c-d417f757480b" containerName="maas-api"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042674    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef00ce67-6409-4bf0-8a7c-d417f757480b" containerName="maas-api"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042679    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042684    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042733    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="604dcfbd-a5a2-4195-a73f-abec65dbd777" containerName="maas-api"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042740    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="25d5afda-d332-49c5-9fe4-bd783a51bdba" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042747    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d680b74-b020-4a5b-8106-da63e0bccdb7" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042752    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe181001-67a9-44b0-93aa-ce538f9aed9d" containerName="payload-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042758    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042763    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1288859a-8fe5-4804-9bca-dd9afa4cdd38" containerName="payload-pre-processing"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042769    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c364db59-da8c-48a1-a26e-5a7304810ea6" containerName="istio-proxy"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042775    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9740f761-dfd3-4034-b22c-899d0cb76189" containerName="manager"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042780    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef00ce67-6409-4bf0-8a7c-d417f757480b" containerName="maas-api"
Sep 10 19:48:10.042778 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.042785    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb1e5902-145a-4d75-8e41-32756dd29b72" containerName="payload-processing"
Sep 10 19:48:10.045683 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.045667    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.049241 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.049211    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sn4np\""
Sep 10 19:48:10.049427 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.049237    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 19:48:10.049427 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.049282    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 19:48:10.049427 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.049287    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 19:48:10.058051 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.058028    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b647d647-vndbh"]
Sep 10 19:48:10.158911 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.158876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-webhook-cert\") pod \"maas-controller-5b647d647-vndbh\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") " pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.158911 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.158911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-metrics-certs\") pod \"maas-controller-5b647d647-vndbh\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") " pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.159139 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.158946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs28q\" (UniqueName: \"kubernetes.io/projected/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-kube-api-access-rs28q\") pod \"maas-controller-5b647d647-vndbh\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") " pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.260051 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.260021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-webhook-cert\") pod \"maas-controller-5b647d647-vndbh\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") " pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.260051 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.260052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-metrics-certs\") pod \"maas-controller-5b647d647-vndbh\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") " pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.260254 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.260088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs28q\" (UniqueName: \"kubernetes.io/projected/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-kube-api-access-rs28q\") pod \"maas-controller-5b647d647-vndbh\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") " pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.262528 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.262503    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-webhook-cert\") pod \"maas-controller-5b647d647-vndbh\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") " pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.262686 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.262579    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-metrics-certs\") pod \"maas-controller-5b647d647-vndbh\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") " pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.269118 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.269095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs28q\" (UniqueName: \"kubernetes.io/projected/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-kube-api-access-rs28q\") pod \"maas-controller-5b647d647-vndbh\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") " pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.356105 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.356026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:10.625842 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.625817    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b647d647-vndbh"]
Sep 10 19:48:10.628227 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:48:10.628199    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c65a5f_e4cb_4cfd_abbd_bf506a631e16.slice/crio-17a621ccc3ecbae4824c51e4af19c915b34e9b1e8653b455d8c6db931223b010 WatchSource:0}: Error finding container 17a621ccc3ecbae4824c51e4af19c915b34e9b1e8653b455d8c6db931223b010: Status 404 returned error can't find the container with id 17a621ccc3ecbae4824c51e4af19c915b34e9b1e8653b455d8c6db931223b010
Sep 10 19:48:10.629616 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:10.629597    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:48:11.490997 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:11.490891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-vndbh" event={"ID":"19c65a5f-e4cb-4cfd-abbd-bf506a631e16","Type":"ContainerStarted","Data":"b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce"}
Sep 10 19:48:11.490997 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:11.490953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-vndbh" event={"ID":"19c65a5f-e4cb-4cfd-abbd-bf506a631e16","Type":"ContainerStarted","Data":"17a621ccc3ecbae4824c51e4af19c915b34e9b1e8653b455d8c6db931223b010"}
Sep 10 19:48:11.490997 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:11.490981    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:11.511191 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:11.511139    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b647d647-vndbh" podStartSLOduration=0.995635786 podStartE2EDuration="1.511124803s" totalImagesPullingTime="515.489017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:48:11.510292135 +0000 UTC m=+1943.365847187" watchObservedRunningTime="2026-09-10 19:48:11.511124803 +0000 UTC m=+1943.366679832"
Sep 10 19:48:22.498695 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:22.498660    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:33.992034 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:33.991995    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b647d647-vndbh"]
Sep 10 19:48:33.992552 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:33.992202    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b647d647-vndbh" podUID="19c65a5f-e4cb-4cfd-abbd-bf506a631e16" containerName="manager" containerID="cri-o://b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce" gracePeriod=30
Sep 10 19:48:34.228817 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.228790    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:34.360131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.360095    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs28q\" (UniqueName: \"kubernetes.io/projected/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-kube-api-access-rs28q\") pod \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") "
Sep 10 19:48:34.360328 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.360172    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-webhook-cert\") pod \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") "
Sep 10 19:48:34.360328 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.360216    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-metrics-certs\") pod \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\" (UID: \"19c65a5f-e4cb-4cfd-abbd-bf506a631e16\") "
Sep 10 19:48:34.362264 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.362228    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-kube-api-access-rs28q" (OuterVolumeSpecName: "kube-api-access-rs28q") pod "19c65a5f-e4cb-4cfd-abbd-bf506a631e16" (UID: "19c65a5f-e4cb-4cfd-abbd-bf506a631e16"). InnerVolumeSpecName "kube-api-access-rs28q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:48:34.362390 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.362280    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "19c65a5f-e4cb-4cfd-abbd-bf506a631e16" (UID: "19c65a5f-e4cb-4cfd-abbd-bf506a631e16"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:48:34.362390 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.362303    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "19c65a5f-e4cb-4cfd-abbd-bf506a631e16" (UID: "19c65a5f-e4cb-4cfd-abbd-bf506a631e16"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:48:34.461612 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.461584    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs28q\" (UniqueName: \"kubernetes.io/projected/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-kube-api-access-rs28q\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:48:34.461612 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.461607    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-webhook-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:48:34.461612 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.461616    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c65a5f-e4cb-4cfd-abbd-bf506a631e16-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:48:34.591972 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.591942    2582 generic.go:356] "Generic (PLEG): container finished" podID="19c65a5f-e4cb-4cfd-abbd-bf506a631e16" containerID="b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce" exitCode=0
Sep 10 19:48:34.592154 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.591977    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-vndbh" event={"ID":"19c65a5f-e4cb-4cfd-abbd-bf506a631e16","Type":"ContainerDied","Data":"b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce"}
Sep 10 19:48:34.592154 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.591985    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-vndbh"
Sep 10 19:48:34.592154 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.592017    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-vndbh" event={"ID":"19c65a5f-e4cb-4cfd-abbd-bf506a631e16","Type":"ContainerDied","Data":"17a621ccc3ecbae4824c51e4af19c915b34e9b1e8653b455d8c6db931223b010"}
Sep 10 19:48:34.592154 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.592046    2582 scope.go:117] "RemoveContainer" containerID="b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce"
Sep 10 19:48:34.600632 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.600612    2582 scope.go:117] "RemoveContainer" containerID="b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce"
Sep 10 19:48:34.600891 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:48:34.600871    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce\": container with ID starting with b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce not found: ID does not exist" containerID="b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce"
Sep 10 19:48:34.600952 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.600903    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce"} err="failed to get container status \"b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce\": rpc error: code = NotFound desc = could not find container \"b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce\": container with ID starting with b8f47da6124fba3d0d12359b23561d5bb68e26bede4e063010212cfd1f29f5ce not found: ID does not exist"
Sep 10 19:48:34.615158 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.615090    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b647d647-vndbh"]
Sep 10 19:48:34.622754 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.622732    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b647d647-vndbh"]
Sep 10 19:48:34.668302 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:34.668268    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c65a5f-e4cb-4cfd-abbd-bf506a631e16" path="/var/lib/kubelet/pods/19c65a5f-e4cb-4cfd-abbd-bf506a631e16/volumes"
Sep 10 19:48:35.439493 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.439453    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b647d647-qmfz4"]
Sep 10 19:48:35.439875 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.439752    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c65a5f-e4cb-4cfd-abbd-bf506a631e16" containerName="manager"
Sep 10 19:48:35.439875 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.439763    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c65a5f-e4cb-4cfd-abbd-bf506a631e16" containerName="manager"
Sep 10 19:48:35.439875 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.439823    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c65a5f-e4cb-4cfd-abbd-bf506a631e16" containerName="manager"
Sep 10 19:48:35.444113 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.444093    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.447335 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.447312    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 19:48:35.447480 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.447371    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 19:48:35.447480 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.447379    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sn4np\""
Sep 10 19:48:35.447480 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.447439    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 19:48:35.455240 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.455220    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b647d647-qmfz4"]
Sep 10 19:48:35.571052 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.571020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca163e77-8119-42b4-a80f-04cb334c72b2-webhook-cert\") pod \"maas-controller-5b647d647-qmfz4\" (UID: \"ca163e77-8119-42b4-a80f-04cb334c72b2\") " pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.571052 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.571051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca163e77-8119-42b4-a80f-04cb334c72b2-metrics-certs\") pod \"maas-controller-5b647d647-qmfz4\" (UID: \"ca163e77-8119-42b4-a80f-04cb334c72b2\") " pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.571239 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.571079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhhmq\" (UniqueName: \"kubernetes.io/projected/ca163e77-8119-42b4-a80f-04cb334c72b2-kube-api-access-hhhmq\") pod \"maas-controller-5b647d647-qmfz4\" (UID: \"ca163e77-8119-42b4-a80f-04cb334c72b2\") " pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.671625 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.671597    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhhmq\" (UniqueName: \"kubernetes.io/projected/ca163e77-8119-42b4-a80f-04cb334c72b2-kube-api-access-hhhmq\") pod \"maas-controller-5b647d647-qmfz4\" (UID: \"ca163e77-8119-42b4-a80f-04cb334c72b2\") " pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.671809 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.671659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca163e77-8119-42b4-a80f-04cb334c72b2-webhook-cert\") pod \"maas-controller-5b647d647-qmfz4\" (UID: \"ca163e77-8119-42b4-a80f-04cb334c72b2\") " pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.671809 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.671764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca163e77-8119-42b4-a80f-04cb334c72b2-metrics-certs\") pod \"maas-controller-5b647d647-qmfz4\" (UID: \"ca163e77-8119-42b4-a80f-04cb334c72b2\") " pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.674123 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.674097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca163e77-8119-42b4-a80f-04cb334c72b2-webhook-cert\") pod \"maas-controller-5b647d647-qmfz4\" (UID: \"ca163e77-8119-42b4-a80f-04cb334c72b2\") " pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.674231 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.674097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca163e77-8119-42b4-a80f-04cb334c72b2-metrics-certs\") pod \"maas-controller-5b647d647-qmfz4\" (UID: \"ca163e77-8119-42b4-a80f-04cb334c72b2\") " pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.680881 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.680864    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhhmq\" (UniqueName: \"kubernetes.io/projected/ca163e77-8119-42b4-a80f-04cb334c72b2-kube-api-access-hhhmq\") pod \"maas-controller-5b647d647-qmfz4\" (UID: \"ca163e77-8119-42b4-a80f-04cb334c72b2\") " pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:35.753573 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:35.753492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:36.027842 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:36.027813    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b647d647-qmfz4"]
Sep 10 19:48:36.030670 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:48:36.030643    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca163e77_8119_42b4_a80f_04cb334c72b2.slice/crio-f2a33088b566371b754bc30bc5058a92fd11b88cf4e6f523800e2b165e6abb1e WatchSource:0}: Error finding container f2a33088b566371b754bc30bc5058a92fd11b88cf4e6f523800e2b165e6abb1e: Status 404 returned error can't find the container with id f2a33088b566371b754bc30bc5058a92fd11b88cf4e6f523800e2b165e6abb1e
Sep 10 19:48:36.604400 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:36.604367    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-qmfz4" event={"ID":"ca163e77-8119-42b4-a80f-04cb334c72b2","Type":"ContainerStarted","Data":"26817c13b468f71f4ee64e788398a767466b94f92bc8ec4a3becef54aa1ea051"}
Sep 10 19:48:36.604801 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:36.604431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b647d647-qmfz4" event={"ID":"ca163e77-8119-42b4-a80f-04cb334c72b2","Type":"ContainerStarted","Data":"f2a33088b566371b754bc30bc5058a92fd11b88cf4e6f523800e2b165e6abb1e"}
Sep 10 19:48:36.604801 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:36.604454    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:48:36.623259 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:36.623168    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b647d647-qmfz4" podStartSLOduration=1.282668458 podStartE2EDuration="1.623150986s" totalImagesPullingTime="340.482528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:48:36.621826179 +0000 UTC m=+1968.477381232" watchObservedRunningTime="2026-09-10 19:48:36.623150986 +0000 UTC m=+1968.478706036"
Sep 10 19:48:47.611309 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:48:47.611231    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b647d647-qmfz4"
Sep 10 19:50:48.858783 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:50:48.858755    2582 scope.go:117] "RemoveContainer" containerID="4dd229c15f67127c4dbca258468b8f93209389f1688e27cdb0dcb58953d504df"
Sep 10 19:52:49.148899 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.148866    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"]
Sep 10 19:52:49.152023 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.152005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.161699 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.161626    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"]
Sep 10 19:52:49.316921 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.316873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5749825-3eea-4c08-a6af-1a11bb12a532-maas-api-tls\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.317117 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.316958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4jkx\" (UniqueName: \"kubernetes.io/projected/b5749825-3eea-4c08-a6af-1a11bb12a532-kube-api-access-p4jkx\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.317117 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.317018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5749825-3eea-4c08-a6af-1a11bb12a532-metrics-certs\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.317117 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.317076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5749825-3eea-4c08-a6af-1a11bb12a532-openshift-service-ca\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.418160 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.418072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5749825-3eea-4c08-a6af-1a11bb12a532-metrics-certs\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.418160 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.418108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5749825-3eea-4c08-a6af-1a11bb12a532-openshift-service-ca\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.418160 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.418147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5749825-3eea-4c08-a6af-1a11bb12a532-maas-api-tls\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.418465 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.418170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jkx\" (UniqueName: \"kubernetes.io/projected/b5749825-3eea-4c08-a6af-1a11bb12a532-kube-api-access-p4jkx\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.418862 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.418838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5749825-3eea-4c08-a6af-1a11bb12a532-openshift-service-ca\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.420735 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.420708    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5749825-3eea-4c08-a6af-1a11bb12a532-metrics-certs\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.420735 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.420725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5749825-3eea-4c08-a6af-1a11bb12a532-maas-api-tls\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.426468 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.426448    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4jkx\" (UniqueName: \"kubernetes.io/projected/b5749825-3eea-4c08-a6af-1a11bb12a532-kube-api-access-p4jkx\") pod \"maas-api-8cb5f7c95-j5d6q\" (UID: \"b5749825-3eea-4c08-a6af-1a11bb12a532\") " pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.463129 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.463093    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:49.740028 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:49.740003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"]
Sep 10 19:52:49.741990 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:52:49.741963    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5749825_3eea_4c08_a6af_1a11bb12a532.slice/crio-5c55d476cb09a052beba9ce2f0c786b799582f029f5f9a416f86a15be008b808 WatchSource:0}: Error finding container 5c55d476cb09a052beba9ce2f0c786b799582f029f5f9a416f86a15be008b808: Status 404 returned error can't find the container with id 5c55d476cb09a052beba9ce2f0c786b799582f029f5f9a416f86a15be008b808
Sep 10 19:52:50.670022 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:50.669984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q" event={"ID":"b5749825-3eea-4c08-a6af-1a11bb12a532","Type":"ContainerStarted","Data":"320eedb9a8d3ad5baee1154f98ede2e850077625de4a37bc7f428388de629d6d"}
Sep 10 19:52:50.670467 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:50.670045    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q" event={"ID":"b5749825-3eea-4c08-a6af-1a11bb12a532","Type":"ContainerStarted","Data":"5c55d476cb09a052beba9ce2f0c786b799582f029f5f9a416f86a15be008b808"}
Sep 10 19:52:50.670467 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:50.670109    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:52:50.689640 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:50.689597    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q" podStartSLOduration=1.195054785 podStartE2EDuration="1.689582907s" totalImagesPullingTime="494.528122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:52:50.688537702 +0000 UTC m=+2222.544092758" watchObservedRunningTime="2026-09-10 19:52:50.689582907 +0000 UTC m=+2222.545137973"
Sep 10 19:52:56.679787 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:52:56.679756    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8cb5f7c95-j5d6q"
Sep 10 19:53:04.726398 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:04.726358    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"]
Sep 10 19:53:04.726962 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:04.726622    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52" podUID="bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" containerName="maas-api" containerID="cri-o://de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25" gracePeriod=30
Sep 10 19:53:05.967055 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:05.967028    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:53:06.059786 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.059754    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cr7z\" (UniqueName: \"kubernetes.io/projected/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-kube-api-access-4cr7z\") pod \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") "
Sep 10 19:53:06.059786 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.059791    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-metrics-certs\") pod \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") "
Sep 10 19:53:06.060023 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.059846    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-openshift-service-ca\") pod \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") "
Sep 10 19:53:06.060023 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.059868    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-maas-api-tls\") pod \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\" (UID: \"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f\") "
Sep 10 19:53:06.060253 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.060227    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" (UID: "bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:53:06.061921 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.061895    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-kube-api-access-4cr7z" (OuterVolumeSpecName: "kube-api-access-4cr7z") pod "bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" (UID: "bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f"). InnerVolumeSpecName "kube-api-access-4cr7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:53:06.062035 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.061930    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" (UID: "bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:53:06.062035 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.061985    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" (UID: "bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:53:06.160721 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.160632    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-openshift-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:53:06.160721 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.160662    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-maas-api-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:53:06.160721 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.160672    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cr7z\" (UniqueName: \"kubernetes.io/projected/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-kube-api-access-4cr7z\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:53:06.160721 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.160682    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f-metrics-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\""
Sep 10 19:53:06.741093 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.741052    2582 generic.go:356] "Generic (PLEG): container finished" podID="bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" containerID="de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25" exitCode=0
Sep 10 19:53:06.741093 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.741097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52" event={"ID":"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f","Type":"ContainerDied","Data":"de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25"}
Sep 10 19:53:06.741316 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.741106    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"
Sep 10 19:53:06.741316 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.741139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52" event={"ID":"bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f","Type":"ContainerDied","Data":"a866676421b84464706f3c07d921b5599f502d84b64bbf7bca6e95367d3e55d5"}
Sep 10 19:53:06.741316 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.741160    2582 scope.go:117] "RemoveContainer" containerID="de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25"
Sep 10 19:53:06.749653 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.749634    2582 scope.go:117] "RemoveContainer" containerID="de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25"
Sep 10 19:53:06.749920 ip-10-0-130-178 kubenswrapper[2582]: E0910 19:53:06.749893    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25\": container with ID starting with de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25 not found: ID does not exist" containerID="de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25"
Sep 10 19:53:06.750033 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.749928    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25"} err="failed to get container status \"de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25\": rpc error: code = NotFound desc = could not find container \"de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25\": container with ID starting with de47e91f880faf87421a817cf765e6094e3f80f2332fb881cc679f98cb3f7e25 not found: ID does not exist"
Sep 10 19:53:06.762431 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.762391    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"]
Sep 10 19:53:06.766467 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:06.766445    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d4dc54f4c-dcx52"]
Sep 10 19:53:08.667800 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:08.667763    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" path="/var/lib/kubelet/pods/bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f/volumes"
Sep 10 19:53:28.783479 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:28.783434    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b647d647-qmfz4_ca163e77-8119-42b4-a80f-04cb334c72b2/manager/0.log"
Sep 10 19:53:29.143626 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:29.143543    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55556678b8-fqzcx_cc12735e-663e-44ad-8868-cc28476055ea/copy-manifests/0.log"
Sep 10 19:53:29.165444 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:29.162123    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55556678b8-fqzcx_cc12735e-663e-44ad-8868-cc28476055ea/manager/0.log"
Sep 10 19:53:29.875877 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:29.875837    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8cb5f7c95-j5d6q_b5749825-3eea-4c08-a6af-1a11bb12a532/maas-api/0.log"
Sep 10 19:53:30.209534 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:30.209446    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-p6r25_cdb6504c-3a19-4582-be4a-db70638b0b1f/postgres/0.log"
Sep 10 19:53:32.215607 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:32.215569    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2tcnh_807bd2f5-c25b-4cad-a558-68f9e7f4eb1e/discovery/0.log"
Sep 10 19:53:33.295153 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:33.295122    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-p5ltm_48760909-4c40-4775-82c6-75d8d664682e/main/0.log"
Sep 10 19:53:33.525190 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:33.525159    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-kgrq5_5026d492-1867-47b7-84f8-2cc293c65900/main/0.log"
Sep 10 19:53:33.751501 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:33.751383    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvgknj_55b1be60-b3f4-4013-80bf-8bbf91cffd79/main/0.log"
Sep 10 19:53:43.036865 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:43.036831    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4rh8j_44581864-3e22-4509-ad4f-03e3ec946cd5/global-pull-secret-syncer/0.log"
Sep 10 19:53:43.268084 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:43.268054    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zmmqh_13c9f34d-129c-4305-afec-7e721ec05a79/konnectivity-agent/0.log"
Sep 10 19:53:43.335221 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:43.335150    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-178.ec2.internal_b0b12b2fbd9460cffd368b1bb1ef73f5/haproxy/0.log"
Sep 10 19:53:50.271733 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:50.271691    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzrrx_0daeaa12-8c68-455d-b723-8e2914964cdc/node-exporter/0.log"
Sep 10 19:53:50.298106 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:50.298078    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzrrx_0daeaa12-8c68-455d-b723-8e2914964cdc/kube-rbac-proxy/0.log"
Sep 10 19:53:50.320909 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:50.320888    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzrrx_0daeaa12-8c68-455d-b723-8e2914964cdc/init-textfile/0.log"
Sep 10 19:53:54.036400 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.036366    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"]
Sep 10 19:53:54.036821 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.036675    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" containerName="maas-api"
Sep 10 19:53:54.036821 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.036687    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" containerName="maas-api"
Sep 10 19:53:54.036821 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.036753    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcdd401b-6ef0-42e4-b6f3-cfefbf1a980f" containerName="maas-api"
Sep 10 19:53:54.040861 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.040841    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.043754 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.043733    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8bt8w\"/\"openshift-service-ca.crt\""
Sep 10 19:53:54.043880 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.043754    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8bt8w\"/\"kube-root-ca.crt\""
Sep 10 19:53:54.044906 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.044764    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8bt8w\"/\"default-dockercfg-ss8rz\""
Sep 10 19:53:54.047012 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.046990    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"]
Sep 10 19:53:54.150728 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.150692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-lib-modules\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.150896 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.150744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvk7n\" (UniqueName: \"kubernetes.io/projected/fc40ec1b-7864-4907-b743-aaa02de69d3a-kube-api-access-hvk7n\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.150896 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.150812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-sys\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.150896 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.150872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-podres\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.151010 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.150916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-proc\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.251491 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.251459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-sys\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.251491 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.251497    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-podres\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.251726 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.251523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-proc\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.251726 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.251553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-lib-modules\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.251726 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.251581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvk7n\" (UniqueName: \"kubernetes.io/projected/fc40ec1b-7864-4907-b743-aaa02de69d3a-kube-api-access-hvk7n\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.251726 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.251593    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-sys\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.251726 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.251618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-proc\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.251726 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.251636    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-podres\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.251726 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.251696    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc40ec1b-7864-4907-b743-aaa02de69d3a-lib-modules\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.260187 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.260165    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvk7n\" (UniqueName: \"kubernetes.io/projected/fc40ec1b-7864-4907-b743-aaa02de69d3a-kube-api-access-hvk7n\") pod \"perf-node-gather-daemonset-q67q9\" (UID: \"fc40ec1b-7864-4907-b743-aaa02de69d3a\") " pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.351676 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.351595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.620788 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.620765    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"]
Sep 10 19:53:54.623010 ip-10-0-130-178 kubenswrapper[2582]: W0910 19:53:54.622978    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc40ec1b_7864_4907_b743_aaa02de69d3a.slice/crio-864eabba0f78ee71c3188fbbaec7f91c03eb4324e0c65c34eb96d0b2ab373cb8 WatchSource:0}: Error finding container 864eabba0f78ee71c3188fbbaec7f91c03eb4324e0c65c34eb96d0b2ab373cb8: Status 404 returned error can't find the container with id 864eabba0f78ee71c3188fbbaec7f91c03eb4324e0c65c34eb96d0b2ab373cb8
Sep 10 19:53:54.945507 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.945400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9" event={"ID":"fc40ec1b-7864-4907-b743-aaa02de69d3a","Type":"ContainerStarted","Data":"8dfcd6ccda59c1b33ba49616fa0c21958e0bfeced164efbb32cab61e5d30986f"}
Sep 10 19:53:54.945507 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.945473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9" event={"ID":"fc40ec1b-7864-4907-b743-aaa02de69d3a","Type":"ContainerStarted","Data":"864eabba0f78ee71c3188fbbaec7f91c03eb4324e0c65c34eb96d0b2ab373cb8"}
Sep 10 19:53:54.945688 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.945529    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:53:54.963571 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:54.963527    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9" podStartSLOduration=0.963515708 podStartE2EDuration="963.515708ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:53:54.962913168 +0000 UTC m=+2286.818468245" watchObservedRunningTime="2026-09-10 19:53:54.963515708 +0000 UTC m=+2286.819070736"
Sep 10 19:53:56.002593 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:56.002556    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xwwll_b9d67ecc-7752-483c-a716-e603acbc782b/dns/0.log"
Sep 10 19:53:56.025131 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:56.025104    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xwwll_b9d67ecc-7752-483c-a716-e603acbc782b/kube-rbac-proxy/0.log"
Sep 10 19:53:56.082171 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:56.082147    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hxp26_04db8de7-0543-4f84-b79b-58de660fd4d3/dns-node-resolver/0.log"
Sep 10 19:53:56.716571 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:56.716536    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2cpxl_91a99c79-d5ae-4757-b689-764bd57e3eea/node-ca/0.log"
Sep 10 19:53:58.264601 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:58.264571    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2tcnh_807bd2f5-c25b-4cad-a558-68f9e7f4eb1e/discovery/0.log"
Sep 10 19:53:59.422943 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:53:59.422915    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zkvnb_c55461a6-a784-44eb-a1b6-6c8772f3b7a2/serve-healthcheck-canary/0.log"
Sep 10 19:54:00.044865 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:00.044835    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mlslf_069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b/kube-rbac-proxy/0.log"
Sep 10 19:54:00.067337 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:00.067310    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mlslf_069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b/exporter/0.log"
Sep 10 19:54:00.091009 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:00.090981    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mlslf_069e53c9-9a5f-4d9f-bb2d-87c14eb09b6b/extractor/0.log"
Sep 10 19:54:00.959471 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:00.959439    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8bt8w/perf-node-gather-daemonset-q67q9"
Sep 10 19:54:02.601964 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:02.601931    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b647d647-qmfz4_ca163e77-8119-42b4-a80f-04cb334c72b2/manager/0.log"
Sep 10 19:54:02.827097 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:02.827063    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55556678b8-fqzcx_cc12735e-663e-44ad-8868-cc28476055ea/manager/0.log"
Sep 10 19:54:02.846574 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:02.846546    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55556678b8-fqzcx_cc12735e-663e-44ad-8868-cc28476055ea/copy-manifests/0.log"
Sep 10 19:54:04.486179 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:04.486145    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77f5df88d-z5ccs_4ebb95c8-3b19-475c-abae-0953bd086eab/manager/0.log"
Sep 10 19:54:04.985196 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:04.985160    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2tcnh_807bd2f5-c25b-4cad-a558-68f9e7f4eb1e/discovery/0.log"
Sep 10 19:54:07.114896 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:07.114862    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2tcnh_807bd2f5-c25b-4cad-a558-68f9e7f4eb1e/discovery/0.log"
Sep 10 19:54:09.849254 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:09.849226    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-tlkxv_1027ec38-921f-439c-be4f-eb7882c5e2c4/migrator/0.log"
Sep 10 19:54:09.870875 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:09.870849    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-tlkxv_1027ec38-921f-439c-be4f-eb7882c5e2c4/graceful-termination/0.log"
Sep 10 19:54:11.281095 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:11.281064    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m8jt_485070b7-9f4c-4d85-8253-89e4199f27a5/kube-multus-additional-cni-plugins/0.log"
Sep 10 19:54:11.303430 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:11.303398    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m8jt_485070b7-9f4c-4d85-8253-89e4199f27a5/egress-router-binary-copy/0.log"
Sep 10 19:54:11.326441 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:11.326406    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m8jt_485070b7-9f4c-4d85-8253-89e4199f27a5/cni-plugins/0.log"
Sep 10 19:54:11.347351 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:11.347332    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m8jt_485070b7-9f4c-4d85-8253-89e4199f27a5/bond-cni-plugin/0.log"
Sep 10 19:54:11.368609 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:11.368587    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m8jt_485070b7-9f4c-4d85-8253-89e4199f27a5/routeoverride-cni/0.log"
Sep 10 19:54:11.391685 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:11.391663    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m8jt_485070b7-9f4c-4d85-8253-89e4199f27a5/whereabouts-cni-bincopy/0.log"
Sep 10 19:54:11.413732 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:11.413713    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2m8jt_485070b7-9f4c-4d85-8253-89e4199f27a5/whereabouts-cni/0.log"
Sep 10 19:54:11.796250 ip-10-0-130-178 kubenswrapper[2582]: I0910 19:54:11.796221    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-chrt4_dc737961-c84b-467d-9627-dcbdfa1571d2/kube-multus/0.log"